Jul 24 16:13:31 user nova-compute[70243]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Jul 24 16:13:34 user nova-compute[70243]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=70243) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=70243) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=70243) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 24 16:13:34 user nova-compute[70243]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.022s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:13:34 user nova-compute[70243]: INFO nova.virt.driver [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] Loading compute driver 'libvirt.LibvirtDriver'
Jul 24 16:13:34 user nova-compute[70243]: INFO nova.compute.provider_config [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] Acquiring lock "singleton_lock" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] Acquired lock "singleton_lock" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] Releasing lock "singleton_lock" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] Full set of CONF: {{(pid=70243) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ******************************************************************************** {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] Configuration options gathered from: {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ================================================================================ {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] allow_resize_to_same_host      = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] arq_binding_timeout            = 300 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] backdoor_port                  = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] backdoor_socket                = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] block_device_allocate_retries  = 300 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] block_device_allocate_retries_interval = 5 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cert                           = self.pem {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] compute_monitors               = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] config_dir                     = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] config_drive_format            = iso9660 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] config_source                  = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] console_host                   = user {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] control_exchange               = nova {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cpu_allocation_ratio           = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] daemon                         = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] debug                          = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] default_access_ip_network_name = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] default_availability_zone      = nova {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] default_ephemeral_format       = ext4 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] default_schedule_zone          = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] disk_allocation_ratio          = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] enable_new_services            = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] enabled_apis                   = ['osapi_compute'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] enabled_ssl_apis               = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] flat_injected                  = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] force_config_drive             = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] force_raw_images               = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] graceful_shutdown_timeout      = 5 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] heal_instance_info_cache_interval = 60 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] host                           = user {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] instance_build_timeout         = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] instance_delete_interval       = 300 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] instance_format                = [instance: %(uuid)s]  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] instance_name_template         = instance-%08x {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] instance_usage_audit           = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] instance_usage_audit_period    = month {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] internal_service_availability_zone = internal {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] key                            = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] live_migration_retry_count     = 30 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] log_config_append              = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] log_dir                        = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] log_file                       = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] log_options                    = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] log_rotate_interval            = 1 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] log_rotate_interval_type       = days {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] log_rotation_type              = none {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] long_rpc_timeout               = 1800 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] max_concurrent_builds          = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] max_concurrent_live_migrations = 1 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] max_concurrent_snapshots       = 5 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] max_local_block_devices        = 3 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] max_logfile_count              = 30 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] max_logfile_size_mb            = 200 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] maximum_instance_delete_attempts = 5 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] metadata_listen                = 0.0.0.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] metadata_listen_port           = 8775 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] metadata_workers               = 3 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] migrate_max_retries            = -1 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] mkisofs_cmd                    = genisoimage {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] my_ip                          = 10.0.0.210 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] network_allocate_retries       = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] osapi_compute_listen_port      = 8774 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] osapi_compute_unique_server_name_scope =  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] osapi_compute_workers          = 3 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] password_length                = 12 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] periodic_enable                = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] periodic_fuzzy_delay           = 60 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] pointer_model                  = ps2mouse {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] preallocate_images             = none {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] publish_errors                 = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] pybasedir                      = /opt/stack/nova {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ram_allocation_ratio           = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] rate_limit_burst               = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] rate_limit_except_level        = CRITICAL {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] rate_limit_interval            = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] reboot_timeout                 = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] reclaim_instance_interval      = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] record                         = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] reimage_timeout_per_gb         = 60 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] report_interval                = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] rescue_timeout                 = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] reserved_host_cpus             = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] reserved_host_disk_mb          = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] reserved_host_memory_mb        = 512 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] reserved_huge_pages            = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] resize_confirm_window          = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] resize_fs_using_block_device   = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] resume_guests_state_on_host_boot = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] rpc_response_timeout           = 60 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] run_external_periodic_tasks    = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] running_deleted_instance_action = reap {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] running_deleted_instance_poll_interval = 1800 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] running_deleted_instance_timeout = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] scheduler_instance_sync_interval = 120 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] service_down_time              = 60 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] servicegroup_driver            = db {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] shelved_offload_time           = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] shelved_poll_interval          = 3600 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] shutdown_timeout               = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] source_is_ipv6                 = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ssl_only                       = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] state_path                     = /opt/stack/data/nova {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] sync_power_state_interval      = 600 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] sync_power_state_pool_size     = 1000 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] syslog_log_facility            = LOG_USER {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] tempdir                        = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] timeout_nbd                    = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] transport_url                  = **** {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] update_resources_interval      = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] use_cow_images                 = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] use_eventlog                   = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] use_journal                    = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] use_json                       = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] use_rootwrap_daemon            = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] use_stderr                     = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] use_syslog                     = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vcpu_pin_set                   = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vif_plugging_is_fatal          = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vif_plugging_timeout           = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] virt_mkfs                      = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] volume_usage_poll_interval     = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] watch_log_file                 = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] web                            = /usr/share/spice-html5 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_concurrency.disable_process_locking = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.auth_strategy              = keystone {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.compute_link_prefix        = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.dhcp_domain                = novalocal {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.enable_instance_password   = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.glance_link_prefix         = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.instance_list_per_project_cells = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.list_records_by_skipping_down_cells = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.local_metadata_per_cell    = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.max_limit                  = 1000 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.metadata_cache_expiration  = 15 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.neutron_default_tenant_id  = default {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.use_forwarded_for          = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.use_neutron_default_nets   = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.vendordata_dynamic_targets = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.vendordata_jsonfile_path   = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.backend                  = dogpile.cache.memcached {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.backend_argument         = **** {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.config_prefix            = cache.oslo {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.dead_timeout             = 60.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.debug_cache_backend      = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.enable_retry_client      = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.enable_socket_keepalive  = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.enabled                  = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.expiration_time          = 600 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.hashclient_retry_attempts = 2 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.memcache_dead_retry      = 300 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.memcache_password        =  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.memcache_pool_maxsize    = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.memcache_sasl_enabled    = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.memcache_username        =  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.proxies                  = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.retry_attempts           = 2 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.retry_delay              = 0.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.socket_keepalive_count   = 1 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.socket_keepalive_idle    = 1 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.socket_keepalive_interval = 1 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.tls_allowed_ciphers      = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.tls_cafile               = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.tls_certfile             = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.tls_enabled              = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cache.tls_keyfile              = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cinder.auth_section            = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cinder.auth_type               = password {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cinder.cafile                  = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cinder.certfile                = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cinder.collect_timing          = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cinder.cross_az_attach         = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cinder.debug                   = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cinder.endpoint_template       = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cinder.http_retries            = 3 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cinder.insecure                = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cinder.keyfile                 = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cinder.os_region_name          = RegionOne {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cinder.split_loggers           = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cinder.timeout                 = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] compute.cpu_dedicated_set      = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] compute.cpu_shared_set         = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] compute.image_type_exclude_list = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] compute.max_concurrent_disk_ops = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] compute.max_disk_devices_to_attach = -1 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] compute.resource_provider_association_refresh = 300 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] compute.shutdown_retry_interval = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] conductor.workers              = 3 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] console.allowed_origins        = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] console.ssl_ciphers            = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] console.ssl_minimum_version    = default {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] consoleauth.token_ttl          = 600 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cyborg.cafile                  = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cyborg.certfile                = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cyborg.collect_timing          = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cyborg.connect_retries         = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cyborg.connect_retry_delay     = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cyborg.endpoint_override       = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cyborg.insecure                = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cyborg.keyfile                 = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cyborg.max_version             = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cyborg.min_version             = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cyborg.region_name             = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cyborg.service_name            = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cyborg.service_type            = accelerator {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cyborg.split_loggers           = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cyborg.status_code_retries     = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cyborg.status_code_retry_delay = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cyborg.timeout                 = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] cyborg.version                 = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] database.backend               = sqlalchemy {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] database.connection            = **** {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] database.connection_debug      = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] database.connection_parameters =  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] database.connection_recycle_time = 3600 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] database.connection_trace      = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] database.db_inc_retry_interval = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] database.db_max_retries        = 20 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] database.db_max_retry_interval = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] database.db_retry_interval     = 1 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] database.max_overflow          = 50 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] database.max_pool_size         = 5 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] database.max_retries           = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] database.mysql_enable_ndb      = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] database.mysql_wsrep_sync_wait = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] database.pool_timeout          = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] database.retry_interval        = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] database.slave_connection      = **** {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] database.sqlite_synchronous    = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api_database.backend           = sqlalchemy {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api_database.connection        = **** {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api_database.connection_debug  = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api_database.connection_parameters =  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api_database.connection_recycle_time = 3600 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api_database.connection_trace  = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api_database.db_inc_retry_interval = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api_database.db_max_retries    = 20 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api_database.db_max_retry_interval = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api_database.db_retry_interval = 1 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api_database.max_overflow      = 50 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api_database.max_pool_size     = 5 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api_database.max_retries       = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api_database.mysql_enable_ndb  = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api_database.pool_timeout      = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api_database.retry_interval    = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api_database.slave_connection  = **** {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] api_database.sqlite_synchronous = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] devices.enabled_mdev_types     = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ephemeral_storage_encryption.enabled = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.api_servers             = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.cafile                  = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.certfile                = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.collect_timing          = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.connect_retries         = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.connect_retry_delay     = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.debug                   = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.default_trusted_certificate_ids = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.enable_certificate_validation = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.enable_rbd_download     = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.endpoint_override       = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.insecure                = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.keyfile                 = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.max_version             = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.min_version             = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.num_retries             = 3 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.rbd_ceph_conf           =  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.rbd_connect_timeout     = 5 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.rbd_pool                =  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.rbd_user                =  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.region_name             = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.service_name            = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.service_type            = image {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.split_loggers           = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.status_code_retries     = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.status_code_retry_delay = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.timeout                 = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.verify_glance_signatures = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] glance.version                 = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] guestfs.debug                  = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] hyperv.config_drive_cdrom      = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] hyperv.config_drive_inject_password = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] hyperv.enable_instance_metrics_collection = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] hyperv.enable_remotefx         = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] hyperv.instances_path_share    =  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] hyperv.iscsi_initiator_list    = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] hyperv.limit_cpu_features      = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] hyperv.power_state_check_timeframe = 60 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] hyperv.use_multipath_io        = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] hyperv.volume_attach_retry_count = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] hyperv.vswitch_name            = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] mks.enabled                    = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] image_cache.manager_interval   = 2400 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] image_cache.precache_concurrency = 1 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] image_cache.remove_unused_base_images = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] image_cache.subdirectory_name  = _base {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.api_max_retries         = 60 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.api_retry_interval      = 2 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.auth_section            = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.auth_type               = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.cafile                  = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.certfile                = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.collect_timing          = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.connect_retries         = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.connect_retry_delay     = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.endpoint_override       = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.insecure                = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.keyfile                 = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.max_version             = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.min_version             = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.partition_key           = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.peer_list               = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.region_name             = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.serial_console_state_timeout = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.service_name            = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.service_type            = baremetal {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.split_loggers           = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.status_code_retries     = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.status_code_retry_delay = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.timeout                 = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ironic.version                 = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] key_manager.fixed_key          = **** {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican.barbican_api_version  = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican.barbican_endpoint     = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican.barbican_endpoint_type = public {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican.barbican_region_name  = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican.cafile                = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican.certfile              = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican.collect_timing        = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican.insecure              = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican.keyfile               = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican.number_of_retries     = 60 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican.retry_delay           = 1 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican.send_service_user_token = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican.split_loggers         = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican.timeout               = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican.verify_ssl            = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican.verify_ssl_path       = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican_service_user.auth_section = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican_service_user.auth_type = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican_service_user.cafile   = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican_service_user.certfile = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican_service_user.collect_timing = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican_service_user.insecure = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican_service_user.keyfile  = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican_service_user.split_loggers = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] barbican_service_user.timeout  = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vault.approle_role_id          = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vault.approle_secret_id        = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vault.cafile                   = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vault.certfile                 = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vault.collect_timing           = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vault.insecure                 = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vault.keyfile                  = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vault.kv_mountpoint            = secret {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vault.kv_version               = 2 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vault.namespace                = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vault.root_token_id            = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vault.split_loggers            = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vault.ssl_ca_crt_file          = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vault.timeout                  = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vault.use_ssl                  = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] keystone.cafile                = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] keystone.certfile              = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] keystone.collect_timing        = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] keystone.connect_retries       = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] keystone.connect_retry_delay   = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] keystone.endpoint_override     = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] keystone.insecure              = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] keystone.keyfile               = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] keystone.max_version           = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] keystone.min_version           = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] keystone.region_name           = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] keystone.service_name          = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] keystone.service_type          = identity {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] keystone.split_loggers         = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] keystone.status_code_retries   = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] keystone.status_code_retry_delay = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] keystone.timeout               = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] keystone.version               = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.connection_uri         =  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.cpu_mode               = custom {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: WARNING oslo_config.cfg [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.cpu_power_governor_high = performance {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.cpu_power_governor_low = powersave {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.cpu_power_management   = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.device_detach_attempts = 8 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.device_detach_timeout  = 20 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.disk_cachemodes        = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.disk_prefix            = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.enabled_perf_events    = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.file_backed_memory     = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.gid_maps               = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.hw_disk_discard        = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.hw_machine_type        = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.images_rbd_glance_store_name =  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.images_rbd_pool        = rbd {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.images_type            = default {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.images_volume_group    = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.inject_key             = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.inject_partition       = -2 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.inject_password        = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.iscsi_iface            = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.iser_use_multipath     = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.live_migration_bandwidth = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.live_migration_downtime = 500 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.live_migration_inbound_addr = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.live_migration_permit_post_copy = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.live_migration_scheme  = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.live_migration_timeout_action = abort {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.live_migration_tunnelled = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: WARNING oslo_config.cfg [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Jul 24 16:13:34 user nova-compute[70243]: live_migration_uri is deprecated for removal in favor of two other options that
Jul 24 16:13:34 user nova-compute[70243]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Jul 24 16:13:34 user nova-compute[70243]: and ``live_migration_inbound_addr`` respectively.
Jul 24 16:13:34 user nova-compute[70243]: ).  Its value may be silently ignored in the future.
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.live_migration_with_native_tls = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.max_queues             = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.nfs_mount_options      = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.num_memory_encrypted_guests = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.num_pcie_ports         = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.pmem_namespaces        = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.quobyte_client_cfg     = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.rbd_secret_uuid        = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.rbd_user               = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.remote_filesystem_transport = ssh {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.rescue_image_id        = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.rescue_kernel_id       = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.rescue_ramdisk_id      = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.rx_queue_size          = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.smbfs_mount_options    =  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.snapshot_compression   = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.snapshot_image_format  = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.sparse_logical_volumes = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.swtpm_enabled          = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.swtpm_group            = tss {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.swtpm_user             = tss {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.sysinfo_serial         = unique {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.tb_cache_size          = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.tx_queue_size          = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.uid_maps               = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.use_virtio_for_bridges = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.virt_type              = kvm {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.volume_clear           = zero {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.volume_clear_size      = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.volume_use_multipath   = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.vzstorage_cache_path   = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.vzstorage_mount_user   = stack {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.auth_section           = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.auth_type              = password {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.cafile                 = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.certfile               = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.collect_timing         = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.connect_retries        = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.connect_retry_delay    = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.default_floating_pool  = public {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.endpoint_override      = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.extension_sync_interval = 600 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.http_retries           = 3 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.insecure               = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.keyfile                = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.max_version            = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.min_version            = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.ovs_bridge             = br-int {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.physnets               = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.region_name            = RegionOne {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.service_metadata_proxy = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.service_name           = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.service_type           = network {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.split_loggers          = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.status_code_retries    = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.status_code_retry_delay = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.timeout                = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] neutron.version                = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] notifications.bdms_in_notifications = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] notifications.default_level    = INFO {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] notifications.notification_format = unversioned {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] notifications.notify_on_state_change = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] pci.alias                      = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] pci.device_spec                = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] pci.report_in_placement        = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.auth_section         = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.auth_type            = password {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.cafile               = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.certfile             = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.collect_timing       = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.connect_retries      = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.connect_retry_delay  = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.default_domain_id    = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.default_domain_name  = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.domain_id            = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.domain_name          = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.endpoint_override    = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.insecure             = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.keyfile              = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.max_version          = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.min_version          = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.password             = **** {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.project_domain_id    = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.project_domain_name  = Default {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.project_id           = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.project_name         = service {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.region_name          = RegionOne {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.service_name         = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.service_type         = placement {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.split_loggers        = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.status_code_retries  = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.status_code_retry_delay = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.system_scope         = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.timeout              = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.trust_id             = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.user_domain_id       = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.user_domain_name     = Default {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.user_id              = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.username             = placement {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] placement.version              = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] quota.cores                    = 20 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] quota.count_usage_from_placement = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] quota.injected_file_content_bytes = 10240 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] quota.injected_file_path_length = 255 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] quota.injected_files           = 5 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] quota.instances                = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] quota.key_pairs                = 100 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] quota.metadata_items           = 128 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] quota.ram                      = 51200 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] quota.recheck_quota            = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] quota.server_group_members     = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] quota.server_groups            = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] rdp.enabled                    = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] scheduler.image_metadata_prefilter = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] scheduler.max_attempts         = 3 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] scheduler.max_placement_results = 1000 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] scheduler.query_placement_for_availability_zone = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] scheduler.query_placement_for_image_type_support = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] scheduler.workers              = 3 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.host_subset_size = 1 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.isolated_hosts = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.isolated_images = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.pci_in_placement = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.track_instance_changes = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] metrics.required               = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] metrics.weight_multiplier      = 1.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] metrics.weight_setting         = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] serial_console.enabled         = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] serial_console.port_range      = 10000:20000 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] serial_console.serialproxy_port = 6083 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] service_user.auth_section      = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] service_user.auth_type         = password {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] service_user.cafile            = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] service_user.certfile          = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] service_user.collect_timing    = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] service_user.insecure          = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] service_user.keyfile           = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] service_user.send_service_user_token = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] service_user.split_loggers     = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] service_user.timeout           = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] spice.agent_enabled            = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] spice.enabled                  = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] spice.html5proxy_port          = 6082 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] spice.image_compression        = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] spice.jpeg_compression         = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] spice.playback_compression     = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] spice.server_listen            = 127.0.0.1 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] spice.streaming_mode           = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] spice.zlib_compression         = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] upgrade_levels.baseapi         = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] upgrade_levels.cert            = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] upgrade_levels.compute         = auto {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] upgrade_levels.conductor       = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] upgrade_levels.scheduler       = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vendordata_dynamic_auth.auth_section = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vendordata_dynamic_auth.auth_type = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vendordata_dynamic_auth.cafile = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vendordata_dynamic_auth.certfile = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vendordata_dynamic_auth.insecure = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vendordata_dynamic_auth.keyfile = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vendordata_dynamic_auth.timeout = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.api_retry_count         = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.ca_file                 = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.cache_prefix            = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.cluster_name            = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.connection_pool_size    = 10 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.console_delay_seconds   = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.datastore_regex         = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.host_ip                 = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.host_password           = **** {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.host_port               = 443 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.host_username           = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.insecure                = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.integration_bridge      = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.maximum_objects         = 100 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.pbm_default_policy      = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.pbm_enabled             = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.pbm_wsdl_location       = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.serial_port_proxy_uri   = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.serial_port_service_uri = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.task_poll_interval      = 0.5 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.use_linked_clone        = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.vnc_keymap              = en-us {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.vnc_port                = 5900 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vmware.vnc_port_total          = 10000 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vnc.auth_schemes               = ['none'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vnc.enabled                    = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vnc.novncproxy_port            = 6080 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vnc.server_listen              = 0.0.0.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vnc.vencrypt_ca_certs          = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vnc.vencrypt_client_cert       = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vnc.vencrypt_client_key        = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] workarounds.disable_rootwrap   = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] workarounds.enable_numa_live_migration = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] workarounds.libvirt_disable_apic = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] wsgi.client_socket_timeout     = 900 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] wsgi.default_pool_size         = 1000 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] wsgi.keep_alive                = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] wsgi.max_header_line           = 16384 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] wsgi.ssl_ca_file               = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] wsgi.ssl_cert_file             = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] wsgi.ssl_key_file              = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] wsgi.tcp_keepidle              = 600 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] zvm.ca_file                    = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] zvm.cloud_connector_url        = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] zvm.reachable_timeout          = 300 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_policy.enforce_new_defaults = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_policy.enforce_scope      = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_policy.policy_default_rule = default {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_policy.policy_file        = policy.yaml {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] profiler.connection_string     = messaging:// {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] profiler.enabled               = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] profiler.es_doc_type           = notification {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] profiler.es_scroll_size        = 10000 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] profiler.es_scroll_time        = 2m {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] profiler.filter_error_trace    = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] profiler.hmac_keys             = **** {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] profiler.sentinel_service_name = mymaster {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] profiler.socket_timeout        = 0.1 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] profiler.trace_requests        = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] profiler.trace_sqlalchemy      = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] profiler_jaeger.process_tags   = {} {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] profiler_jaeger.service_name_prefix = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] profiler_otlp.service_name_prefix = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] remote_debug.host              = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] remote_debug.port              = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.ssl      = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_notifications.retry = -1 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_messaging_notifications.transport_url = **** {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_limit.auth_section        = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_limit.auth_type           = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_limit.cafile              = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_limit.certfile            = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_limit.collect_timing      = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_limit.connect_retries     = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_limit.connect_retry_delay = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_limit.endpoint_id         = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_limit.endpoint_override   = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_limit.insecure            = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_limit.keyfile             = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_limit.max_version         = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_limit.min_version         = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_limit.region_name         = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_limit.service_name        = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_limit.service_type        = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_limit.split_loggers       = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_limit.status_code_retries = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_limit.status_code_retry_delay = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_limit.timeout             = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_limit.valid_interfaces    = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_limit.version             = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_reports.file_event_handler = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] oslo_reports.log_dir           = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vif_plug_ovs_privileged.group  = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] vif_plug_ovs_privileged.user   = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] os_vif_linux_bridge.flat_interface = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] os_vif_ovs.isolate_vif         = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] os_vif_ovs.per_port_bridge     = False {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] os_brick.lock_path             = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] privsep_osbrick.capabilities   = [21] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] privsep_osbrick.group          = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] privsep_osbrick.helper_command = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] privsep_osbrick.user           = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] nova_sys_admin.group           = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] nova_sys_admin.helper_command  = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] nova_sys_admin.user            = None {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG oslo_service.service [None req-cdd6e1bd-2442-4810-838a-4cd080844a41 None None] ******************************************************************************** {{(pid=70243) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Jul 24 16:13:34 user nova-compute[70243]: INFO nova.service [-] Starting compute node (version 0.0.0)
Jul 24 16:13:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Starting native event thread {{(pid=70243) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Starting green dispatch thread {{(pid=70243) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Starting connection event dispatch thread {{(pid=70243) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Connecting to libvirt: qemu:///system {{(pid=70243) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f91f31bf400> {{(pid=70243) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Jul 24 16:13:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f91f31bf400> {{(pid=70243) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Jul 24 16:13:34 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Connection event '1' reason 'None'
Jul 24 16:13:34 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 24 16:13:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.mount [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Initialising _HostMountState generation 0 {{(pid=70243) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Jul 24 16:13:42 user nova-compute[70243]: INFO nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Libvirt host capabilities <capabilities>
Jul 24 16:13:42 user nova-compute[70243]:   <host>
Jul 24 16:13:42 user nova-compute[70243]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Jul 24 16:13:42 user nova-compute[70243]:     <cpu>
Jul 24 16:13:42 user nova-compute[70243]:       <arch>x86_64</arch>
Jul 24 16:13:42 user nova-compute[70243]:       <model>IvyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <vendor>Intel</vendor>
Jul 24 16:13:42 user nova-compute[70243]:       <microcode version='1070'/>
Jul 24 16:13:42 user nova-compute[70243]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Jul 24 16:13:42 user nova-compute[70243]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature name='ss'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature name='vmx'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature name='pcid'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature name='osxsave'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature name='hypervisor'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature name='arat'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature name='tsc_adjust'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature name='md-clear'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature name='stibp'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature name='arch-capabilities'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature name='ssbd'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature name='invtsc'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature name='rsba'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature name='skip-l1dfl-vmentry'/>
Jul 24 16:13:42 user nova-compute[70243]:       <pages unit='KiB' size='4'/>
Jul 24 16:13:42 user nova-compute[70243]:       <pages unit='KiB' size='2048'/>
Jul 24 16:13:42 user nova-compute[70243]:     </cpu>
Jul 24 16:13:42 user nova-compute[70243]:     <power_management>
Jul 24 16:13:42 user nova-compute[70243]:       <suspend_mem/>
Jul 24 16:13:42 user nova-compute[70243]:       <suspend_disk/>
Jul 24 16:13:42 user nova-compute[70243]:       <suspend_hybrid/>
Jul 24 16:13:42 user nova-compute[70243]:     </power_management>
Jul 24 16:13:42 user nova-compute[70243]:     <iommu support='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     <migration_features>
Jul 24 16:13:42 user nova-compute[70243]:       <live/>
Jul 24 16:13:42 user nova-compute[70243]:       <uri_transports>
Jul 24 16:13:42 user nova-compute[70243]:         <uri_transport>tcp</uri_transport>
Jul 24 16:13:42 user nova-compute[70243]:         <uri_transport>rdma</uri_transport>
Jul 24 16:13:42 user nova-compute[70243]:       </uri_transports>
Jul 24 16:13:42 user nova-compute[70243]:     </migration_features>
Jul 24 16:13:42 user nova-compute[70243]:     <topology>
Jul 24 16:13:42 user nova-compute[70243]:       <cells num='2'>
Jul 24 16:13:42 user nova-compute[70243]:         <cell id='0'>
Jul 24 16:13:42 user nova-compute[70243]:           <memory unit='KiB'>8189224</memory>
Jul 24 16:13:42 user nova-compute[70243]:           <pages unit='KiB' size='4'>2047306</pages>
Jul 24 16:13:42 user nova-compute[70243]:           <pages unit='KiB' size='2048'>0</pages>
Jul 24 16:13:42 user nova-compute[70243]:           <distances>
Jul 24 16:13:42 user nova-compute[70243]:             <sibling id='0' value='10'/>
Jul 24 16:13:42 user nova-compute[70243]:             <sibling id='1' value='20'/>
Jul 24 16:13:42 user nova-compute[70243]:           </distances>
Jul 24 16:13:42 user nova-compute[70243]:           <cpus num='6'>
Jul 24 16:13:42 user nova-compute[70243]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Jul 24 16:13:42 user nova-compute[70243]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Jul 24 16:13:42 user nova-compute[70243]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Jul 24 16:13:42 user nova-compute[70243]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Jul 24 16:13:42 user nova-compute[70243]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Jul 24 16:13:42 user nova-compute[70243]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Jul 24 16:13:42 user nova-compute[70243]:           </cpus>
Jul 24 16:13:42 user nova-compute[70243]:         </cell>
Jul 24 16:13:42 user nova-compute[70243]:         <cell id='1'>
Jul 24 16:13:42 user nova-compute[70243]:           <memory unit='KiB'>8206460</memory>
Jul 24 16:13:42 user nova-compute[70243]:           <pages unit='KiB' size='4'>2051615</pages>
Jul 24 16:13:42 user nova-compute[70243]:           <pages unit='KiB' size='2048'>0</pages>
Jul 24 16:13:42 user nova-compute[70243]:           <distances>
Jul 24 16:13:42 user nova-compute[70243]:             <sibling id='0' value='20'/>
Jul 24 16:13:42 user nova-compute[70243]:             <sibling id='1' value='10'/>
Jul 24 16:13:42 user nova-compute[70243]:           </distances>
Jul 24 16:13:42 user nova-compute[70243]:           <cpus num='6'>
Jul 24 16:13:42 user nova-compute[70243]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Jul 24 16:13:42 user nova-compute[70243]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Jul 24 16:13:42 user nova-compute[70243]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Jul 24 16:13:42 user nova-compute[70243]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Jul 24 16:13:42 user nova-compute[70243]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Jul 24 16:13:42 user nova-compute[70243]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Jul 24 16:13:42 user nova-compute[70243]:           </cpus>
Jul 24 16:13:42 user nova-compute[70243]:         </cell>
Jul 24 16:13:42 user nova-compute[70243]:       </cells>
Jul 24 16:13:42 user nova-compute[70243]:     </topology>
Jul 24 16:13:42 user nova-compute[70243]:     <cache>
Jul 24 16:13:42 user nova-compute[70243]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Jul 24 16:13:42 user nova-compute[70243]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Jul 24 16:13:42 user nova-compute[70243]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Jul 24 16:13:42 user nova-compute[70243]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Jul 24 16:13:42 user nova-compute[70243]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Jul 24 16:13:42 user nova-compute[70243]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Jul 24 16:13:42 user nova-compute[70243]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Jul 24 16:13:42 user nova-compute[70243]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Jul 24 16:13:42 user nova-compute[70243]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Jul 24 16:13:42 user nova-compute[70243]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Jul 24 16:13:42 user nova-compute[70243]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Jul 24 16:13:42 user nova-compute[70243]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Jul 24 16:13:42 user nova-compute[70243]:     </cache>
Jul 24 16:13:42 user nova-compute[70243]:     <secmodel>
Jul 24 16:13:42 user nova-compute[70243]:       <model>apparmor</model>
Jul 24 16:13:42 user nova-compute[70243]:       <doi>0</doi>
Jul 24 16:13:42 user nova-compute[70243]:     </secmodel>
Jul 24 16:13:42 user nova-compute[70243]:     <secmodel>
Jul 24 16:13:42 user nova-compute[70243]:       <model>dac</model>
Jul 24 16:13:42 user nova-compute[70243]:       <doi>0</doi>
Jul 24 16:13:42 user nova-compute[70243]:       <baselabel type='kvm'>+64055:+108</baselabel>
Jul 24 16:13:42 user nova-compute[70243]:       <baselabel type='qemu'>+64055:+108</baselabel>
Jul 24 16:13:42 user nova-compute[70243]:     </secmodel>
Jul 24 16:13:42 user nova-compute[70243]:   </host>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='alpha'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>64</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>clipper</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='armv6l'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>32</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>integratorcp</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>borzoi</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>spitz</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>nuri</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>musca-b1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>versatileab</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>kzm</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>musca-a</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>smdkc210</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>sx1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>z2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>tosa</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>sabrelite</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>realview-eb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>n810</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>n800</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>versatilepb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>terrier</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mainstone</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>midway</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>musicpal</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>microbit</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>cubieboard</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>verdex</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>netduino2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>raspi2b</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>cheetah</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>highbank</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>akita</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>connex</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>collie</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>raspi0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='armv7l'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>32</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>integratorcp</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>borzoi</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>spitz</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>nuri</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>musca-b1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>versatileab</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>kzm</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>musca-a</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>smdkc210</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>sx1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>z2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>tosa</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>sabrelite</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>realview-eb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>n810</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>n800</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>versatilepb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>terrier</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mainstone</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>midway</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>musicpal</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>microbit</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>cubieboard</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>verdex</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>netduino2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>raspi2b</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>cheetah</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>highbank</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>akita</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>connex</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>collie</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>raspi0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='aarch64'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>64</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>integratorcp</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>borzoi</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>spitz</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>nuri</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>musca-b1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>versatileab</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>kzm</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>musca-a</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>smdkc210</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>sx1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>z2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>tosa</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>sabrelite</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>realview-eb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>sbsa-ref</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>n810</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>n800</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>versatilepb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>terrier</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mainstone</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>midway</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>musicpal</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>microbit</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>raspi3ap</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>cubieboard</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>verdex</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>netduino2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>raspi3b</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>raspi2b</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>cheetah</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>highbank</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>akita</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>connex</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>collie</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>raspi0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <acpi default='on' toggle='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='cris'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>32</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>axis-dev88</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='i686'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>32</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>x-remote</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>isapc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>microvm</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='kvm'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <pae/>
Jul 24 16:13:42 user nova-compute[70243]:       <nonpae/>
Jul 24 16:13:42 user nova-compute[70243]:       <acpi default='on' toggle='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:       <apic default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='m68k'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>32</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mcf5208evb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>an5206</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>virt-6.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>q800</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>virt-6.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>next-cube</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>virt-6.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='microblaze'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>32</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='microblazeel'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>32</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='mips'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>32</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='16'>malta</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mipssim</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='mipsel'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>32</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='16'>malta</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mipssim</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='mips64'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>64</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='16'>malta</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mipssim</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>pica61</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>magnum</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='mips64el'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>64</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='16'>malta</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='16'>loongson3-virt</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mipssim</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>pica61</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>magnum</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='16'>boston</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>fuloong2e</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='ppc'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>32</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>g3beige</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mac99</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='32'>ppce500</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>pegasos2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>sam460ex</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>bamboo</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>40p</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>ref405ep</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>taihu</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='ppc64'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>64</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2048'>powernv9</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>taihu</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2048'>powernv10</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='32'>ppce500</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>40p</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>pegasos2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>bamboo</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>g3beige</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mac99</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>sam460ex</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>ref405ep</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2048'>powernv8</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='ppc64le'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>64</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2048'>powernv9</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>taihu</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2048'>powernv10</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='32'>ppce500</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>40p</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>pegasos2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>bamboo</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>g3beige</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>mac99</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>sam460ex</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>ref405ep</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2048'>powernv8</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='riscv32'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>32</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='8'>spike</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>opentitan</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='5'>sifive_u</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>sifive_e</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='8'>virt</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='riscv64'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>64</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='8'>spike</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='5'>sifive_u</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>shakti_c</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>sifive_e</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='8'>virt</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='s390x'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>64</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='sh4'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>32</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>shix</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>r2d</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='sh4eb'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>64</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>shix</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>r2d</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='sparc'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>32</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>SS-5</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>SS-20</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>LX</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>SPARCClassic</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>leon3_generic</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>SPARCbook</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>SS-4</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>SS-600MP</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>SS-10</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>Voyager</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='sparc64'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>64</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>sun4u</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>niagara</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>sun4v</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='x86_64'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>64</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>x-remote</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='1'>isapc</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>microvm</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='kvm'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <acpi default='on' toggle='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:       <apic default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='xtensa'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>32</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>sim</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='32'>kc705</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='32'>ml605</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='32'>virt</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='32'>lx200</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='32'>lx60</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]:   <guest>
Jul 24 16:13:42 user nova-compute[70243]:     <os_type>hvm</os_type>
Jul 24 16:13:42 user nova-compute[70243]:     <arch name='xtensaeb'>
Jul 24 16:13:42 user nova-compute[70243]:       <wordsize>32</wordsize>
Jul 24 16:13:42 user nova-compute[70243]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='4'>sim</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='32'>kc705</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='32'>ml605</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='32'>virt</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='32'>lx200</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='32'>lx60</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 24 16:13:42 user nova-compute[70243]:       <domain type='qemu'/>
Jul 24 16:13:42 user nova-compute[70243]:     </arch>
Jul 24 16:13:42 user nova-compute[70243]:     <features>
Jul 24 16:13:42 user nova-compute[70243]:       <cpuselection/>
Jul 24 16:13:42 user nova-compute[70243]:       <deviceboot/>
Jul 24 16:13:42 user nova-compute[70243]:       <disksnapshot default='on' toggle='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     </features>
Jul 24 16:13:42 user nova-compute[70243]:   </guest>
Jul 24 16:13:42 user nova-compute[70243]: </capabilities>
Jul 24 16:13:42 user nova-compute[70243]: 
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Jul 24 16:13:42 user nova-compute[70243]: <domainCapabilities>
Jul 24 16:13:42 user nova-compute[70243]:   <path>/usr/bin/qemu-system-i386</path>
Jul 24 16:13:42 user nova-compute[70243]:   <domain>kvm</domain>
Jul 24 16:13:42 user nova-compute[70243]:   <machine>pc-q35-6.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:   <arch>i686</arch>
Jul 24 16:13:42 user nova-compute[70243]:   <vcpu max='288'/>
Jul 24 16:13:42 user nova-compute[70243]:   <iothreads supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:   <os supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:     <enum name='firmware'/>
Jul 24 16:13:42 user nova-compute[70243]:     <loader supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='type'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>rom</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>pflash</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='readonly'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>yes</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>no</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='secure'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>no</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </loader>
Jul 24 16:13:42 user nova-compute[70243]:   </os>
Jul 24 16:13:42 user nova-compute[70243]:   <cpu>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='host-passthrough' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='hostPassthroughMigratable'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>off</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='maximum' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='maximumMigratable'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>on</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>off</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='host-model' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <vendor>Intel</vendor>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ss'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='vmx'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='pcid'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='hypervisor'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='arat'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='umip'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='md-clear'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='stibp'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ssbd'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ibpb'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ibrs'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='amd-stibp'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='disable' name='erms'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='disable' name='lm'/>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='custom' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>qemu64</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>qemu32</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>phenom</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium3</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium2</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>n270</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>kvm64</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>kvm32</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>coreduo</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>core2duo</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>athlon</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Westmere-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Westmere</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Snowridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>SandyBridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Penryn</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G5</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G4</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G3</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G2</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G1</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Nehalem-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Nehalem</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>IvyBridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Icelake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-Rome</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-Milan</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Dhyana</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cooperlake</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Conroe</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>486</model>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:   </cpu>
Jul 24 16:13:42 user nova-compute[70243]:   <memoryBacking supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:     <enum name='sourceType'>
Jul 24 16:13:42 user nova-compute[70243]:       <value>file</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>anonymous</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>memfd</value>
Jul 24 16:13:42 user nova-compute[70243]:     </enum>
Jul 24 16:13:42 user nova-compute[70243]:   </memoryBacking>
Jul 24 16:13:42 user nova-compute[70243]:   <devices>
Jul 24 16:13:42 user nova-compute[70243]:     <disk supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='diskDevice'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>disk</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>cdrom</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>floppy</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>lun</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='bus'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>fdc</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>scsi</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>usb</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>sata</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-non-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </disk>
Jul 24 16:13:42 user nova-compute[70243]:     <graphics supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='type'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>sdl</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vnc</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>spice</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>egl-headless</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </graphics>
Jul 24 16:13:42 user nova-compute[70243]:     <video supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='modelType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vga</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>cirrus</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vmvga</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>qxl</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>none</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>bochs</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>ramfb</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </video>
Jul 24 16:13:42 user nova-compute[70243]:     <hostdev supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='mode'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>subsystem</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='startupPolicy'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>default</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>mandatory</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>requisite</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>optional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='subsysType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>usb</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>pci</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>scsi</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='capsType'/>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='pciBackend'/>
Jul 24 16:13:42 user nova-compute[70243]:     </hostdev>
Jul 24 16:13:42 user nova-compute[70243]:     <rng supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-non-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='backendModel'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>random</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>egd</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>builtin</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </rng>
Jul 24 16:13:42 user nova-compute[70243]:     <filesystem supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='driverType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>path</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>handle</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtiofs</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </filesystem>
Jul 24 16:13:42 user nova-compute[70243]:     <tpm supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>tpm-tis</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>tpm-crb</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='backendModel'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>passthrough</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>emulator</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </tpm>
Jul 24 16:13:42 user nova-compute[70243]:   </devices>
Jul 24 16:13:42 user nova-compute[70243]:   <features>
Jul 24 16:13:42 user nova-compute[70243]:     <gic supported='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     <vmcoreinfo supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <genid supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <backingStoreInput supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <backup supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <sev supported='no'/>
Jul 24 16:13:42 user nova-compute[70243]:   </features>
Jul 24 16:13:42 user nova-compute[70243]: </domainCapabilities>
Jul 24 16:13:42 user nova-compute[70243]:  {{(pid=70243) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Jul 24 16:13:42 user nova-compute[70243]: <domainCapabilities>
Jul 24 16:13:42 user nova-compute[70243]:   <path>/usr/bin/qemu-system-i386</path>
Jul 24 16:13:42 user nova-compute[70243]:   <domain>kvm</domain>
Jul 24 16:13:42 user nova-compute[70243]:   <machine>pc-q35-jammy</machine>
Jul 24 16:13:42 user nova-compute[70243]:   <arch>i686</arch>
Jul 24 16:13:42 user nova-compute[70243]:   <vcpu max='288'/>
Jul 24 16:13:42 user nova-compute[70243]:   <iothreads supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:   <os supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:     <enum name='firmware'/>
Jul 24 16:13:42 user nova-compute[70243]:     <loader supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='type'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>rom</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>pflash</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='readonly'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>yes</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>no</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='secure'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>no</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </loader>
Jul 24 16:13:42 user nova-compute[70243]:   </os>
Jul 24 16:13:42 user nova-compute[70243]:   <cpu>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='host-passthrough' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='hostPassthroughMigratable'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>off</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='maximum' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='maximumMigratable'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>on</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>off</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='host-model' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <vendor>Intel</vendor>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ss'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='vmx'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='pcid'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='hypervisor'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='arat'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='umip'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='md-clear'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='stibp'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ssbd'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ibpb'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ibrs'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='amd-stibp'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='disable' name='erms'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='disable' name='lm'/>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='custom' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>qemu64</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>qemu32</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>phenom</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium3</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium2</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>n270</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>kvm64</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>kvm32</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>coreduo</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>core2duo</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>athlon</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Westmere-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Westmere</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Snowridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>SandyBridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Penryn</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G5</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G4</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G3</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G2</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G1</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Nehalem-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Nehalem</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>IvyBridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Icelake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-Rome</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-Milan</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Dhyana</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cooperlake</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Conroe</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>486</model>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:   </cpu>
Jul 24 16:13:42 user nova-compute[70243]:   <memoryBacking supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:     <enum name='sourceType'>
Jul 24 16:13:42 user nova-compute[70243]:       <value>file</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>anonymous</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>memfd</value>
Jul 24 16:13:42 user nova-compute[70243]:     </enum>
Jul 24 16:13:42 user nova-compute[70243]:   </memoryBacking>
Jul 24 16:13:42 user nova-compute[70243]:   <devices>
Jul 24 16:13:42 user nova-compute[70243]:     <disk supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='diskDevice'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>disk</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>cdrom</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>floppy</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>lun</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='bus'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>fdc</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>scsi</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>usb</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>sata</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-non-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </disk>
Jul 24 16:13:42 user nova-compute[70243]:     <graphics supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='type'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>sdl</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vnc</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>spice</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>egl-headless</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </graphics>
Jul 24 16:13:42 user nova-compute[70243]:     <video supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='modelType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vga</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>cirrus</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vmvga</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>qxl</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>none</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>bochs</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>ramfb</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </video>
Jul 24 16:13:42 user nova-compute[70243]:     <hostdev supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='mode'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>subsystem</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='startupPolicy'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>default</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>mandatory</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>requisite</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>optional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='subsysType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>usb</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>pci</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>scsi</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='capsType'/>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='pciBackend'/>
Jul 24 16:13:42 user nova-compute[70243]:     </hostdev>
Jul 24 16:13:42 user nova-compute[70243]:     <rng supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-non-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='backendModel'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>random</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>egd</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>builtin</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </rng>
Jul 24 16:13:42 user nova-compute[70243]:     <filesystem supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='driverType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>path</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>handle</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtiofs</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </filesystem>
Jul 24 16:13:42 user nova-compute[70243]:     <tpm supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>tpm-tis</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>tpm-crb</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='backendModel'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>passthrough</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>emulator</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </tpm>
Jul 24 16:13:42 user nova-compute[70243]:   </devices>
Jul 24 16:13:42 user nova-compute[70243]:   <features>
Jul 24 16:13:42 user nova-compute[70243]:     <gic supported='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     <vmcoreinfo supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <genid supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <backingStoreInput supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <backup supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <sev supported='no'/>
Jul 24 16:13:42 user nova-compute[70243]:   </features>
Jul 24 16:13:42 user nova-compute[70243]: </domainCapabilities>
Jul 24 16:13:42 user nova-compute[70243]:  {{(pid=70243) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Jul 24 16:13:42 user nova-compute[70243]: <domainCapabilities>
Jul 24 16:13:42 user nova-compute[70243]:   <path>/usr/bin/qemu-system-i386</path>
Jul 24 16:13:42 user nova-compute[70243]:   <domain>kvm</domain>
Jul 24 16:13:42 user nova-compute[70243]:   <machine>pc-i440fx-6.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:   <arch>i686</arch>
Jul 24 16:13:42 user nova-compute[70243]:   <vcpu max='255'/>
Jul 24 16:13:42 user nova-compute[70243]:   <iothreads supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:   <os supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:     <enum name='firmware'/>
Jul 24 16:13:42 user nova-compute[70243]:     <loader supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='type'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>rom</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>pflash</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='readonly'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>yes</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>no</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='secure'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>no</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </loader>
Jul 24 16:13:42 user nova-compute[70243]:   </os>
Jul 24 16:13:42 user nova-compute[70243]:   <cpu>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='host-passthrough' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='hostPassthroughMigratable'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>off</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='maximum' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='maximumMigratable'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>on</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>off</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='host-model' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <vendor>Intel</vendor>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ss'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='vmx'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='pcid'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='hypervisor'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='arat'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='umip'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='md-clear'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='stibp'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ssbd'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ibpb'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ibrs'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='amd-stibp'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='disable' name='erms'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='disable' name='lm'/>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='custom' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>qemu64</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>qemu32</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>phenom</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium3</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium2</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>n270</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>kvm64</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>kvm32</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>coreduo</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>core2duo</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>athlon</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Westmere-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Westmere</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Snowridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>SandyBridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Penryn</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G5</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G4</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G3</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G2</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G1</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Nehalem-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Nehalem</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>IvyBridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Icelake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-Rome</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-Milan</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Dhyana</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cooperlake</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Conroe</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>486</model>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:   </cpu>
Jul 24 16:13:42 user nova-compute[70243]:   <memoryBacking supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:     <enum name='sourceType'>
Jul 24 16:13:42 user nova-compute[70243]:       <value>file</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>anonymous</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>memfd</value>
Jul 24 16:13:42 user nova-compute[70243]:     </enum>
Jul 24 16:13:42 user nova-compute[70243]:   </memoryBacking>
Jul 24 16:13:42 user nova-compute[70243]:   <devices>
Jul 24 16:13:42 user nova-compute[70243]:     <disk supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='diskDevice'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>disk</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>cdrom</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>floppy</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>lun</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='bus'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>ide</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>fdc</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>scsi</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>usb</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>sata</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-non-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </disk>
Jul 24 16:13:42 user nova-compute[70243]:     <graphics supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='type'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>sdl</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vnc</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>spice</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>egl-headless</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </graphics>
Jul 24 16:13:42 user nova-compute[70243]:     <video supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='modelType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vga</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>cirrus</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vmvga</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>qxl</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>none</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>bochs</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>ramfb</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </video>
Jul 24 16:13:42 user nova-compute[70243]:     <hostdev supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='mode'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>subsystem</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='startupPolicy'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>default</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>mandatory</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>requisite</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>optional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='subsysType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>usb</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>pci</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>scsi</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='capsType'/>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='pciBackend'/>
Jul 24 16:13:42 user nova-compute[70243]:     </hostdev>
Jul 24 16:13:42 user nova-compute[70243]:     <rng supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-non-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='backendModel'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>random</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>egd</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>builtin</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </rng>
Jul 24 16:13:42 user nova-compute[70243]:     <filesystem supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='driverType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>path</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>handle</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtiofs</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </filesystem>
Jul 24 16:13:42 user nova-compute[70243]:     <tpm supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>tpm-tis</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>tpm-crb</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='backendModel'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>passthrough</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>emulator</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </tpm>
Jul 24 16:13:42 user nova-compute[70243]:   </devices>
Jul 24 16:13:42 user nova-compute[70243]:   <features>
Jul 24 16:13:42 user nova-compute[70243]:     <gic supported='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     <vmcoreinfo supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <genid supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <backingStoreInput supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <backup supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <sev supported='no'/>
Jul 24 16:13:42 user nova-compute[70243]:   </features>
Jul 24 16:13:42 user nova-compute[70243]: </domainCapabilities>
Jul 24 16:13:42 user nova-compute[70243]:  {{(pid=70243) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Jul 24 16:13:42 user nova-compute[70243]: <domainCapabilities>
Jul 24 16:13:42 user nova-compute[70243]:   <path>/usr/bin/qemu-system-i386</path>
Jul 24 16:13:42 user nova-compute[70243]:   <domain>kvm</domain>
Jul 24 16:13:42 user nova-compute[70243]:   <machine>pc-i440fx-jammy</machine>
Jul 24 16:13:42 user nova-compute[70243]:   <arch>i686</arch>
Jul 24 16:13:42 user nova-compute[70243]:   <vcpu max='255'/>
Jul 24 16:13:42 user nova-compute[70243]:   <iothreads supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:   <os supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:     <enum name='firmware'/>
Jul 24 16:13:42 user nova-compute[70243]:     <loader supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='type'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>rom</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>pflash</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='readonly'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>yes</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>no</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='secure'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>no</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </loader>
Jul 24 16:13:42 user nova-compute[70243]:   </os>
Jul 24 16:13:42 user nova-compute[70243]:   <cpu>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='host-passthrough' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='hostPassthroughMigratable'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>off</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='maximum' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='maximumMigratable'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>on</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>off</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='host-model' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <vendor>Intel</vendor>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ss'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='vmx'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='pcid'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='hypervisor'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='arat'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='umip'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='md-clear'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='stibp'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ssbd'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ibpb'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ibrs'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='amd-stibp'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='disable' name='erms'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='disable' name='lm'/>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='custom' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>qemu64</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>qemu32</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>phenom</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium3</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium2</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>n270</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>kvm64</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>kvm32</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>coreduo</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>core2duo</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>athlon</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Westmere-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Westmere</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Snowridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>SandyBridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Penryn</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G5</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G4</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G3</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G2</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G1</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Nehalem-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Nehalem</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>IvyBridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Icelake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-Rome</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-Milan</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Dhyana</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cooperlake</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Conroe</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>486</model>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:   </cpu>
Jul 24 16:13:42 user nova-compute[70243]:   <memoryBacking supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:     <enum name='sourceType'>
Jul 24 16:13:42 user nova-compute[70243]:       <value>file</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>anonymous</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>memfd</value>
Jul 24 16:13:42 user nova-compute[70243]:     </enum>
Jul 24 16:13:42 user nova-compute[70243]:   </memoryBacking>
Jul 24 16:13:42 user nova-compute[70243]:   <devices>
Jul 24 16:13:42 user nova-compute[70243]:     <disk supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='diskDevice'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>disk</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>cdrom</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>floppy</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>lun</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='bus'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>ide</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>fdc</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>scsi</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>usb</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>sata</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-non-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </disk>
Jul 24 16:13:42 user nova-compute[70243]:     <graphics supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='type'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>sdl</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vnc</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>spice</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>egl-headless</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </graphics>
Jul 24 16:13:42 user nova-compute[70243]:     <video supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='modelType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vga</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>cirrus</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vmvga</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>qxl</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>none</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>bochs</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>ramfb</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </video>
Jul 24 16:13:42 user nova-compute[70243]:     <hostdev supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='mode'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>subsystem</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='startupPolicy'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>default</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>mandatory</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>requisite</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>optional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='subsysType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>usb</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>pci</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>scsi</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='capsType'/>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='pciBackend'/>
Jul 24 16:13:42 user nova-compute[70243]:     </hostdev>
Jul 24 16:13:42 user nova-compute[70243]:     <rng supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-non-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='backendModel'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>random</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>egd</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>builtin</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </rng>
Jul 24 16:13:42 user nova-compute[70243]:     <filesystem supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='driverType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>path</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>handle</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtiofs</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </filesystem>
Jul 24 16:13:42 user nova-compute[70243]:     <tpm supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>tpm-tis</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>tpm-crb</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='backendModel'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>passthrough</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>emulator</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </tpm>
Jul 24 16:13:42 user nova-compute[70243]:   </devices>
Jul 24 16:13:42 user nova-compute[70243]:   <features>
Jul 24 16:13:42 user nova-compute[70243]:     <gic supported='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     <vmcoreinfo supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <genid supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <backingStoreInput supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <backup supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <sev supported='no'/>
Jul 24 16:13:42 user nova-compute[70243]:   </features>
Jul 24 16:13:42 user nova-compute[70243]: </domainCapabilities>
Jul 24 16:13:42 user nova-compute[70243]:  {{(pid=70243) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Jul 24 16:13:42 user nova-compute[70243]: <domainCapabilities>
Jul 24 16:13:42 user nova-compute[70243]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 24 16:13:42 user nova-compute[70243]:   <domain>kvm</domain>
Jul 24 16:13:42 user nova-compute[70243]:   <machine>pc-q35-6.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:   <arch>x86_64</arch>
Jul 24 16:13:42 user nova-compute[70243]:   <vcpu max='288'/>
Jul 24 16:13:42 user nova-compute[70243]:   <iothreads supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:   <os supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:     <enum name='firmware'>
Jul 24 16:13:42 user nova-compute[70243]:       <value>efi</value>
Jul 24 16:13:42 user nova-compute[70243]:     </enum>
Jul 24 16:13:42 user nova-compute[70243]:     <loader supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='type'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>rom</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>pflash</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='readonly'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>yes</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>no</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='secure'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>yes</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>no</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </loader>
Jul 24 16:13:42 user nova-compute[70243]:   </os>
Jul 24 16:13:42 user nova-compute[70243]:   <cpu>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='host-passthrough' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='hostPassthroughMigratable'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>on</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>off</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='maximum' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='maximumMigratable'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>on</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>off</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='host-model' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <vendor>Intel</vendor>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ss'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='vmx'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='pcid'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='hypervisor'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='arat'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='umip'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='md-clear'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='stibp'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ssbd'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='invtsc'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ibpb'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ibrs'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='amd-stibp'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='rsba'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='pschange-mc-no'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='disable' name='erms'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='custom' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>qemu64</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>qemu32</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>phenom</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium3</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium2</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>n270</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>kvm64</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>kvm32</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>coreduo</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>core2duo</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>athlon</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Westmere-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Westmere</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Snowridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>SandyBridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Penryn</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G5</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G4</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G3</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G2</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Opteron_G1</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Nehalem</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>IvyBridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Icelake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-Rome</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-Milan</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Dhyana</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cooperlake</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Conroe</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>486</model>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:   </cpu>
Jul 24 16:13:42 user nova-compute[70243]:   <memoryBacking supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:     <enum name='sourceType'>
Jul 24 16:13:42 user nova-compute[70243]:       <value>file</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>anonymous</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>memfd</value>
Jul 24 16:13:42 user nova-compute[70243]:     </enum>
Jul 24 16:13:42 user nova-compute[70243]:   </memoryBacking>
Jul 24 16:13:42 user nova-compute[70243]:   <devices>
Jul 24 16:13:42 user nova-compute[70243]:     <disk supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='diskDevice'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>disk</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>cdrom</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>floppy</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>lun</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='bus'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>fdc</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>scsi</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>usb</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>sata</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-non-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </disk>
Jul 24 16:13:42 user nova-compute[70243]:     <graphics supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='type'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>sdl</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vnc</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>spice</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>egl-headless</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </graphics>
Jul 24 16:13:42 user nova-compute[70243]:     <video supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='modelType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vga</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>cirrus</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vmvga</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>qxl</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>none</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>bochs</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>ramfb</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </video>
Jul 24 16:13:42 user nova-compute[70243]:     <hostdev supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='mode'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>subsystem</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='startupPolicy'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>default</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>mandatory</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>requisite</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>optional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='subsysType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>usb</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>pci</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>scsi</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='capsType'/>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='pciBackend'/>
Jul 24 16:13:42 user nova-compute[70243]:     </hostdev>
Jul 24 16:13:42 user nova-compute[70243]:     <rng supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-non-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='backendModel'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>random</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>egd</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>builtin</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </rng>
Jul 24 16:13:42 user nova-compute[70243]:     <filesystem supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='driverType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>path</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>handle</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtiofs</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </filesystem>
Jul 24 16:13:42 user nova-compute[70243]:     <tpm supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>tpm-tis</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>tpm-crb</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='backendModel'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>passthrough</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>emulator</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </tpm>
Jul 24 16:13:42 user nova-compute[70243]:   </devices>
Jul 24 16:13:42 user nova-compute[70243]:   <features>
Jul 24 16:13:42 user nova-compute[70243]:     <gic supported='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     <vmcoreinfo supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <genid supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <backingStoreInput supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <backup supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <sev supported='no'/>
Jul 24 16:13:42 user nova-compute[70243]:   </features>
Jul 24 16:13:42 user nova-compute[70243]: </domainCapabilities>
Jul 24 16:13:42 user nova-compute[70243]:  {{(pid=70243) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Jul 24 16:13:42 user nova-compute[70243]: <domainCapabilities>
Jul 24 16:13:42 user nova-compute[70243]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 24 16:13:42 user nova-compute[70243]:   <domain>kvm</domain>
Jul 24 16:13:42 user nova-compute[70243]:   <machine>pc-q35-jammy</machine>
Jul 24 16:13:42 user nova-compute[70243]:   <arch>x86_64</arch>
Jul 24 16:13:42 user nova-compute[70243]:   <vcpu max='288'/>
Jul 24 16:13:42 user nova-compute[70243]:   <iothreads supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:   <os supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:     <enum name='firmware'>
Jul 24 16:13:42 user nova-compute[70243]:       <value>efi</value>
Jul 24 16:13:42 user nova-compute[70243]:     </enum>
Jul 24 16:13:42 user nova-compute[70243]:     <loader supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='type'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>rom</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>pflash</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='readonly'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>yes</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>no</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='secure'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>yes</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>no</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </loader>
Jul 24 16:13:42 user nova-compute[70243]:   </os>
Jul 24 16:13:42 user nova-compute[70243]:   <cpu>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='host-passthrough' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='hostPassthroughMigratable'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>on</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>off</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='maximum' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='maximumMigratable'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>on</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>off</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='host-model' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <vendor>Intel</vendor>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ss'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='vmx'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='pcid'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='hypervisor'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='arat'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='umip'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='md-clear'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='stibp'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ssbd'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='invtsc'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ibpb'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ibrs'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='amd-stibp'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='rsba'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='pschange-mc-no'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='disable' name='erms'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='custom' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>qemu64</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>qemu32</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>phenom</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium3</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium2</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>n270</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>kvm64</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>kvm32</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>coreduo</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>core2duo</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>athlon</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Westmere-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Westmere</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Snowridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>SandyBridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Penryn</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G5</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G4</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G3</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G2</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Opteron_G1</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Nehalem</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>IvyBridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Icelake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-Rome</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-Milan</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Dhyana</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cooperlake</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Conroe</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>486</model>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:   </cpu>
Jul 24 16:13:42 user nova-compute[70243]:   <memoryBacking supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:     <enum name='sourceType'>
Jul 24 16:13:42 user nova-compute[70243]:       <value>file</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>anonymous</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>memfd</value>
Jul 24 16:13:42 user nova-compute[70243]:     </enum>
Jul 24 16:13:42 user nova-compute[70243]:   </memoryBacking>
Jul 24 16:13:42 user nova-compute[70243]:   <devices>
Jul 24 16:13:42 user nova-compute[70243]:     <disk supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='diskDevice'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>disk</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>cdrom</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>floppy</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>lun</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='bus'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>fdc</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>scsi</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>usb</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>sata</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-non-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </disk>
Jul 24 16:13:42 user nova-compute[70243]:     <graphics supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='type'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>sdl</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vnc</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>spice</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>egl-headless</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </graphics>
Jul 24 16:13:42 user nova-compute[70243]:     <video supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='modelType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vga</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>cirrus</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vmvga</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>qxl</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>none</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>bochs</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>ramfb</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </video>
Jul 24 16:13:42 user nova-compute[70243]:     <hostdev supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='mode'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>subsystem</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='startupPolicy'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>default</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>mandatory</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>requisite</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>optional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='subsysType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>usb</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>pci</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>scsi</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='capsType'/>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='pciBackend'/>
Jul 24 16:13:42 user nova-compute[70243]:     </hostdev>
Jul 24 16:13:42 user nova-compute[70243]:     <rng supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-non-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='backendModel'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>random</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>egd</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>builtin</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </rng>
Jul 24 16:13:42 user nova-compute[70243]:     <filesystem supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='driverType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>path</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>handle</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtiofs</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </filesystem>
Jul 24 16:13:42 user nova-compute[70243]:     <tpm supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>tpm-tis</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>tpm-crb</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='backendModel'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>passthrough</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>emulator</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </tpm>
Jul 24 16:13:42 user nova-compute[70243]:   </devices>
Jul 24 16:13:42 user nova-compute[70243]:   <features>
Jul 24 16:13:42 user nova-compute[70243]:     <gic supported='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     <vmcoreinfo supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <genid supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <backingStoreInput supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <backup supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <sev supported='no'/>
Jul 24 16:13:42 user nova-compute[70243]:   </features>
Jul 24 16:13:42 user nova-compute[70243]: </domainCapabilities>
Jul 24 16:13:42 user nova-compute[70243]:  {{(pid=70243) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Jul 24 16:13:42 user nova-compute[70243]: <domainCapabilities>
Jul 24 16:13:42 user nova-compute[70243]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 24 16:13:42 user nova-compute[70243]:   <domain>kvm</domain>
Jul 24 16:13:42 user nova-compute[70243]:   <machine>pc-i440fx-6.2</machine>
Jul 24 16:13:42 user nova-compute[70243]:   <arch>x86_64</arch>
Jul 24 16:13:42 user nova-compute[70243]:   <vcpu max='255'/>
Jul 24 16:13:42 user nova-compute[70243]:   <iothreads supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:   <os supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:     <enum name='firmware'>
Jul 24 16:13:42 user nova-compute[70243]:       <value>efi</value>
Jul 24 16:13:42 user nova-compute[70243]:     </enum>
Jul 24 16:13:42 user nova-compute[70243]:     <loader supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='type'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>rom</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>pflash</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='readonly'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>yes</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>no</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='secure'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>no</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </loader>
Jul 24 16:13:42 user nova-compute[70243]:   </os>
Jul 24 16:13:42 user nova-compute[70243]:   <cpu>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='host-passthrough' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='hostPassthroughMigratable'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>on</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>off</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='maximum' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='maximumMigratable'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>on</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>off</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='host-model' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <vendor>Intel</vendor>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ss'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='vmx'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='pcid'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='hypervisor'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='arat'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='umip'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='md-clear'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='stibp'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ssbd'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='invtsc'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ibpb'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ibrs'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='amd-stibp'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='rsba'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='pschange-mc-no'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='disable' name='erms'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='custom' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>qemu64</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>qemu32</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>phenom</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium3</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium2</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>n270</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>kvm64</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>kvm32</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>coreduo</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>core2duo</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>athlon</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Westmere-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Westmere</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Snowridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>SandyBridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Penryn</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G5</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G4</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G3</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G2</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Opteron_G1</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Nehalem</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>IvyBridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Icelake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-Rome</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-Milan</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Dhyana</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cooperlake</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Conroe</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>486</model>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:   </cpu>
Jul 24 16:13:42 user nova-compute[70243]:   <memoryBacking supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:     <enum name='sourceType'>
Jul 24 16:13:42 user nova-compute[70243]:       <value>file</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>anonymous</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>memfd</value>
Jul 24 16:13:42 user nova-compute[70243]:     </enum>
Jul 24 16:13:42 user nova-compute[70243]:   </memoryBacking>
Jul 24 16:13:42 user nova-compute[70243]:   <devices>
Jul 24 16:13:42 user nova-compute[70243]:     <disk supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='diskDevice'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>disk</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>cdrom</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>floppy</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>lun</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='bus'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>ide</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>fdc</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>scsi</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>usb</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>sata</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-non-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </disk>
Jul 24 16:13:42 user nova-compute[70243]:     <graphics supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='type'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>sdl</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vnc</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>spice</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>egl-headless</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </graphics>
Jul 24 16:13:42 user nova-compute[70243]:     <video supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='modelType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vga</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>cirrus</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vmvga</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>qxl</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>none</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>bochs</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>ramfb</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </video>
Jul 24 16:13:42 user nova-compute[70243]:     <hostdev supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='mode'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>subsystem</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='startupPolicy'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>default</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>mandatory</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>requisite</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>optional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='subsysType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>usb</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>pci</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>scsi</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='capsType'/>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='pciBackend'/>
Jul 24 16:13:42 user nova-compute[70243]:     </hostdev>
Jul 24 16:13:42 user nova-compute[70243]:     <rng supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-non-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='backendModel'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>random</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>egd</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>builtin</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </rng>
Jul 24 16:13:42 user nova-compute[70243]:     <filesystem supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='driverType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>path</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>handle</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtiofs</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </filesystem>
Jul 24 16:13:42 user nova-compute[70243]:     <tpm supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>tpm-tis</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>tpm-crb</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='backendModel'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>passthrough</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>emulator</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </tpm>
Jul 24 16:13:42 user nova-compute[70243]:   </devices>
Jul 24 16:13:42 user nova-compute[70243]:   <features>
Jul 24 16:13:42 user nova-compute[70243]:     <gic supported='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     <vmcoreinfo supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <genid supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <backingStoreInput supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <backup supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <sev supported='no'/>
Jul 24 16:13:42 user nova-compute[70243]:   </features>
Jul 24 16:13:42 user nova-compute[70243]: </domainCapabilities>
Jul 24 16:13:42 user nova-compute[70243]:  {{(pid=70243) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Jul 24 16:13:42 user nova-compute[70243]: <domainCapabilities>
Jul 24 16:13:42 user nova-compute[70243]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 24 16:13:42 user nova-compute[70243]:   <domain>kvm</domain>
Jul 24 16:13:42 user nova-compute[70243]:   <machine>pc-i440fx-jammy</machine>
Jul 24 16:13:42 user nova-compute[70243]:   <arch>x86_64</arch>
Jul 24 16:13:42 user nova-compute[70243]:   <vcpu max='255'/>
Jul 24 16:13:42 user nova-compute[70243]:   <iothreads supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:   <os supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:     <enum name='firmware'>
Jul 24 16:13:42 user nova-compute[70243]:       <value>efi</value>
Jul 24 16:13:42 user nova-compute[70243]:     </enum>
Jul 24 16:13:42 user nova-compute[70243]:     <loader supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='type'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>rom</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>pflash</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='readonly'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>yes</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>no</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='secure'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>no</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </loader>
Jul 24 16:13:42 user nova-compute[70243]:   </os>
Jul 24 16:13:42 user nova-compute[70243]:   <cpu>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='host-passthrough' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='hostPassthroughMigratable'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>on</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>off</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='maximum' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='maximumMigratable'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>on</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>off</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='host-model' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <vendor>Intel</vendor>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ss'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='vmx'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='pcid'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='hypervisor'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='arat'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='tsc_adjust'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='umip'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='md-clear'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='stibp'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='arch-capabilities'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ssbd'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='invtsc'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ibpb'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='ibrs'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='amd-stibp'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='amd-ssbd'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='rsba'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='require' name='pschange-mc-no'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='disable' name='erms'/>
Jul 24 16:13:42 user nova-compute[70243]:       <feature policy='disable' name='xsaveopt'/>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:     <mode name='custom' supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>qemu64</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>qemu32</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>phenom</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium3</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium2</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>pentium</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>n270</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>kvm64</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>kvm32</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>coreduo</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>core2duo</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>athlon</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Westmere-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Westmere</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Snowridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Skylake-Client</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>SandyBridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Penryn</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G5</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G4</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G3</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Opteron_G2</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Opteron_G1</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Nehalem</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>IvyBridge</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Icelake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Haswell</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-Rome</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-Milan</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC-IBPB</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>EPYC</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Dhyana</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cooperlake</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>Conroe</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Cascadelake-Server</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-noTSX</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell-IBRS</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='no'>Broadwell</model>
Jul 24 16:13:42 user nova-compute[70243]:       <model usable='yes'>486</model>
Jul 24 16:13:42 user nova-compute[70243]:     </mode>
Jul 24 16:13:42 user nova-compute[70243]:   </cpu>
Jul 24 16:13:42 user nova-compute[70243]:   <memoryBacking supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:     <enum name='sourceType'>
Jul 24 16:13:42 user nova-compute[70243]:       <value>file</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>anonymous</value>
Jul 24 16:13:42 user nova-compute[70243]:       <value>memfd</value>
Jul 24 16:13:42 user nova-compute[70243]:     </enum>
Jul 24 16:13:42 user nova-compute[70243]:   </memoryBacking>
Jul 24 16:13:42 user nova-compute[70243]:   <devices>
Jul 24 16:13:42 user nova-compute[70243]:     <disk supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='diskDevice'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>disk</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>cdrom</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>floppy</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>lun</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='bus'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>ide</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>fdc</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>scsi</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>usb</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>sata</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-non-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </disk>
Jul 24 16:13:42 user nova-compute[70243]:     <graphics supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='type'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>sdl</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vnc</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>spice</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>egl-headless</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </graphics>
Jul 24 16:13:42 user nova-compute[70243]:     <video supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='modelType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vga</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>cirrus</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>vmvga</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>qxl</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>none</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>bochs</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>ramfb</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </video>
Jul 24 16:13:42 user nova-compute[70243]:     <hostdev supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='mode'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>subsystem</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='startupPolicy'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>default</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>mandatory</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>requisite</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>optional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='subsysType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>usb</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>pci</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>scsi</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='capsType'/>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='pciBackend'/>
Jul 24 16:13:42 user nova-compute[70243]:     </hostdev>
Jul 24 16:13:42 user nova-compute[70243]:     <rng supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtio-non-transitional</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='backendModel'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>random</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>egd</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>builtin</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </rng>
Jul 24 16:13:42 user nova-compute[70243]:     <filesystem supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='driverType'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>path</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>handle</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>virtiofs</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </filesystem>
Jul 24 16:13:42 user nova-compute[70243]:     <tpm supported='yes'>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='model'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>tpm-tis</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>tpm-crb</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:       <enum name='backendModel'>
Jul 24 16:13:42 user nova-compute[70243]:         <value>passthrough</value>
Jul 24 16:13:42 user nova-compute[70243]:         <value>emulator</value>
Jul 24 16:13:42 user nova-compute[70243]:       </enum>
Jul 24 16:13:42 user nova-compute[70243]:     </tpm>
Jul 24 16:13:42 user nova-compute[70243]:   </devices>
Jul 24 16:13:42 user nova-compute[70243]:   <features>
Jul 24 16:13:42 user nova-compute[70243]:     <gic supported='no'/>
Jul 24 16:13:42 user nova-compute[70243]:     <vmcoreinfo supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <genid supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <backingStoreInput supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <backup supported='yes'/>
Jul 24 16:13:42 user nova-compute[70243]:     <sev supported='no'/>
Jul 24 16:13:42 user nova-compute[70243]:   </features>
Jul 24 16:13:42 user nova-compute[70243]: </domainCapabilities>
Jul 24 16:13:42 user nova-compute[70243]:  {{(pid=70243) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=70243) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=70243) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Checking secure boot support for host arch (x86_64) {{(pid=70243) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 24 16:13:42 user nova-compute[70243]: INFO nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Secure Boot support detected
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] cpu compare xml: <cpu match="exact">
Jul 24 16:13:42 user nova-compute[70243]:   <model>Nehalem</model>
Jul 24 16:13:42 user nova-compute[70243]: </cpu>
Jul 24 16:13:42 user nova-compute[70243]:  {{(pid=70243) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Jul 24 16:13:42 user nova-compute[70243]: INFO nova.virt.node [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Generated node identity 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0
Jul 24 16:13:42 user nova-compute[70243]: INFO nova.virt.node [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Wrote node identity 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 to /opt/stack/data/nova/compute_id
Jul 24 16:13:42 user nova-compute[70243]: WARNING nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Compute nodes ['428d8cd7-181b-4d2d-ad06-02c79cc6b5e0'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Jul 24 16:13:42 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Jul 24 16:13:42 user nova-compute[70243]: WARNING nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 24 16:13:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:13:42 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:13:43 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:13:43 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:13:43 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Hypervisor/Node resource view: name=user free_ram=10837MB free_disk=25.22455596923828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:13:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:13:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:13:43 user nova-compute[70243]: WARNING nova.compute.resource_tracker [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] No compute node record for user:428d8cd7-181b-4d2d-ad06-02c79cc6b5e0: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 could not be found.
Jul 24 16:13:43 user nova-compute[70243]: INFO nova.compute.resource_tracker [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Compute node record created for user:user with uuid: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0
Jul 24 16:13:43 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:13:43 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:13:43 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [req-1e7b5e9b-b7b2-471d-be60-1e31407984cc] Created resource provider record via placement API for resource provider with UUID 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 and name user.
Jul 24 16:13:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=70243) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Jul 24 16:13:43 user nova-compute[70243]: INFO nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] kernel doesn't support AMD SEV
Jul 24 16:13:43 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Updating inventory in ProviderTree for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 16:13:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:13:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Libvirt baseline CPU <cpu>
Jul 24 16:13:43 user nova-compute[70243]:   <arch>x86_64</arch>
Jul 24 16:13:43 user nova-compute[70243]:   <model>Nehalem</model>
Jul 24 16:13:43 user nova-compute[70243]:   <vendor>Intel</vendor>
Jul 24 16:13:43 user nova-compute[70243]:   <topology sockets="6" cores="1" threads="1"/>
Jul 24 16:13:43 user nova-compute[70243]: </cpu>
Jul 24 16:13:43 user nova-compute[70243]:  {{(pid=70243) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Jul 24 16:13:43 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Updated inventory for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Jul 24 16:13:43 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Updating resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 generation from 0 to 1 during operation: update_inventory {{(pid=70243) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 24 16:13:43 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Updating inventory in ProviderTree for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 16:13:43 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Updating resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 generation from 1 to 2 during operation: update_traits {{(pid=70243) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 24 16:13:43 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:13:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.651s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:13:43 user nova-compute[70243]: DEBUG nova.service [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Creating RPC server for service compute {{(pid=70243) start /opt/stack/nova/nova/service.py:182}}
Jul 24 16:13:43 user nova-compute[70243]: DEBUG nova.service [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Join ServiceGroup membership for this service compute {{(pid=70243) start /opt/stack/nova/nova/service.py:199}}
Jul 24 16:13:43 user nova-compute[70243]: DEBUG nova.servicegroup.drivers.db [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=70243) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Jul 24 16:14:10 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:14:10 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Didn't find any instances for network info cache update. {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:14:34 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:14:34 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:14:34 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=10237MB free_disk=25.128543853759766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:14:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.105s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:15:34 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:15:34 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:15:34 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:15:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:15:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:15:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:15:34 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:15:35 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:15:35 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:15:35 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=10185MB free_disk=25.174331665039062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:15:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:15:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:15:35 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:15:35 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:15:35 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:15:35 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:15:35 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:15:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:15:35 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:15:35 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:15:35 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:15:35 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:15:35 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:15:36 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:15:36 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:15:36 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:15:36 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 16:15:36 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Didn't find any instances for network info cache update. {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 16:15:36 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:16:34 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:16:35 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:16:35 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:16:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:16:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:16:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:16:35 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:16:35 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:16:35 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:16:35 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=10198MB free_disk=24.9476318359375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:16:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:16:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:16:35 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:16:35 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:16:35 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:16:35 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:16:35 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:16:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:16:36 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:16:36 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:16:36 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:16:36 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:16:36 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:16:37 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:16:37 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:16:37 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 16:16:37 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Didn't find any instances for network info cache update. {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 16:16:37 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:17:34 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:17:36 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:17:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:36 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:17:36 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:17:36 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:17:36 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=9413MB free_disk=24.970539093017578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:17:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:36 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:17:36 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:17:36 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:17:36 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:17:36 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:17:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:37 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:17:37 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:17:37 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:17:38 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:17:38 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:17:38 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:17:38 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:17:39 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:17:39 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:17:39 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:17:39 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 16:17:39 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Didn't find any instances for network info cache update. {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 16:17:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Acquiring lock "e637a0d4-d38e-46e0-8fde-3b45c2410439" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "e637a0d4-d38e-46e0-8fde-3b45c2410439" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:48 user nova-compute[70243]: DEBUG nova.compute.manager [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:17:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:48 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:17:48 user nova-compute[70243]: INFO nova.compute.claims [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Claim successful on node user
Jul 24 16:17:48 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:17:48 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:17:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:48 user nova-compute[70243]: DEBUG nova.compute.manager [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:17:48 user nova-compute[70243]: DEBUG nova.compute.manager [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:17:48 user nova-compute[70243]: DEBUG nova.network.neutron [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:17:48 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:17:48 user nova-compute[70243]: DEBUG nova.compute.manager [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:17:49 user nova-compute[70243]: DEBUG nova.compute.manager [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:17:49 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:17:49 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Creating image(s)
Jul 24 16:17:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Acquiring lock "/opt/stack/data/nova/instances/e637a0d4-d38e-46e0-8fde-3b45c2410439/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "/opt/stack/data/nova/instances/e637a0d4-d38e-46e0-8fde-3b45c2410439/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "/opt/stack/data/nova/instances/e637a0d4-d38e-46e0-8fde-3b45c2410439/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:49 user nova-compute[70243]: DEBUG nova.policy [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f0773bcaad34af2ba2bab77b1eaef97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc401d03db549a7b4082dc30655d9d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:17:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d.part --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d.part --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:50 user nova-compute[70243]: DEBUG nova.virt.images [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] 7192dcb0-7da9-4207-b62f-555f7e11e667 was qcow2, converting to raw {{(pid=70243) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 16:17:50 user nova-compute[70243]: DEBUG nova.privsep.utils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70243) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 16:17:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d.part /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d.converted {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d.part /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d.converted" returned: 0 in 0.205s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d.converted --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d.converted --force-share --output=json" returned: 0 in 0.146s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.455s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:50 user nova-compute[70243]: INFO oslo.privsep.daemon [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpyjr4jfiz/privsep.sock']
Jul 24 16:17:50 user sudo[79380]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpyjr4jfiz/privsep.sock
Jul 24 16:17:50 user sudo[79380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 24 16:17:52 user nova-compute[70243]: DEBUG nova.network.neutron [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Successfully created port: 49a60955-c322-46d8-910d-31d4302f9f27 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:17:52 user sudo[79380]: pam_unix(sudo:session): session closed for user root
Jul 24 16:17:52 user nova-compute[70243]: INFO oslo.privsep.daemon [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Spawned new privsep daemon via rootwrap
Jul 24 16:17:52 user nova-compute[70243]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 24 16:17:52 user nova-compute[70243]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 24 16:17:52 user nova-compute[70243]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 24 16:17:52 user nova-compute[70243]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 79383
Jul 24 16:17:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.144s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/e637a0d4-d38e-46e0-8fde-3b45c2410439/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/e637a0d4-d38e-46e0-8fde-3b45c2410439/disk 1073741824" returned: 0 in 0.042s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:52 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e637a0d4-d38e-46e0-8fde-3b45c2410439/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:17:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e637a0d4-d38e-46e0-8fde-3b45c2410439/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e637a0d4-d38e-46e0-8fde-3b45c2410439/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:53 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Cannot resize image /opt/stack/data/nova/instances/e637a0d4-d38e-46e0-8fde-3b45c2410439/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:17:53 user nova-compute[70243]: DEBUG nova.objects.instance [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lazy-loading 'migration_context' on Instance uuid e637a0d4-d38e-46e0-8fde-3b45c2410439 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:17:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:17:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Ensure instance console log exists: /opt/stack/data/nova/instances/e637a0d4-d38e-46e0-8fde-3b45c2410439/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:17:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "de22ea98-b041-4f3f-8986-435c43267a2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "de22ea98-b041-4f3f-8986-435c43267a2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:53 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:17:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:53 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:17:53 user nova-compute[70243]: INFO nova.compute.claims [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Claim successful on node user
Jul 24 16:17:54 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:17:54 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:17:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:54 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:17:54 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:17:54 user nova-compute[70243]: DEBUG nova.network.neutron [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:17:54 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:17:54 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:17:54 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:17:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:17:54 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Creating image(s)
Jul 24 16:17:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "/opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "/opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "/opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.170s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.156s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk 1073741824" returned: 0 in 0.050s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG nova.policy [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa3936255d31421184e585e2fd17d7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdb3cb079814db091227f80b2ed1b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.213s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Cannot resize image /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG nova.objects.instance [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lazy-loading 'migration_context' on Instance uuid de22ea98-b041-4f3f-8986-435c43267a2e {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Ensure instance console log exists: /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG nova.network.neutron [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Successfully updated port: 49a60955-c322-46d8-910d-31d4302f9f27 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Acquiring lock "refresh_cache-e637a0d4-d38e-46e0-8fde-3b45c2410439" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Acquired lock "refresh_cache-e637a0d4-d38e-46e0-8fde-3b45c2410439" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG nova.network.neutron [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "de484cb2-7f20-4bf1-927b-c066735bfeca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "de484cb2-7f20-4bf1-927b-c066735bfeca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquiring lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:17:55 user nova-compute[70243]: INFO nova.compute.claims [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Claim successful on node user
Jul 24 16:17:55 user nova-compute[70243]: DEBUG nova.network.neutron [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG nova.compute.manager [req-9b27774d-ab16-41fb-8828-0202c55df00c req-c0702b1f-f2dc-414e-a186-09f650142325 service nova] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Received event network-changed-49a60955-c322-46d8-910d-31d4302f9f27 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG nova.compute.manager [req-9b27774d-ab16-41fb-8828-0202c55df00c req-c0702b1f-f2dc-414e-a186-09f650142325 service nova] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Refreshing instance network info cache due to event network-changed-49a60955-c322-46d8-910d-31d4302f9f27. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:17:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9b27774d-ab16-41fb-8828-0202c55df00c req-c0702b1f-f2dc-414e-a186-09f650142325 service nova] Acquiring lock "refresh_cache-e637a0d4-d38e-46e0-8fde-3b45c2410439" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.324s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:17:56 user nova-compute[70243]: INFO nova.compute.claims [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Claim successful on node user
Jul 24 16:17:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG nova.network.neutron [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:17:56 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:17:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:17:56 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Creating image(s)
Jul 24 16:17:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "/opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "/opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "/opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG nova.policy [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93b6ed534c2c44d08a71f3050e212644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24d98248104f5f898cf6f79207435b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.146s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.118s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG nova.network.neutron [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk 1073741824" returned: 0 in 0.046s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.168s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:56 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:17:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG nova.network.neutron [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Updating instance_info_cache with network_info: [{"id": "49a60955-c322-46d8-910d-31d4302f9f27", "address": "fa:16:3e:6b:ce:ba", "network": {"id": "57522509-2606-4962-aa15-fad15bf1dc6e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-863116301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcc401d03db549a7b4082dc30655d9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a60955-c3", "ovs_interfaceid": "49a60955-c322-46d8-910d-31d4302f9f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Releasing lock "refresh_cache-e637a0d4-d38e-46e0-8fde-3b45c2410439" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Instance network_info: |[{"id": "49a60955-c322-46d8-910d-31d4302f9f27", "address": "fa:16:3e:6b:ce:ba", "network": {"id": "57522509-2606-4962-aa15-fad15bf1dc6e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-863116301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcc401d03db549a7b4082dc30655d9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a60955-c3", "ovs_interfaceid": "49a60955-c322-46d8-910d-31d4302f9f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9b27774d-ab16-41fb-8828-0202c55df00c req-c0702b1f-f2dc-414e-a186-09f650142325 service nova] Acquired lock "refresh_cache-e637a0d4-d38e-46e0-8fde-3b45c2410439" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG nova.network.neutron [req-9b27774d-ab16-41fb-8828-0202c55df00c req-c0702b1f-f2dc-414e-a186-09f650142325 service nova] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Refreshing network info cache for port 49a60955-c322-46d8-910d-31d4302f9f27 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:17:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Start _get_guest_xml network_info=[{"id": "49a60955-c322-46d8-910d-31d4302f9f27", "address": "fa:16:3e:6b:ce:ba", "network": {"id": "57522509-2606-4962-aa15-fad15bf1dc6e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-863116301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcc401d03db549a7b4082dc30655d9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a60955-c3", "ovs_interfaceid": "49a60955-c322-46d8-910d-31d4302f9f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:17:56 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:17:56 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.privsep.utils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70243) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1597360493',display_name='tempest-DeleteServersTestJSON-server-1597360493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1597360493',id=1,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcc401d03db549a7b4082dc30655d9d2',ramdisk_id='',reservation_id='r-j6ewmg20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1630589831',owner_user_name='tempest-DeleteServersTestJSON-1630589831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:17:49Z,user_data=None,user_id='8f0773bcaad34af2ba2bab77b1eaef97',uuid=e637a0d4-d38e-46e0-8fde-3b45c2410439,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49a60955-c322-46d8-910d-31d4302f9f27", "address": "fa:16:3e:6b:ce:ba", "network": {"id": "57522509-2606-4962-aa15-fad15bf1dc6e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-863116301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcc401d03db549a7b4082dc30655d9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a60955-c3", "ovs_interfaceid": "49a60955-c322-46d8-910d-31d4302f9f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Converting VIF {"id": "49a60955-c322-46d8-910d-31d4302f9f27", "address": "fa:16:3e:6b:ce:ba", "network": {"id": "57522509-2606-4962-aa15-fad15bf1dc6e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-863116301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcc401d03db549a7b4082dc30655d9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a60955-c3", "ovs_interfaceid": "49a60955-c322-46d8-910d-31d4302f9f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ce:ba,bridge_name='br-int',has_traffic_filtering=True,id=49a60955-c322-46d8-910d-31d4302f9f27,network=Network(57522509-2606-4962-aa15-fad15bf1dc6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a60955-c3') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.objects.instance [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lazy-loading 'pci_devices' on Instance uuid e637a0d4-d38e-46e0-8fde-3b45c2410439 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.compute.manager [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:17:57 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Creating image(s)
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquiring lock "/opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "/opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "/opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:17:57 user nova-compute[70243]:   <uuid>e637a0d4-d38e-46e0-8fde-3b45c2410439</uuid>
Jul 24 16:17:57 user nova-compute[70243]:   <name>instance-00000001</name>
Jul 24 16:17:57 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:17:57 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:17:57 user nova-compute[70243]:   <metadata>
Jul 24 16:17:57 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:17:57 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:17:57 user nova-compute[70243]:       <nova:name>tempest-DeleteServersTestJSON-server-1597360493</nova:name>
Jul 24 16:17:57 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:17:56</nova:creationTime>
Jul 24 16:17:57 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:17:57 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:17:57 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:17:57 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:17:57 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:17:57 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:17:57 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:17:57 user nova-compute[70243]:       <nova:owner>
Jul 24 16:17:57 user nova-compute[70243]:         <nova:user uuid="8f0773bcaad34af2ba2bab77b1eaef97">tempest-DeleteServersTestJSON-1630589831-project-member</nova:user>
Jul 24 16:17:57 user nova-compute[70243]:         <nova:project uuid="bcc401d03db549a7b4082dc30655d9d2">tempest-DeleteServersTestJSON-1630589831</nova:project>
Jul 24 16:17:57 user nova-compute[70243]:       </nova:owner>
Jul 24 16:17:57 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:17:57 user nova-compute[70243]:       <nova:ports>
Jul 24 16:17:57 user nova-compute[70243]:         <nova:port uuid="49a60955-c322-46d8-910d-31d4302f9f27">
Jul 24 16:17:57 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 16:17:57 user nova-compute[70243]:         </nova:port>
Jul 24 16:17:57 user nova-compute[70243]:       </nova:ports>
Jul 24 16:17:57 user nova-compute[70243]:     </nova:instance>
Jul 24 16:17:57 user nova-compute[70243]:   </metadata>
Jul 24 16:17:57 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:17:57 user nova-compute[70243]:     <system>
Jul 24 16:17:57 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:17:57 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:17:57 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:17:57 user nova-compute[70243]:       <entry name="serial">e637a0d4-d38e-46e0-8fde-3b45c2410439</entry>
Jul 24 16:17:57 user nova-compute[70243]:       <entry name="uuid">e637a0d4-d38e-46e0-8fde-3b45c2410439</entry>
Jul 24 16:17:57 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:17:57 user nova-compute[70243]:     </system>
Jul 24 16:17:57 user nova-compute[70243]:   </sysinfo>
Jul 24 16:17:57 user nova-compute[70243]:   <os>
Jul 24 16:17:57 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:17:57 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:17:57 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:17:57 user nova-compute[70243]:   </os>
Jul 24 16:17:57 user nova-compute[70243]:   <features>
Jul 24 16:17:57 user nova-compute[70243]:     <acpi/>
Jul 24 16:17:57 user nova-compute[70243]:     <apic/>
Jul 24 16:17:57 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:17:57 user nova-compute[70243]:   </features>
Jul 24 16:17:57 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:17:57 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:17:57 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:17:57 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:17:57 user nova-compute[70243]:   </clock>
Jul 24 16:17:57 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:17:57 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:17:57 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:17:57 user nova-compute[70243]:   </cpu>
Jul 24 16:17:57 user nova-compute[70243]:   <devices>
Jul 24 16:17:57 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:17:57 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:17:57 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/e637a0d4-d38e-46e0-8fde-3b45c2410439/disk"/>
Jul 24 16:17:57 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:17:57 user nova-compute[70243]:     </disk>
Jul 24 16:17:57 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:17:57 user nova-compute[70243]:       <mac address="fa:16:3e:6b:ce:ba"/>
Jul 24 16:17:57 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:17:57 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:17:57 user nova-compute[70243]:       <target dev="tap49a60955-c3"/>
Jul 24 16:17:57 user nova-compute[70243]:     </interface>
Jul 24 16:17:57 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:17:57 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/e637a0d4-d38e-46e0-8fde-3b45c2410439/console.log" append="off"/>
Jul 24 16:17:57 user nova-compute[70243]:     </serial>
Jul 24 16:17:57 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:17:57 user nova-compute[70243]:     <video>
Jul 24 16:17:57 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:17:57 user nova-compute[70243]:     </video>
Jul 24 16:17:57 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:17:57 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:17:57 user nova-compute[70243]:     </rng>
Jul 24 16:17:57 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:17:57 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:17:57 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:17:57 user nova-compute[70243]:     </memballoon>
Jul 24 16:17:57 user nova-compute[70243]:   </devices>
Jul 24 16:17:57 user nova-compute[70243]: </domain>
Jul 24 16:17:57 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1597360493',display_name='tempest-DeleteServersTestJSON-server-1597360493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1597360493',id=1,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcc401d03db549a7b4082dc30655d9d2',ramdisk_id='',reservation_id='r-j6ewmg20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1630589831',owner_user_name='tempest-DeleteServersTestJSON-1630589831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:17:49Z,user_data=None,user_id='8f0773bcaad34af2ba2bab77b1eaef97',uuid=e637a0d4-d38e-46e0-8fde-3b45c2410439,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49a60955-c322-46d8-910d-31d4302f9f27", "address": "fa:16:3e:6b:ce:ba", "network": {"id": "57522509-2606-4962-aa15-fad15bf1dc6e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-863116301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcc401d03db549a7b4082dc30655d9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a60955-c3", "ovs_interfaceid": "49a60955-c322-46d8-910d-31d4302f9f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Converting VIF {"id": "49a60955-c322-46d8-910d-31d4302f9f27", "address": "fa:16:3e:6b:ce:ba", "network": {"id": "57522509-2606-4962-aa15-fad15bf1dc6e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-863116301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcc401d03db549a7b4082dc30655d9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a60955-c3", "ovs_interfaceid": "49a60955-c322-46d8-910d-31d4302f9f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ce:ba,bridge_name='br-int',has_traffic_filtering=True,id=49a60955-c322-46d8-910d-31d4302f9f27,network=Network(57522509-2606-4962-aa15-fad15bf1dc6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a60955-c3') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG os_vif [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ce:ba,bridge_name='br-int',has_traffic_filtering=True,id=49a60955-c322-46d8-910d-31d4302f9f27,network=Network(57522509-2606-4962-aa15-fad15bf1dc6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a60955-c3') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.policy [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5afda4138db34a6c95e974a5814ea26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c70a6d9bf46466da48267f2fc2e02d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Created schema index Interface.name {{(pid=70243) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Created schema index Port.name {{(pid=70243) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Created schema index Bridge.name {{(pid=70243) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Cannot resize image /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.objects.instance [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lazy-loading 'migration_context' on Instance uuid de484cb2-7f20-4bf1-927b-c066735bfeca {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [POLLOUT] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.154s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Ensure instance console log exists: /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.188s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "ad611655-ba4d-4a66-b78e-a82c058f4414" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:17:57 user nova-compute[70243]: INFO oslo.privsep.daemon [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpu_rzaril/privsep.sock']
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk 1073741824" returned: 0 in 0.045s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:57 user sudo[79457]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpu_rzaril/privsep.sock
Jul 24 16:17:57 user sudo[79457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:17:57 user nova-compute[70243]: INFO nova.compute.claims [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Claim successful on node user
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Cannot resize image /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.objects.instance [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lazy-loading 'migration_context' on Instance uuid a13c243a-2b98-4ef1-b17c-e2e15ba005fd {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Ensure instance console log exists: /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:57 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG nova.network.neutron [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:17:58 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:17:58 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:17:58 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Creating image(s)
Jul 24 16:17:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "/opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "/opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG nova.policy [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7de0cd9dd23d4569939884728bde772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd099632b940545b9bbe000e5cc323ec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.156s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG nova.network.neutron [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Successfully created port: e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG nova.network.neutron [req-9b27774d-ab16-41fb-8828-0202c55df00c req-c0702b1f-f2dc-414e-a186-09f650142325 service nova] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Updated VIF entry in instance network info cache for port 49a60955-c322-46d8-910d-31d4302f9f27. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG nova.network.neutron [req-9b27774d-ab16-41fb-8828-0202c55df00c req-c0702b1f-f2dc-414e-a186-09f650142325 service nova] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Updating instance_info_cache with network_info: [{"id": "49a60955-c322-46d8-910d-31d4302f9f27", "address": "fa:16:3e:6b:ce:ba", "network": {"id": "57522509-2606-4962-aa15-fad15bf1dc6e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-863116301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcc401d03db549a7b4082dc30655d9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a60955-c3", "ovs_interfaceid": "49a60955-c322-46d8-910d-31d4302f9f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.131s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG nova.network.neutron [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Successfully created port: e3519574-a5e5-48f3-9e0c-852d0e9e3505 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9b27774d-ab16-41fb-8828-0202c55df00c req-c0702b1f-f2dc-414e-a186-09f650142325 service nova] Releasing lock "refresh_cache-e637a0d4-d38e-46e0-8fde-3b45c2410439" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk 1073741824" returned: 0 in 0.061s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.122s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Cannot resize image /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG nova.objects.instance [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'migration_context' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Ensure instance console log exists: /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:17:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:17:59 user sudo[79457]: pam_unix(sudo:session): session closed for user root
Jul 24 16:17:59 user nova-compute[70243]: INFO oslo.privsep.daemon [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Spawned new privsep daemon via rootwrap
Jul 24 16:17:59 user nova-compute[70243]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 24 16:17:59 user nova-compute[70243]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 24 16:17:59 user nova-compute[70243]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Jul 24 16:17:59 user nova-compute[70243]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 79480
Jul 24 16:17:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "5f70528b-33db-4257-96fe-e5fad869a224" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "5f70528b-33db-4257-96fe-e5fad869a224" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:59 user nova-compute[70243]: DEBUG nova.compute.manager [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:17:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:17:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49a60955-c3, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:17:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap49a60955-c3, col_values=(('external_ids', {'iface-id': '49a60955-c322-46d8-910d-31d4302f9f27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:ce:ba', 'vm-uuid': 'e637a0d4-d38e-46e0-8fde-3b45c2410439'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:17:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:17:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:17:59 user nova-compute[70243]: INFO os_vif [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ce:ba,bridge_name='br-int',has_traffic_filtering=True,id=49a60955-c322-46d8-910d-31d4302f9f27,network=Network(57522509-2606-4962-aa15-fad15bf1dc6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a60955-c3')
Jul 24 16:17:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:17:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:17:59 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:17:59 user nova-compute[70243]: INFO nova.compute.claims [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Claim successful on node user
Jul 24 16:17:59 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:17:59 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] No VIF found with MAC fa:16:3e:6b:ce:ba, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:17:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Successfully updated port: e3519574-a5e5-48f3-9e0c-852d0e9e3505 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:18:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "refresh_cache-de484cb2-7f20-4bf1-927b-c066735bfeca" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:18:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquired lock "refresh_cache-de484cb2-7f20-4bf1-927b-c066735bfeca" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:18:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:18:00 user nova-compute[70243]: DEBUG nova.compute.manager [req-457aa9f6-123c-4817-b678-80915d8eae14 req-b33f514b-908a-48c8-9b5e-cf046cf94d0c service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Received event network-changed-e3519574-a5e5-48f3-9e0c-852d0e9e3505 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:00 user nova-compute[70243]: DEBUG nova.compute.manager [req-457aa9f6-123c-4817-b678-80915d8eae14 req-b33f514b-908a-48c8-9b5e-cf046cf94d0c service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Refreshing instance network info cache due to event network-changed-e3519574-a5e5-48f3-9e0c-852d0e9e3505. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:18:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-457aa9f6-123c-4817-b678-80915d8eae14 req-b33f514b-908a-48c8-9b5e-cf046cf94d0c service nova] Acquiring lock "refresh_cache-de484cb2-7f20-4bf1-927b-c066735bfeca" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:18:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:18:00 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:18:00 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:18:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.802s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:18:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Successfully created port: 2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:18:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:18:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:18:00 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:18:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:18:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Successfully created port: ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:18:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:18:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:18:00 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Creating image(s)
Jul 24 16:18:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "/opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "/opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.145s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.150s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk 1073741824" returned: 0 in 0.051s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.policy [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9db33a574c334a2d91afc72b21ef15e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5385c4cfc8d84d1abd728c11d75c003d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.180s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Cannot resize image /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.objects.instance [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lazy-loading 'migration_context' on Instance uuid 5f70528b-33db-4257-96fe-e5fad869a224 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Ensure instance console log exists: /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.network.neutron [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Updating instance_info_cache with network_info: [{"id": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "address": "fa:16:3e:8b:ac:95", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3519574-a5", "ovs_interfaceid": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Releasing lock "refresh_cache-de484cb2-7f20-4bf1-927b-c066735bfeca" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Instance network_info: |[{"id": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "address": "fa:16:3e:8b:ac:95", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3519574-a5", "ovs_interfaceid": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-457aa9f6-123c-4817-b678-80915d8eae14 req-b33f514b-908a-48c8-9b5e-cf046cf94d0c service nova] Acquired lock "refresh_cache-de484cb2-7f20-4bf1-927b-c066735bfeca" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.network.neutron [req-457aa9f6-123c-4817-b678-80915d8eae14 req-b33f514b-908a-48c8-9b5e-cf046cf94d0c service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Refreshing network info cache for port e3519574-a5e5-48f3-9e0c-852d0e9e3505 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Start _get_guest_xml network_info=[{"id": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "address": "fa:16:3e:8b:ac:95", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3519574-a5", "ovs_interfaceid": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:18:01 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:18:01 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1886654388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1886654388',id=3,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3fJVVBtKxrt2LD8LOh8QFcWuhNGbHNO3uDwNu28+nEDy7SWSLtikmY1xaqrqeTUpy4fYlAfegrXHnjy0xHrVH2MKaijfKhsymbrBuHSH5kmz77Lc8TXnMfDKezsXqDdQ==',key_name='tempest-keypair-1916786482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec24d98248104f5f898cf6f79207435b',ramdisk_id='',reservation_id='r-natg13nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1173962228',owner_user_name='tempest-ServerActionsV293TestJSON-1173962228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93b6ed534c2c44d08a71f3050e212644',uuid=de484cb2-7f20-4bf1-927b-c066735bfeca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "address": "fa:16:3e:8b:ac:95", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3519574-a5", "ovs_interfaceid": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Converting VIF {"id": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "address": "fa:16:3e:8b:ac:95", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3519574-a5", "ovs_interfaceid": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ac:95,bridge_name='br-int',has_traffic_filtering=True,id=e3519574-a5e5-48f3-9e0c-852d0e9e3505,network=Network(3ed67d60-f22b-4d39-9563-c680c176858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3519574-a5') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.objects.instance [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lazy-loading 'pci_devices' on Instance uuid de484cb2-7f20-4bf1-927b-c066735bfeca {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:18:01 user nova-compute[70243]:   <uuid>de484cb2-7f20-4bf1-927b-c066735bfeca</uuid>
Jul 24 16:18:01 user nova-compute[70243]:   <name>instance-00000003</name>
Jul 24 16:18:01 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:18:01 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:18:01 user nova-compute[70243]:   <metadata>
Jul 24 16:18:01 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:18:01 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:18:01 user nova-compute[70243]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1886654388</nova:name>
Jul 24 16:18:01 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:18:01</nova:creationTime>
Jul 24 16:18:01 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:18:01 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:18:01 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:18:01 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:18:01 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:18:01 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:18:01 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:18:01 user nova-compute[70243]:       <nova:owner>
Jul 24 16:18:01 user nova-compute[70243]:         <nova:user uuid="93b6ed534c2c44d08a71f3050e212644">tempest-ServerActionsV293TestJSON-1173962228-project-member</nova:user>
Jul 24 16:18:01 user nova-compute[70243]:         <nova:project uuid="ec24d98248104f5f898cf6f79207435b">tempest-ServerActionsV293TestJSON-1173962228</nova:project>
Jul 24 16:18:01 user nova-compute[70243]:       </nova:owner>
Jul 24 16:18:01 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:18:01 user nova-compute[70243]:       <nova:ports>
Jul 24 16:18:01 user nova-compute[70243]:         <nova:port uuid="e3519574-a5e5-48f3-9e0c-852d0e9e3505">
Jul 24 16:18:01 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 24 16:18:01 user nova-compute[70243]:         </nova:port>
Jul 24 16:18:01 user nova-compute[70243]:       </nova:ports>
Jul 24 16:18:01 user nova-compute[70243]:     </nova:instance>
Jul 24 16:18:01 user nova-compute[70243]:   </metadata>
Jul 24 16:18:01 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:18:01 user nova-compute[70243]:     <system>
Jul 24 16:18:01 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:18:01 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:18:01 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:18:01 user nova-compute[70243]:       <entry name="serial">de484cb2-7f20-4bf1-927b-c066735bfeca</entry>
Jul 24 16:18:01 user nova-compute[70243]:       <entry name="uuid">de484cb2-7f20-4bf1-927b-c066735bfeca</entry>
Jul 24 16:18:01 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:18:01 user nova-compute[70243]:     </system>
Jul 24 16:18:01 user nova-compute[70243]:   </sysinfo>
Jul 24 16:18:01 user nova-compute[70243]:   <os>
Jul 24 16:18:01 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:18:01 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:18:01 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:18:01 user nova-compute[70243]:   </os>
Jul 24 16:18:01 user nova-compute[70243]:   <features>
Jul 24 16:18:01 user nova-compute[70243]:     <acpi/>
Jul 24 16:18:01 user nova-compute[70243]:     <apic/>
Jul 24 16:18:01 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:18:01 user nova-compute[70243]:   </features>
Jul 24 16:18:01 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:18:01 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:18:01 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:18:01 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:18:01 user nova-compute[70243]:   </clock>
Jul 24 16:18:01 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:18:01 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:18:01 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:18:01 user nova-compute[70243]:   </cpu>
Jul 24 16:18:01 user nova-compute[70243]:   <devices>
Jul 24 16:18:01 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:18:01 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:18:01 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk"/>
Jul 24 16:18:01 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:18:01 user nova-compute[70243]:     </disk>
Jul 24 16:18:01 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:18:01 user nova-compute[70243]:       <mac address="fa:16:3e:8b:ac:95"/>
Jul 24 16:18:01 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:18:01 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:18:01 user nova-compute[70243]:       <target dev="tape3519574-a5"/>
Jul 24 16:18:01 user nova-compute[70243]:     </interface>
Jul 24 16:18:01 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:18:01 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/console.log" append="off"/>
Jul 24 16:18:01 user nova-compute[70243]:     </serial>
Jul 24 16:18:01 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:18:01 user nova-compute[70243]:     <video>
Jul 24 16:18:01 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:18:01 user nova-compute[70243]:     </video>
Jul 24 16:18:01 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:18:01 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:18:01 user nova-compute[70243]:     </rng>
Jul 24 16:18:01 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:18:01 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:18:01 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:18:01 user nova-compute[70243]:     </memballoon>
Jul 24 16:18:01 user nova-compute[70243]:   </devices>
Jul 24 16:18:01 user nova-compute[70243]: </domain>
Jul 24 16:18:01 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1886654388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1886654388',id=3,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3fJVVBtKxrt2LD8LOh8QFcWuhNGbHNO3uDwNu28+nEDy7SWSLtikmY1xaqrqeTUpy4fYlAfegrXHnjy0xHrVH2MKaijfKhsymbrBuHSH5kmz77Lc8TXnMfDKezsXqDdQ==',key_name='tempest-keypair-1916786482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec24d98248104f5f898cf6f79207435b',ramdisk_id='',reservation_id='r-natg13nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1173962228',owner_user_name='tempest-ServerActionsV293TestJSON-1173962228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93b6ed534c2c44d08a71f3050e212644',uuid=de484cb2-7f20-4bf1-927b-c066735bfeca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "address": "fa:16:3e:8b:ac:95", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3519574-a5", "ovs_interfaceid": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Converting VIF {"id": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "address": "fa:16:3e:8b:ac:95", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3519574-a5", "ovs_interfaceid": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ac:95,bridge_name='br-int',has_traffic_filtering=True,id=e3519574-a5e5-48f3-9e0c-852d0e9e3505,network=Network(3ed67d60-f22b-4d39-9563-c680c176858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3519574-a5') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG os_vif [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ac:95,bridge_name='br-int',has_traffic_filtering=True,id=e3519574-a5e5-48f3-9e0c-852d0e9e3505,network=Network(3ed67d60-f22b-4d39-9563-c680c176858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3519574-a5') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3519574-a5, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape3519574-a5, col_values=(('external_ids', {'iface-id': 'e3519574-a5e5-48f3-9e0c-852d0e9e3505', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:ac:95', 'vm-uuid': 'de484cb2-7f20-4bf1-927b-c066735bfeca'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:01 user nova-compute[70243]: INFO os_vif [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ac:95,bridge_name='br-int',has_traffic_filtering=True,id=e3519574-a5e5-48f3-9e0c-852d0e9e3505,network=Network(3ed67d60-f22b-4d39-9563-c680c176858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3519574-a5')
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] No VIF found with MAC fa:16:3e:8b:ac:95, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:18:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:02 user nova-compute[70243]: DEBUG nova.network.neutron [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Successfully updated port: e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:18:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "refresh_cache-de22ea98-b041-4f3f-8986-435c43267a2e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:18:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquired lock "refresh_cache-de22ea98-b041-4f3f-8986-435c43267a2e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:18:02 user nova-compute[70243]: DEBUG nova.network.neutron [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:18:02 user nova-compute[70243]: DEBUG nova.compute.manager [req-25427795-7412-4232-bbca-f9e90fba58c9 req-5098f7e6-6c7c-4a89-866e-a296ed474fa6 service nova] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Received event network-vif-plugged-49a60955-c322-46d8-910d-31d4302f9f27 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-25427795-7412-4232-bbca-f9e90fba58c9 req-5098f7e6-6c7c-4a89-866e-a296ed474fa6 service nova] Acquiring lock "e637a0d4-d38e-46e0-8fde-3b45c2410439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-25427795-7412-4232-bbca-f9e90fba58c9 req-5098f7e6-6c7c-4a89-866e-a296ed474fa6 service nova] Lock "e637a0d4-d38e-46e0-8fde-3b45c2410439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-25427795-7412-4232-bbca-f9e90fba58c9 req-5098f7e6-6c7c-4a89-866e-a296ed474fa6 service nova] Lock "e637a0d4-d38e-46e0-8fde-3b45c2410439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:02 user nova-compute[70243]: DEBUG nova.compute.manager [req-25427795-7412-4232-bbca-f9e90fba58c9 req-5098f7e6-6c7c-4a89-866e-a296ed474fa6 service nova] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] No waiting events found dispatching network-vif-plugged-49a60955-c322-46d8-910d-31d4302f9f27 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:18:02 user nova-compute[70243]: WARNING nova.compute.manager [req-25427795-7412-4232-bbca-f9e90fba58c9 req-5098f7e6-6c7c-4a89-866e-a296ed474fa6 service nova] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Received unexpected event network-vif-plugged-49a60955-c322-46d8-910d-31d4302f9f27 for instance with vm_state building and task_state spawning.
Jul 24 16:18:02 user nova-compute[70243]: DEBUG nova.network.neutron [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:18:03 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215483.0679865, e637a0d4-d38e-46e0-8fde-3b45c2410439 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:18:03 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] VM Resumed (Lifecycle Event)
Jul 24 16:18:03 user nova-compute[70243]: DEBUG nova.compute.manager [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:18:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:18:03 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Instance spawned successfully.
Jul 24 16:18:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:18:03 user nova-compute[70243]: DEBUG nova.network.neutron [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Successfully updated port: ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:18:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "refresh_cache-ad611655-ba4d-4a66-b78e-a82c058f4414" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:18:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquired lock "refresh_cache-ad611655-ba4d-4a66-b78e-a82c058f4414" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:18:03 user nova-compute[70243]: DEBUG nova.network.neutron [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:18:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:03 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:03 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:18:03 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:18:03 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215483.0720828, e637a0d4-d38e-46e0-8fde-3b45c2410439 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:18:03 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] VM Started (Lifecycle Event)
Jul 24 16:18:03 user nova-compute[70243]: INFO nova.compute.manager [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Took 14.14 seconds to spawn the instance on the hypervisor.
Jul 24 16:18:03 user nova-compute[70243]: DEBUG nova.compute.manager [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:03 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:03 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:18:03 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:18:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:03 user nova-compute[70243]: INFO nova.compute.manager [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Took 15.05 seconds to build instance.
Jul 24 16:18:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4db42658-27ca-4417-a603-8540cd2c0203 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "e637a0d4-d38e-46e0-8fde-3b45c2410439" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.262s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:03 user nova-compute[70243]: DEBUG nova.network.neutron [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:18:03 user nova-compute[70243]: DEBUG nova.compute.manager [req-85173eb5-270b-4ee8-a778-b6d2966f54c1 req-25d99c67-69c7-422d-a244-1e64ddf77153 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received event network-changed-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:03 user nova-compute[70243]: DEBUG nova.compute.manager [req-85173eb5-270b-4ee8-a778-b6d2966f54c1 req-25d99c67-69c7-422d-a244-1e64ddf77153 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Refreshing instance network info cache due to event network-changed-ef8e7d11-464b-421b-bfc9-0d5a17f610d4. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:18:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-85173eb5-270b-4ee8-a778-b6d2966f54c1 req-25d99c67-69c7-422d-a244-1e64ddf77153 service nova] Acquiring lock "refresh_cache-ad611655-ba4d-4a66-b78e-a82c058f4414" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:18:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.network.neutron [req-457aa9f6-123c-4817-b678-80915d8eae14 req-b33f514b-908a-48c8-9b5e-cf046cf94d0c service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Updated VIF entry in instance network info cache for port e3519574-a5e5-48f3-9e0c-852d0e9e3505. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.network.neutron [req-457aa9f6-123c-4817-b678-80915d8eae14 req-b33f514b-908a-48c8-9b5e-cf046cf94d0c service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Updating instance_info_cache with network_info: [{"id": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "address": "fa:16:3e:8b:ac:95", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3519574-a5", "ovs_interfaceid": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-457aa9f6-123c-4817-b678-80915d8eae14 req-b33f514b-908a-48c8-9b5e-cf046cf94d0c service nova] Releasing lock "refresh_cache-de484cb2-7f20-4bf1-927b-c066735bfeca" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.network.neutron [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Updating instance_info_cache with network_info: [{"id": "e709e269-eff5-4ac2-8c2a-29048448a422", "address": "fa:16:3e:0a:84:99", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape709e269-ef", "ovs_interfaceid": "e709e269-eff5-4ac2-8c2a-29048448a422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Releasing lock "refresh_cache-de22ea98-b041-4f3f-8986-435c43267a2e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Instance network_info: |[{"id": "e709e269-eff5-4ac2-8c2a-29048448a422", "address": "fa:16:3e:0a:84:99", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape709e269-ef", "ovs_interfaceid": "e709e269-eff5-4ac2-8c2a-29048448a422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Start _get_guest_xml network_info=[{"id": "e709e269-eff5-4ac2-8c2a-29048448a422", "address": "fa:16:3e:0a:84:99", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape709e269-ef", "ovs_interfaceid": "e709e269-eff5-4ac2-8c2a-29048448a422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:18:04 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:18:04 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-318401571',display_name='tempest-ServerActionsTestOtherA-server-318401571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-318401571',id=2,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNt4ywOtyDbY3gzVxioiadq0RHvp3ujVzU7+egeM9QHVtvP6DGqg4hSRwxq8r4OyAFnfBqKPWEeStDLSLwfjx+5dISRxZesWLAiccd5P+5WMBwka91+aa63O7dxU+RVwA==',key_name='tempest-keypair-283031417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebdb3cb079814db091227f80b2ed1b9d',ramdisk_id='',reservation_id='r-fjhaudds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-39125821',owner_user_name='tempest-ServerActionsTestOtherA-39125821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:17:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa3936255d31421184e585e2fd17d7ef',uuid=de22ea98-b041-4f3f-8986-435c43267a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e709e269-eff5-4ac2-8c2a-29048448a422", "address": "fa:16:3e:0a:84:99", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape709e269-ef", "ovs_interfaceid": "e709e269-eff5-4ac2-8c2a-29048448a422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converting VIF {"id": "e709e269-eff5-4ac2-8c2a-29048448a422", "address": "fa:16:3e:0a:84:99", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape709e269-ef", "ovs_interfaceid": "e709e269-eff5-4ac2-8c2a-29048448a422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:84:99,bridge_name='br-int',has_traffic_filtering=True,id=e709e269-eff5-4ac2-8c2a-29048448a422,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape709e269-ef') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.objects.instance [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lazy-loading 'pci_devices' on Instance uuid de22ea98-b041-4f3f-8986-435c43267a2e {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:18:04 user nova-compute[70243]:   <uuid>de22ea98-b041-4f3f-8986-435c43267a2e</uuid>
Jul 24 16:18:04 user nova-compute[70243]:   <name>instance-00000002</name>
Jul 24 16:18:04 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:18:04 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:18:04 user nova-compute[70243]:   <metadata>
Jul 24 16:18:04 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:18:04 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:18:04 user nova-compute[70243]:       <nova:name>tempest-ServerActionsTestOtherA-server-318401571</nova:name>
Jul 24 16:18:04 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:18:04</nova:creationTime>
Jul 24 16:18:04 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:18:04 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:18:04 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:18:04 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:18:04 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:18:04 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:18:04 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:18:04 user nova-compute[70243]:       <nova:owner>
Jul 24 16:18:04 user nova-compute[70243]:         <nova:user uuid="aa3936255d31421184e585e2fd17d7ef">tempest-ServerActionsTestOtherA-39125821-project-member</nova:user>
Jul 24 16:18:04 user nova-compute[70243]:         <nova:project uuid="ebdb3cb079814db091227f80b2ed1b9d">tempest-ServerActionsTestOtherA-39125821</nova:project>
Jul 24 16:18:04 user nova-compute[70243]:       </nova:owner>
Jul 24 16:18:04 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:18:04 user nova-compute[70243]:       <nova:ports>
Jul 24 16:18:04 user nova-compute[70243]:         <nova:port uuid="e709e269-eff5-4ac2-8c2a-29048448a422">
Jul 24 16:18:04 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 24 16:18:04 user nova-compute[70243]:         </nova:port>
Jul 24 16:18:04 user nova-compute[70243]:       </nova:ports>
Jul 24 16:18:04 user nova-compute[70243]:     </nova:instance>
Jul 24 16:18:04 user nova-compute[70243]:   </metadata>
Jul 24 16:18:04 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:18:04 user nova-compute[70243]:     <system>
Jul 24 16:18:04 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:18:04 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:18:04 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:18:04 user nova-compute[70243]:       <entry name="serial">de22ea98-b041-4f3f-8986-435c43267a2e</entry>
Jul 24 16:18:04 user nova-compute[70243]:       <entry name="uuid">de22ea98-b041-4f3f-8986-435c43267a2e</entry>
Jul 24 16:18:04 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:18:04 user nova-compute[70243]:     </system>
Jul 24 16:18:04 user nova-compute[70243]:   </sysinfo>
Jul 24 16:18:04 user nova-compute[70243]:   <os>
Jul 24 16:18:04 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:18:04 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:18:04 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:18:04 user nova-compute[70243]:   </os>
Jul 24 16:18:04 user nova-compute[70243]:   <features>
Jul 24 16:18:04 user nova-compute[70243]:     <acpi/>
Jul 24 16:18:04 user nova-compute[70243]:     <apic/>
Jul 24 16:18:04 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:18:04 user nova-compute[70243]:   </features>
Jul 24 16:18:04 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:18:04 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:18:04 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:18:04 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:18:04 user nova-compute[70243]:   </clock>
Jul 24 16:18:04 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:18:04 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:18:04 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:18:04 user nova-compute[70243]:   </cpu>
Jul 24 16:18:04 user nova-compute[70243]:   <devices>
Jul 24 16:18:04 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:18:04 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:18:04 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk"/>
Jul 24 16:18:04 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:18:04 user nova-compute[70243]:     </disk>
Jul 24 16:18:04 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:18:04 user nova-compute[70243]:       <mac address="fa:16:3e:0a:84:99"/>
Jul 24 16:18:04 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:18:04 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:18:04 user nova-compute[70243]:       <target dev="tape709e269-ef"/>
Jul 24 16:18:04 user nova-compute[70243]:     </interface>
Jul 24 16:18:04 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:18:04 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/console.log" append="off"/>
Jul 24 16:18:04 user nova-compute[70243]:     </serial>
Jul 24 16:18:04 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:18:04 user nova-compute[70243]:     <video>
Jul 24 16:18:04 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:18:04 user nova-compute[70243]:     </video>
Jul 24 16:18:04 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:18:04 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:18:04 user nova-compute[70243]:     </rng>
Jul 24 16:18:04 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:18:04 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:18:04 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:18:04 user nova-compute[70243]:     </memballoon>
Jul 24 16:18:04 user nova-compute[70243]:   </devices>
Jul 24 16:18:04 user nova-compute[70243]: </domain>
Jul 24 16:18:04 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-318401571',display_name='tempest-ServerActionsTestOtherA-server-318401571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-318401571',id=2,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNt4ywOtyDbY3gzVxioiadq0RHvp3ujVzU7+egeM9QHVtvP6DGqg4hSRwxq8r4OyAFnfBqKPWEeStDLSLwfjx+5dISRxZesWLAiccd5P+5WMBwka91+aa63O7dxU+RVwA==',key_name='tempest-keypair-283031417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebdb3cb079814db091227f80b2ed1b9d',ramdisk_id='',reservation_id='r-fjhaudds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-39125821',owner_user_name='tempest-ServerActionsTestOtherA-39125821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:17:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa3936255d31421184e585e2fd17d7ef',uuid=de22ea98-b041-4f3f-8986-435c43267a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e709e269-eff5-4ac2-8c2a-29048448a422", "address": "fa:16:3e:0a:84:99", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape709e269-ef", "ovs_interfaceid": "e709e269-eff5-4ac2-8c2a-29048448a422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converting VIF {"id": "e709e269-eff5-4ac2-8c2a-29048448a422", "address": "fa:16:3e:0a:84:99", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape709e269-ef", "ovs_interfaceid": "e709e269-eff5-4ac2-8c2a-29048448a422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:84:99,bridge_name='br-int',has_traffic_filtering=True,id=e709e269-eff5-4ac2-8c2a-29048448a422,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape709e269-ef') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG os_vif [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:84:99,bridge_name='br-int',has_traffic_filtering=True,id=e709e269-eff5-4ac2-8c2a-29048448a422,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape709e269-ef') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.network.neutron [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Successfully updated port: 2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape709e269-ef, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape709e269-ef, col_values=(('external_ids', {'iface-id': 'e709e269-eff5-4ac2-8c2a-29048448a422', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:84:99', 'vm-uuid': 'de22ea98-b041-4f3f-8986-435c43267a2e'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquiring lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquired lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.network.neutron [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:04 user nova-compute[70243]: INFO os_vif [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:84:99,bridge_name='br-int',has_traffic_filtering=True,id=e709e269-eff5-4ac2-8c2a-29048448a422,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape709e269-ef')
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] No VIF found with MAC fa:16:3e:0a:84:99, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.network.neutron [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Updating instance_info_cache with network_info: [{"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Releasing lock "refresh_cache-ad611655-ba4d-4a66-b78e-a82c058f4414" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Instance network_info: |[{"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-85173eb5-270b-4ee8-a778-b6d2966f54c1 req-25d99c67-69c7-422d-a244-1e64ddf77153 service nova] Acquired lock "refresh_cache-ad611655-ba4d-4a66-b78e-a82c058f4414" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.network.neutron [req-85173eb5-270b-4ee8-a778-b6d2966f54c1 req-25d99c67-69c7-422d-a244-1e64ddf77153 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Refreshing network info cache for port ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Start _get_guest_xml network_info=[{"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.network.neutron [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:18:04 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:18:04 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.compute.manager [req-aa7c9eb1-6604-4046-a824-04edf31d5bf0 req-80af3ca9-5ad1-45a7-807d-a4c41e573697 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Received event network-changed-e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.compute.manager [req-aa7c9eb1-6604-4046-a824-04edf31d5bf0 req-80af3ca9-5ad1-45a7-807d-a4c41e573697 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Refreshing instance network info cache due to event network-changed-e709e269-eff5-4ac2-8c2a-29048448a422. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-aa7c9eb1-6604-4046-a824-04edf31d5bf0 req-80af3ca9-5ad1-45a7-807d-a4c41e573697 service nova] Acquiring lock "refresh_cache-de22ea98-b041-4f3f-8986-435c43267a2e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-aa7c9eb1-6604-4046-a824-04edf31d5bf0 req-80af3ca9-5ad1-45a7-807d-a4c41e573697 service nova] Acquired lock "refresh_cache-de22ea98-b041-4f3f-8986-435c43267a2e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.network.neutron [req-aa7c9eb1-6604-4046-a824-04edf31d5bf0 req-80af3ca9-5ad1-45a7-807d-a4c41e573697 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Refreshing network info cache for port e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1592531500',display_name='tempest-AttachVolumeTestJSON-server-1592531500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1592531500',id=5,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyqJB6onbLaD2r1QfVtdarKDSnujLrUpKPczrv1sRKzUEbnqnXysxM1e2pVM0BKjCFI6X1To86Tx81MPL8yxdaUKlyWRVQ/8A7Y/aJ/EGuRxG0ZYo3tQwvjAcenmDrEEg==',key_name='tempest-keypair-810229109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d099632b940545b9bbe000e5cc323ec1',ramdisk_id='',reservation_id='r-6lakmpdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1836925262',owner_user_name='tempest-AttachVolumeTestJSON-1836925262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7de0cd9dd23d4569939884728bde772c',uuid=ad611655-ba4d-4a66-b78e-a82c058f4414,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converting VIF {"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d8:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef8e7d11-464b-421b-bfc9-0d5a17f610d4,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8e7d11-46') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.objects.instance [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'pci_devices' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:18:04 user nova-compute[70243]:   <uuid>ad611655-ba4d-4a66-b78e-a82c058f4414</uuid>
Jul 24 16:18:04 user nova-compute[70243]:   <name>instance-00000005</name>
Jul 24 16:18:04 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:18:04 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:18:04 user nova-compute[70243]:   <metadata>
Jul 24 16:18:04 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:18:04 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:18:04 user nova-compute[70243]:       <nova:name>tempest-AttachVolumeTestJSON-server-1592531500</nova:name>
Jul 24 16:18:04 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:18:04</nova:creationTime>
Jul 24 16:18:04 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:18:04 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:18:04 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:18:04 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:18:04 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:18:04 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:18:04 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:18:04 user nova-compute[70243]:       <nova:owner>
Jul 24 16:18:04 user nova-compute[70243]:         <nova:user uuid="7de0cd9dd23d4569939884728bde772c">tempest-AttachVolumeTestJSON-1836925262-project-member</nova:user>
Jul 24 16:18:04 user nova-compute[70243]:         <nova:project uuid="d099632b940545b9bbe000e5cc323ec1">tempest-AttachVolumeTestJSON-1836925262</nova:project>
Jul 24 16:18:04 user nova-compute[70243]:       </nova:owner>
Jul 24 16:18:04 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:18:04 user nova-compute[70243]:       <nova:ports>
Jul 24 16:18:04 user nova-compute[70243]:         <nova:port uuid="ef8e7d11-464b-421b-bfc9-0d5a17f610d4">
Jul 24 16:18:04 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 24 16:18:04 user nova-compute[70243]:         </nova:port>
Jul 24 16:18:04 user nova-compute[70243]:       </nova:ports>
Jul 24 16:18:04 user nova-compute[70243]:     </nova:instance>
Jul 24 16:18:04 user nova-compute[70243]:   </metadata>
Jul 24 16:18:04 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:18:04 user nova-compute[70243]:     <system>
Jul 24 16:18:04 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:18:04 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:18:04 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:18:04 user nova-compute[70243]:       <entry name="serial">ad611655-ba4d-4a66-b78e-a82c058f4414</entry>
Jul 24 16:18:04 user nova-compute[70243]:       <entry name="uuid">ad611655-ba4d-4a66-b78e-a82c058f4414</entry>
Jul 24 16:18:04 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:18:04 user nova-compute[70243]:     </system>
Jul 24 16:18:04 user nova-compute[70243]:   </sysinfo>
Jul 24 16:18:04 user nova-compute[70243]:   <os>
Jul 24 16:18:04 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:18:04 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:18:04 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:18:04 user nova-compute[70243]:   </os>
Jul 24 16:18:04 user nova-compute[70243]:   <features>
Jul 24 16:18:04 user nova-compute[70243]:     <acpi/>
Jul 24 16:18:04 user nova-compute[70243]:     <apic/>
Jul 24 16:18:04 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:18:04 user nova-compute[70243]:   </features>
Jul 24 16:18:04 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:18:04 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:18:04 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:18:04 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:18:04 user nova-compute[70243]:   </clock>
Jul 24 16:18:04 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:18:04 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:18:04 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:18:04 user nova-compute[70243]:   </cpu>
Jul 24 16:18:04 user nova-compute[70243]:   <devices>
Jul 24 16:18:04 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:18:04 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:18:04 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk"/>
Jul 24 16:18:04 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:18:04 user nova-compute[70243]:     </disk>
Jul 24 16:18:04 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:18:04 user nova-compute[70243]:       <mac address="fa:16:3e:0e:d8:8a"/>
Jul 24 16:18:04 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:18:04 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:18:04 user nova-compute[70243]:       <target dev="tapef8e7d11-46"/>
Jul 24 16:18:04 user nova-compute[70243]:     </interface>
Jul 24 16:18:04 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:18:04 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/console.log" append="off"/>
Jul 24 16:18:04 user nova-compute[70243]:     </serial>
Jul 24 16:18:04 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:18:04 user nova-compute[70243]:     <video>
Jul 24 16:18:04 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:18:04 user nova-compute[70243]:     </video>
Jul 24 16:18:04 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:18:04 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:18:04 user nova-compute[70243]:     </rng>
Jul 24 16:18:04 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:18:04 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:18:04 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:18:04 user nova-compute[70243]:     </memballoon>
Jul 24 16:18:04 user nova-compute[70243]:   </devices>
Jul 24 16:18:04 user nova-compute[70243]: </domain>
Jul 24 16:18:04 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1592531500',display_name='tempest-AttachVolumeTestJSON-server-1592531500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1592531500',id=5,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyqJB6onbLaD2r1QfVtdarKDSnujLrUpKPczrv1sRKzUEbnqnXysxM1e2pVM0BKjCFI6X1To86Tx81MPL8yxdaUKlyWRVQ/8A7Y/aJ/EGuRxG0ZYo3tQwvjAcenmDrEEg==',key_name='tempest-keypair-810229109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d099632b940545b9bbe000e5cc323ec1',ramdisk_id='',reservation_id='r-6lakmpdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1836925262',owner_user_name='tempest-AttachVolumeTestJSON-1836925262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7de0cd9dd23d4569939884728bde772c',uuid=ad611655-ba4d-4a66-b78e-a82c058f4414,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converting VIF {"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d8:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef8e7d11-464b-421b-bfc9-0d5a17f610d4,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8e7d11-46') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG os_vif [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d8:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef8e7d11-464b-421b-bfc9-0d5a17f610d4,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8e7d11-46') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef8e7d11-46, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef8e7d11-46, col_values=(('external_ids', {'iface-id': 'ef8e7d11-464b-421b-bfc9-0d5a17f610d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:d8:8a', 'vm-uuid': 'ad611655-ba4d-4a66-b78e-a82c058f4414'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:04 user nova-compute[70243]: INFO os_vif [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d8:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef8e7d11-464b-421b-bfc9-0d5a17f610d4,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8e7d11-46')
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:18:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] No VIF found with MAC fa:16:3e:0e:d8:8a, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:18:05 user nova-compute[70243]: DEBUG nova.network.neutron [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Successfully created port: 66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:18:05 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215485.9505968, de484cb2-7f20-4bf1-927b-c066735bfeca => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:18:05 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] VM Resumed (Lifecycle Event)
Jul 24 16:18:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:05 user nova-compute[70243]: DEBUG nova.compute.manager [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:18:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:18:05 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Instance spawned successfully.
Jul 24 16:18:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:18:05 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:05 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:06 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215485.9661965, de484cb2-7f20-4bf1-927b-c066735bfeca => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:18:06 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] VM Started (Lifecycle Event)
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:18:06 user nova-compute[70243]: INFO nova.compute.manager [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Took 9.58 seconds to spawn the instance on the hypervisor.
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.compute.manager [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:06 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.network.neutron [req-85173eb5-270b-4ee8-a778-b6d2966f54c1 req-25d99c67-69c7-422d-a244-1e64ddf77153 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Updated VIF entry in instance network info cache for port ef8e7d11-464b-421b-bfc9-0d5a17f610d4. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.network.neutron [req-85173eb5-270b-4ee8-a778-b6d2966f54c1 req-25d99c67-69c7-422d-a244-1e64ddf77153 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Updating instance_info_cache with network_info: [{"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.network.neutron [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Updating instance_info_cache with network_info: [{"id": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "address": "fa:16:3e:92:8d:42", "network": {"id": "69c0285e-5c28-41c5-893d-9d92e9626cb2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808448879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c70a6d9bf46466da48267f2fc2e02d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2943f763-29", "ovs_interfaceid": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-85173eb5-270b-4ee8-a778-b6d2966f54c1 req-25d99c67-69c7-422d-a244-1e64ddf77153 service nova] Releasing lock "refresh_cache-ad611655-ba4d-4a66-b78e-a82c058f4414" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Releasing lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.compute.manager [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Instance network_info: |[{"id": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "address": "fa:16:3e:92:8d:42", "network": {"id": "69c0285e-5c28-41c5-893d-9d92e9626cb2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808448879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c70a6d9bf46466da48267f2fc2e02d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2943f763-29", "ovs_interfaceid": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Start _get_guest_xml network_info=[{"id": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "address": "fa:16:3e:92:8d:42", "network": {"id": "69c0285e-5c28-41c5-893d-9d92e9626cb2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808448879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c70a6d9bf46466da48267f2fc2e02d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2943f763-29", "ovs_interfaceid": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:18:06 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:18:06 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2052048387',display_name='tempest-ServerStableDeviceRescueTest-server-2052048387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2052048387',id=4,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxyg7GKQZgiFcqgBrRCAKYhBgpz6QF7p7ruGhqH37zaYL25ozkQKcEfngpDlxwde/ZCtd+vcFLzRscQnyUxcajhFeR/MGJHm2Mv330WuzoMeAS6WZFsRGOHNqib8c36Bw==',key_name='tempest-keypair-258761738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c70a6d9bf46466da48267f2fc2e02d6',ramdisk_id='',reservation_id='r-yozkpi2d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1068915189',owner_user_name='tempest-ServerStableDeviceRescueTest-1068915189-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:17:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afda4138db34a6c95e974a5814ea26a',uuid=a13c243a-2b98-4ef1-b17c-e2e15ba005fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "address": "fa:16:3e:92:8d:42", "network": {"id": "69c0285e-5c28-41c5-893d-9d92e9626cb2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808448879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c70a6d9bf46466da48267f2fc2e02d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2943f763-29", "ovs_interfaceid": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Converting VIF {"id": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "address": "fa:16:3e:92:8d:42", "network": {"id": "69c0285e-5c28-41c5-893d-9d92e9626cb2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808448879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c70a6d9bf46466da48267f2fc2e02d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2943f763-29", "ovs_interfaceid": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8d:42,bridge_name='br-int',has_traffic_filtering=True,id=2943f763-290c-46a8-90cf-f0e6b59a2be4,network=Network(69c0285e-5c28-41c5-893d-9d92e9626cb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2943f763-29') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.objects.instance [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lazy-loading 'pci_devices' on Instance uuid a13c243a-2b98-4ef1-b17c-e2e15ba005fd {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:18:06 user nova-compute[70243]: INFO nova.compute.manager [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Took 10.63 seconds to build instance.
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:18:06 user nova-compute[70243]:   <uuid>a13c243a-2b98-4ef1-b17c-e2e15ba005fd</uuid>
Jul 24 16:18:06 user nova-compute[70243]:   <name>instance-00000004</name>
Jul 24 16:18:06 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:18:06 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:18:06 user nova-compute[70243]:   <metadata>
Jul 24 16:18:06 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:18:06 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:18:06 user nova-compute[70243]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2052048387</nova:name>
Jul 24 16:18:06 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:18:06</nova:creationTime>
Jul 24 16:18:06 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:18:06 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:18:06 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:18:06 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:18:06 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:18:06 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:18:06 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:18:06 user nova-compute[70243]:       <nova:owner>
Jul 24 16:18:06 user nova-compute[70243]:         <nova:user uuid="5afda4138db34a6c95e974a5814ea26a">tempest-ServerStableDeviceRescueTest-1068915189-project-member</nova:user>
Jul 24 16:18:06 user nova-compute[70243]:         <nova:project uuid="5c70a6d9bf46466da48267f2fc2e02d6">tempest-ServerStableDeviceRescueTest-1068915189</nova:project>
Jul 24 16:18:06 user nova-compute[70243]:       </nova:owner>
Jul 24 16:18:06 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:18:06 user nova-compute[70243]:       <nova:ports>
Jul 24 16:18:06 user nova-compute[70243]:         <nova:port uuid="2943f763-290c-46a8-90cf-f0e6b59a2be4">
Jul 24 16:18:06 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 24 16:18:06 user nova-compute[70243]:         </nova:port>
Jul 24 16:18:06 user nova-compute[70243]:       </nova:ports>
Jul 24 16:18:06 user nova-compute[70243]:     </nova:instance>
Jul 24 16:18:06 user nova-compute[70243]:   </metadata>
Jul 24 16:18:06 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:18:06 user nova-compute[70243]:     <system>
Jul 24 16:18:06 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:18:06 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:18:06 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:18:06 user nova-compute[70243]:       <entry name="serial">a13c243a-2b98-4ef1-b17c-e2e15ba005fd</entry>
Jul 24 16:18:06 user nova-compute[70243]:       <entry name="uuid">a13c243a-2b98-4ef1-b17c-e2e15ba005fd</entry>
Jul 24 16:18:06 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:18:06 user nova-compute[70243]:     </system>
Jul 24 16:18:06 user nova-compute[70243]:   </sysinfo>
Jul 24 16:18:06 user nova-compute[70243]:   <os>
Jul 24 16:18:06 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:18:06 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:18:06 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:18:06 user nova-compute[70243]:   </os>
Jul 24 16:18:06 user nova-compute[70243]:   <features>
Jul 24 16:18:06 user nova-compute[70243]:     <acpi/>
Jul 24 16:18:06 user nova-compute[70243]:     <apic/>
Jul 24 16:18:06 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:18:06 user nova-compute[70243]:   </features>
Jul 24 16:18:06 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:18:06 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:18:06 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:18:06 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:18:06 user nova-compute[70243]:   </clock>
Jul 24 16:18:06 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:18:06 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:18:06 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:18:06 user nova-compute[70243]:   </cpu>
Jul 24 16:18:06 user nova-compute[70243]:   <devices>
Jul 24 16:18:06 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:18:06 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:18:06 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk"/>
Jul 24 16:18:06 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:18:06 user nova-compute[70243]:     </disk>
Jul 24 16:18:06 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:18:06 user nova-compute[70243]:       <mac address="fa:16:3e:92:8d:42"/>
Jul 24 16:18:06 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:18:06 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:18:06 user nova-compute[70243]:       <target dev="tap2943f763-29"/>
Jul 24 16:18:06 user nova-compute[70243]:     </interface>
Jul 24 16:18:06 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:18:06 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/console.log" append="off"/>
Jul 24 16:18:06 user nova-compute[70243]:     </serial>
Jul 24 16:18:06 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:18:06 user nova-compute[70243]:     <video>
Jul 24 16:18:06 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:18:06 user nova-compute[70243]:     </video>
Jul 24 16:18:06 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:18:06 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:18:06 user nova-compute[70243]:     </rng>
Jul 24 16:18:06 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:18:06 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:18:06 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:18:06 user nova-compute[70243]:     </memballoon>
Jul 24 16:18:06 user nova-compute[70243]:   </devices>
Jul 24 16:18:06 user nova-compute[70243]: </domain>
Jul 24 16:18:06 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2052048387',display_name='tempest-ServerStableDeviceRescueTest-server-2052048387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2052048387',id=4,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxyg7GKQZgiFcqgBrRCAKYhBgpz6QF7p7ruGhqH37zaYL25ozkQKcEfngpDlxwde/ZCtd+vcFLzRscQnyUxcajhFeR/MGJHm2Mv330WuzoMeAS6WZFsRGOHNqib8c36Bw==',key_name='tempest-keypair-258761738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c70a6d9bf46466da48267f2fc2e02d6',ramdisk_id='',reservation_id='r-yozkpi2d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1068915189',owner_user_name='tempest-ServerStableDeviceRescueTest-1068915189-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:17:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afda4138db34a6c95e974a5814ea26a',uuid=a13c243a-2b98-4ef1-b17c-e2e15ba005fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "address": "fa:16:3e:92:8d:42", "network": {"id": "69c0285e-5c28-41c5-893d-9d92e9626cb2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808448879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c70a6d9bf46466da48267f2fc2e02d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2943f763-29", "ovs_interfaceid": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Converting VIF {"id": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "address": "fa:16:3e:92:8d:42", "network": {"id": "69c0285e-5c28-41c5-893d-9d92e9626cb2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808448879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c70a6d9bf46466da48267f2fc2e02d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2943f763-29", "ovs_interfaceid": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8d:42,bridge_name='br-int',has_traffic_filtering=True,id=2943f763-290c-46a8-90cf-f0e6b59a2be4,network=Network(69c0285e-5c28-41c5-893d-9d92e9626cb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2943f763-29') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG os_vif [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8d:42,bridge_name='br-int',has_traffic_filtering=True,id=2943f763-290c-46a8-90cf-f0e6b59a2be4,network=Network(69c0285e-5c28-41c5-893d-9d92e9626cb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2943f763-29') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2943f763-29, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2943f763-29, col_values=(('external_ids', {'iface-id': '2943f763-290c-46a8-90cf-f0e6b59a2be4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:8d:42', 'vm-uuid': 'a13c243a-2b98-4ef1-b17c-e2e15ba005fd'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-35ed813b-de6c-4cfe-a622-b68befdfccd4 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "de484cb2-7f20-4bf1-927b-c066735bfeca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.768s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:06 user nova-compute[70243]: INFO os_vif [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8d:42,bridge_name='br-int',has_traffic_filtering=True,id=2943f763-290c-46a8-90cf-f0e6b59a2be4,network=Network(69c0285e-5c28-41c5-893d-9d92e9626cb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2943f763-29')
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] No VIF found with MAC fa:16:3e:92:8d:42, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.network.neutron [req-aa7c9eb1-6604-4046-a824-04edf31d5bf0 req-80af3ca9-5ad1-45a7-807d-a4c41e573697 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Updated VIF entry in instance network info cache for port e709e269-eff5-4ac2-8c2a-29048448a422. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.network.neutron [req-aa7c9eb1-6604-4046-a824-04edf31d5bf0 req-80af3ca9-5ad1-45a7-807d-a4c41e573697 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Updating instance_info_cache with network_info: [{"id": "e709e269-eff5-4ac2-8c2a-29048448a422", "address": "fa:16:3e:0a:84:99", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape709e269-ef", "ovs_interfaceid": "e709e269-eff5-4ac2-8c2a-29048448a422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-aa7c9eb1-6604-4046-a824-04edf31d5bf0 req-80af3ca9-5ad1-45a7-807d-a4c41e573697 service nova] Releasing lock "refresh_cache-de22ea98-b041-4f3f-8986-435c43267a2e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.compute.manager [req-aa7c9eb1-6604-4046-a824-04edf31d5bf0 req-80af3ca9-5ad1-45a7-807d-a4c41e573697 service nova] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Received event network-vif-plugged-49a60955-c322-46d8-910d-31d4302f9f27 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-aa7c9eb1-6604-4046-a824-04edf31d5bf0 req-80af3ca9-5ad1-45a7-807d-a4c41e573697 service nova] Acquiring lock "e637a0d4-d38e-46e0-8fde-3b45c2410439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-aa7c9eb1-6604-4046-a824-04edf31d5bf0 req-80af3ca9-5ad1-45a7-807d-a4c41e573697 service nova] Lock "e637a0d4-d38e-46e0-8fde-3b45c2410439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-aa7c9eb1-6604-4046-a824-04edf31d5bf0 req-80af3ca9-5ad1-45a7-807d-a4c41e573697 service nova] Lock "e637a0d4-d38e-46e0-8fde-3b45c2410439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.compute.manager [req-aa7c9eb1-6604-4046-a824-04edf31d5bf0 req-80af3ca9-5ad1-45a7-807d-a4c41e573697 service nova] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] No waiting events found dispatching network-vif-plugged-49a60955-c322-46d8-910d-31d4302f9f27 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:18:06 user nova-compute[70243]: WARNING nova.compute.manager [req-aa7c9eb1-6604-4046-a824-04edf31d5bf0 req-80af3ca9-5ad1-45a7-807d-a4c41e573697 service nova] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Received unexpected event network-vif-plugged-49a60955-c322-46d8-910d-31d4302f9f27 for instance with vm_state active and task_state None.
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.compute.manager [req-aa7c9eb1-6604-4046-a824-04edf31d5bf0 req-80af3ca9-5ad1-45a7-807d-a4c41e573697 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received event network-changed-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.compute.manager [req-aa7c9eb1-6604-4046-a824-04edf31d5bf0 req-80af3ca9-5ad1-45a7-807d-a4c41e573697 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Refreshing instance network info cache due to event network-changed-2943f763-290c-46a8-90cf-f0e6b59a2be4. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-aa7c9eb1-6604-4046-a824-04edf31d5bf0 req-80af3ca9-5ad1-45a7-807d-a4c41e573697 service nova] Acquiring lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-aa7c9eb1-6604-4046-a824-04edf31d5bf0 req-80af3ca9-5ad1-45a7-807d-a4c41e573697 service nova] Acquired lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.network.neutron [req-aa7c9eb1-6604-4046-a824-04edf31d5bf0 req-80af3ca9-5ad1-45a7-807d-a4c41e573697 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Refreshing network info cache for port 2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.compute.manager [req-0f4793f6-fd14-4214-9193-5c295f712284 req-f9a95edf-e10f-46f5-a3c5-2bf51768b935 service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Received event network-vif-plugged-e3519574-a5e5-48f3-9e0c-852d0e9e3505 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0f4793f6-fd14-4214-9193-5c295f712284 req-f9a95edf-e10f-46f5-a3c5-2bf51768b935 service nova] Acquiring lock "de484cb2-7f20-4bf1-927b-c066735bfeca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0f4793f6-fd14-4214-9193-5c295f712284 req-f9a95edf-e10f-46f5-a3c5-2bf51768b935 service nova] Lock "de484cb2-7f20-4bf1-927b-c066735bfeca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0f4793f6-fd14-4214-9193-5c295f712284 req-f9a95edf-e10f-46f5-a3c5-2bf51768b935 service nova] Lock "de484cb2-7f20-4bf1-927b-c066735bfeca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:06 user nova-compute[70243]: DEBUG nova.compute.manager [req-0f4793f6-fd14-4214-9193-5c295f712284 req-f9a95edf-e10f-46f5-a3c5-2bf51768b935 service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] No waiting events found dispatching network-vif-plugged-e3519574-a5e5-48f3-9e0c-852d0e9e3505 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:18:06 user nova-compute[70243]: WARNING nova.compute.manager [req-0f4793f6-fd14-4214-9193-5c295f712284 req-f9a95edf-e10f-46f5-a3c5-2bf51768b935 service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Received unexpected event network-vif-plugged-e3519574-a5e5-48f3-9e0c-852d0e9e3505 for instance with vm_state active and task_state None.
Jul 24 16:18:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG nova.network.neutron [req-aa7c9eb1-6604-4046-a824-04edf31d5bf0 req-80af3ca9-5ad1-45a7-807d-a4c41e573697 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Updated VIF entry in instance network info cache for port 2943f763-290c-46a8-90cf-f0e6b59a2be4. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG nova.network.neutron [req-aa7c9eb1-6604-4046-a824-04edf31d5bf0 req-80af3ca9-5ad1-45a7-807d-a4c41e573697 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Updating instance_info_cache with network_info: [{"id": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "address": "fa:16:3e:92:8d:42", "network": {"id": "69c0285e-5c28-41c5-893d-9d92e9626cb2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808448879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c70a6d9bf46466da48267f2fc2e02d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2943f763-29", "ovs_interfaceid": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-aa7c9eb1-6604-4046-a824-04edf31d5bf0 req-80af3ca9-5ad1-45a7-807d-a4c41e573697 service nova] Releasing lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG nova.compute.manager [req-59d2c537-06d3-4c43-ac99-0b17462d3173 req-4a91899e-1430-4d87-bff3-77ac125e8797 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Received event network-vif-plugged-e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-59d2c537-06d3-4c43-ac99-0b17462d3173 req-4a91899e-1430-4d87-bff3-77ac125e8797 service nova] Acquiring lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-59d2c537-06d3-4c43-ac99-0b17462d3173 req-4a91899e-1430-4d87-bff3-77ac125e8797 service nova] Lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-59d2c537-06d3-4c43-ac99-0b17462d3173 req-4a91899e-1430-4d87-bff3-77ac125e8797 service nova] Lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG nova.compute.manager [req-59d2c537-06d3-4c43-ac99-0b17462d3173 req-4a91899e-1430-4d87-bff3-77ac125e8797 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] No waiting events found dispatching network-vif-plugged-e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:18:08 user nova-compute[70243]: WARNING nova.compute.manager [req-59d2c537-06d3-4c43-ac99-0b17462d3173 req-4a91899e-1430-4d87-bff3-77ac125e8797 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Received unexpected event network-vif-plugged-e709e269-eff5-4ac2-8c2a-29048448a422 for instance with vm_state building and task_state spawning.
Jul 24 16:18:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG nova.network.neutron [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Successfully updated port: 66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquired lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG nova.network.neutron [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG nova.compute.manager [req-4040443e-a245-4ec5-8c5b-1d0ee438f3e8 req-3eea041e-80a1-4471-9672-4c8bb819d65f service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received event network-changed-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG nova.compute.manager [req-4040443e-a245-4ec5-8c5b-1d0ee438f3e8 req-3eea041e-80a1-4471-9672-4c8bb819d65f service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Refreshing instance network info cache due to event network-changed-66249aa8-373c-45b2-940f-74f7e6228bce. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4040443e-a245-4ec5-8c5b-1d0ee438f3e8 req-3eea041e-80a1-4471-9672-4c8bb819d65f service nova] Acquiring lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-58e9c371-2f41-4287-9d1c-b9ec59fe99ef req-a8d6f918-2da1-4911-8857-31a22f08a156 service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Received event network-vif-plugged-e3519574-a5e5-48f3-9e0c-852d0e9e3505 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-58e9c371-2f41-4287-9d1c-b9ec59fe99ef req-a8d6f918-2da1-4911-8857-31a22f08a156 service nova] Acquiring lock "de484cb2-7f20-4bf1-927b-c066735bfeca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-58e9c371-2f41-4287-9d1c-b9ec59fe99ef req-a8d6f918-2da1-4911-8857-31a22f08a156 service nova] Lock "de484cb2-7f20-4bf1-927b-c066735bfeca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-58e9c371-2f41-4287-9d1c-b9ec59fe99ef req-a8d6f918-2da1-4911-8857-31a22f08a156 service nova] Lock "de484cb2-7f20-4bf1-927b-c066735bfeca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-58e9c371-2f41-4287-9d1c-b9ec59fe99ef req-a8d6f918-2da1-4911-8857-31a22f08a156 service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] No waiting events found dispatching network-vif-plugged-e3519574-a5e5-48f3-9e0c-852d0e9e3505 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:18:09 user nova-compute[70243]: WARNING nova.compute.manager [req-58e9c371-2f41-4287-9d1c-b9ec59fe99ef req-a8d6f918-2da1-4911-8857-31a22f08a156 service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Received unexpected event network-vif-plugged-e3519574-a5e5-48f3-9e0c-852d0e9e3505 for instance with vm_state active and task_state None.
Jul 24 16:18:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:09 user nova-compute[70243]: DEBUG nova.network.neutron [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:18:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.network.neutron [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Updating instance_info_cache with network_info: [{"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Releasing lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Instance network_info: |[{"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4040443e-a245-4ec5-8c5b-1d0ee438f3e8 req-3eea041e-80a1-4471-9672-4c8bb819d65f service nova] Acquired lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.network.neutron [req-4040443e-a245-4ec5-8c5b-1d0ee438f3e8 req-3eea041e-80a1-4471-9672-4c8bb819d65f service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Refreshing network info cache for port 66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Start _get_guest_xml network_info=[{"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:18:10 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:18:10 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1291679900',display_name='tempest-ServerActionsTestOtherB-server-1291679900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1291679900',id=6,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqymb2uus6Bkqa8Jv1s5ZbibCwJHiHaRW+MVWVRPkPu9Fm+8ajStg97Lu5Oh0gjEFACHSPElKL2d/v4nyEqxN0n8bX7piloSV6v2kR0JjimuB49HIj2A6fdu+bprtip6w==',key_name='tempest-keypair-692701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5385c4cfc8d84d1abd728c11d75c003d',ramdisk_id='',reservation_id='r-tutxnqyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-485175328',owner_user_name='tempest-ServerActionsTestOtherB-485175328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:18:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9db33a574c334a2d91afc72b21ef15e6',uuid=5f70528b-33db-4257-96fe-e5fad869a224,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Converting VIF {"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=66249aa8-373c-45b2-940f-74f7e6228bce,network=Network(109feefe-8734-40ee-a8b8-2defa6e83853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66249aa8-37') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.objects.instance [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f70528b-33db-4257-96fe-e5fad869a224 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.compute.manager [req-0ceb1171-1013-47ac-a46f-a87f9244398c req-4313fbdc-25ba-4e4d-a15d-cda205a00371 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Received event network-vif-plugged-e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0ceb1171-1013-47ac-a46f-a87f9244398c req-4313fbdc-25ba-4e4d-a15d-cda205a00371 service nova] Acquiring lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0ceb1171-1013-47ac-a46f-a87f9244398c req-4313fbdc-25ba-4e4d-a15d-cda205a00371 service nova] Lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0ceb1171-1013-47ac-a46f-a87f9244398c req-4313fbdc-25ba-4e4d-a15d-cda205a00371 service nova] Lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.010s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.compute.manager [req-0ceb1171-1013-47ac-a46f-a87f9244398c req-4313fbdc-25ba-4e4d-a15d-cda205a00371 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] No waiting events found dispatching network-vif-plugged-e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:18:10 user nova-compute[70243]: WARNING nova.compute.manager [req-0ceb1171-1013-47ac-a46f-a87f9244398c req-4313fbdc-25ba-4e4d-a15d-cda205a00371 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Received unexpected event network-vif-plugged-e709e269-eff5-4ac2-8c2a-29048448a422 for instance with vm_state building and task_state spawning.
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:18:10 user nova-compute[70243]:   <uuid>5f70528b-33db-4257-96fe-e5fad869a224</uuid>
Jul 24 16:18:10 user nova-compute[70243]:   <name>instance-00000006</name>
Jul 24 16:18:10 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:18:10 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:18:10 user nova-compute[70243]:   <metadata>
Jul 24 16:18:10 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:18:10 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:18:10 user nova-compute[70243]:       <nova:name>tempest-ServerActionsTestOtherB-server-1291679900</nova:name>
Jul 24 16:18:10 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:18:10</nova:creationTime>
Jul 24 16:18:10 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:18:10 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:18:10 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:18:10 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:18:10 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:18:10 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:18:10 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:18:10 user nova-compute[70243]:       <nova:owner>
Jul 24 16:18:10 user nova-compute[70243]:         <nova:user uuid="9db33a574c334a2d91afc72b21ef15e6">tempest-ServerActionsTestOtherB-485175328-project-member</nova:user>
Jul 24 16:18:10 user nova-compute[70243]:         <nova:project uuid="5385c4cfc8d84d1abd728c11d75c003d">tempest-ServerActionsTestOtherB-485175328</nova:project>
Jul 24 16:18:10 user nova-compute[70243]:       </nova:owner>
Jul 24 16:18:10 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:18:10 user nova-compute[70243]:       <nova:ports>
Jul 24 16:18:10 user nova-compute[70243]:         <nova:port uuid="66249aa8-373c-45b2-940f-74f7e6228bce">
Jul 24 16:18:10 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 16:18:10 user nova-compute[70243]:         </nova:port>
Jul 24 16:18:10 user nova-compute[70243]:       </nova:ports>
Jul 24 16:18:10 user nova-compute[70243]:     </nova:instance>
Jul 24 16:18:10 user nova-compute[70243]:   </metadata>
Jul 24 16:18:10 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:18:10 user nova-compute[70243]:     <system>
Jul 24 16:18:10 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:18:10 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:18:10 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:18:10 user nova-compute[70243]:       <entry name="serial">5f70528b-33db-4257-96fe-e5fad869a224</entry>
Jul 24 16:18:10 user nova-compute[70243]:       <entry name="uuid">5f70528b-33db-4257-96fe-e5fad869a224</entry>
Jul 24 16:18:10 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:18:10 user nova-compute[70243]:     </system>
Jul 24 16:18:10 user nova-compute[70243]:   </sysinfo>
Jul 24 16:18:10 user nova-compute[70243]:   <os>
Jul 24 16:18:10 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:18:10 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:18:10 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:18:10 user nova-compute[70243]:   </os>
Jul 24 16:18:10 user nova-compute[70243]:   <features>
Jul 24 16:18:10 user nova-compute[70243]:     <acpi/>
Jul 24 16:18:10 user nova-compute[70243]:     <apic/>
Jul 24 16:18:10 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:18:10 user nova-compute[70243]:   </features>
Jul 24 16:18:10 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:18:10 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:18:10 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:18:10 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:18:10 user nova-compute[70243]:   </clock>
Jul 24 16:18:10 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:18:10 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:18:10 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:18:10 user nova-compute[70243]:   </cpu>
Jul 24 16:18:10 user nova-compute[70243]:   <devices>
Jul 24 16:18:10 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:18:10 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:18:10 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk"/>
Jul 24 16:18:10 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:18:10 user nova-compute[70243]:     </disk>
Jul 24 16:18:10 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:18:10 user nova-compute[70243]:       <mac address="fa:16:3e:b0:61:6c"/>
Jul 24 16:18:10 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:18:10 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:18:10 user nova-compute[70243]:       <target dev="tap66249aa8-37"/>
Jul 24 16:18:10 user nova-compute[70243]:     </interface>
Jul 24 16:18:10 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:18:10 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/console.log" append="off"/>
Jul 24 16:18:10 user nova-compute[70243]:     </serial>
Jul 24 16:18:10 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:18:10 user nova-compute[70243]:     <video>
Jul 24 16:18:10 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:18:10 user nova-compute[70243]:     </video>
Jul 24 16:18:10 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:18:10 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:18:10 user nova-compute[70243]:     </rng>
Jul 24 16:18:10 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:18:10 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:18:10 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:18:10 user nova-compute[70243]:     </memballoon>
Jul 24 16:18:10 user nova-compute[70243]:   </devices>
Jul 24 16:18:10 user nova-compute[70243]: </domain>
Jul 24 16:18:10 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1291679900',display_name='tempest-ServerActionsTestOtherB-server-1291679900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1291679900',id=6,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqymb2uus6Bkqa8Jv1s5ZbibCwJHiHaRW+MVWVRPkPu9Fm+8ajStg97Lu5Oh0gjEFACHSPElKL2d/v4nyEqxN0n8bX7piloSV6v2kR0JjimuB49HIj2A6fdu+bprtip6w==',key_name='tempest-keypair-692701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5385c4cfc8d84d1abd728c11d75c003d',ramdisk_id='',reservation_id='r-tutxnqyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-485175328',owner_user_name='tempest-ServerActionsTestOtherB-485175328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:18:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9db33a574c334a2d91afc72b21ef15e6',uuid=5f70528b-33db-4257-96fe-e5fad869a224,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Converting VIF {"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=66249aa8-373c-45b2-940f-74f7e6228bce,network=Network(109feefe-8734-40ee-a8b8-2defa6e83853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66249aa8-37') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG os_vif [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=66249aa8-373c-45b2-940f-74f7e6228bce,network=Network(109feefe-8734-40ee-a8b8-2defa6e83853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66249aa8-37') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66249aa8-37, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap66249aa8-37, col_values=(('external_ids', {'iface-id': '66249aa8-373c-45b2-940f-74f7e6228bce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:61:6c', 'vm-uuid': '5f70528b-33db-4257-96fe-e5fad869a224'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:10 user nova-compute[70243]: INFO os_vif [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=66249aa8-373c-45b2-940f-74f7e6228bce,network=Network(109feefe-8734-40ee-a8b8-2defa6e83853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66249aa8-37')
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:18:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] No VIF found with MAC fa:16:3e:b0:61:6c, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:18:11 user nova-compute[70243]: DEBUG nova.compute.manager [req-293d86e1-271d-4e38-91f7-d3625a3f8cff req-de1f4202-97a4-4132-b043-050a241992b9 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received event network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-293d86e1-271d-4e38-91f7-d3625a3f8cff req-de1f4202-97a4-4132-b043-050a241992b9 service nova] Acquiring lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-293d86e1-271d-4e38-91f7-d3625a3f8cff req-de1f4202-97a4-4132-b043-050a241992b9 service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-293d86e1-271d-4e38-91f7-d3625a3f8cff req-de1f4202-97a4-4132-b043-050a241992b9 service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:11 user nova-compute[70243]: DEBUG nova.compute.manager [req-293d86e1-271d-4e38-91f7-d3625a3f8cff req-de1f4202-97a4-4132-b043-050a241992b9 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] No waiting events found dispatching network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:18:11 user nova-compute[70243]: WARNING nova.compute.manager [req-293d86e1-271d-4e38-91f7-d3625a3f8cff req-de1f4202-97a4-4132-b043-050a241992b9 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received unexpected event network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 for instance with vm_state building and task_state spawning.
Jul 24 16:18:11 user nova-compute[70243]: DEBUG nova.compute.manager [req-293d86e1-271d-4e38-91f7-d3625a3f8cff req-de1f4202-97a4-4132-b043-050a241992b9 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received event network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-293d86e1-271d-4e38-91f7-d3625a3f8cff req-de1f4202-97a4-4132-b043-050a241992b9 service nova] Acquiring lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-293d86e1-271d-4e38-91f7-d3625a3f8cff req-de1f4202-97a4-4132-b043-050a241992b9 service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-293d86e1-271d-4e38-91f7-d3625a3f8cff req-de1f4202-97a4-4132-b043-050a241992b9 service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:11 user nova-compute[70243]: DEBUG nova.compute.manager [req-293d86e1-271d-4e38-91f7-d3625a3f8cff req-de1f4202-97a4-4132-b043-050a241992b9 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] No waiting events found dispatching network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:18:11 user nova-compute[70243]: WARNING nova.compute.manager [req-293d86e1-271d-4e38-91f7-d3625a3f8cff req-de1f4202-97a4-4132-b043-050a241992b9 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received unexpected event network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 for instance with vm_state building and task_state spawning.
Jul 24 16:18:11 user nova-compute[70243]: DEBUG nova.compute.manager [req-293d86e1-271d-4e38-91f7-d3625a3f8cff req-de1f4202-97a4-4132-b043-050a241992b9 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received event network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-293d86e1-271d-4e38-91f7-d3625a3f8cff req-de1f4202-97a4-4132-b043-050a241992b9 service nova] Acquiring lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-293d86e1-271d-4e38-91f7-d3625a3f8cff req-de1f4202-97a4-4132-b043-050a241992b9 service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-293d86e1-271d-4e38-91f7-d3625a3f8cff req-de1f4202-97a4-4132-b043-050a241992b9 service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:11 user nova-compute[70243]: DEBUG nova.compute.manager [req-293d86e1-271d-4e38-91f7-d3625a3f8cff req-de1f4202-97a4-4132-b043-050a241992b9 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] No waiting events found dispatching network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:18:11 user nova-compute[70243]: WARNING nova.compute.manager [req-293d86e1-271d-4e38-91f7-d3625a3f8cff req-de1f4202-97a4-4132-b043-050a241992b9 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received unexpected event network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 for instance with vm_state building and task_state spawning.
Jul 24 16:18:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:11 user nova-compute[70243]: DEBUG nova.network.neutron [req-4040443e-a245-4ec5-8c5b-1d0ee438f3e8 req-3eea041e-80a1-4471-9672-4c8bb819d65f service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Updated VIF entry in instance network info cache for port 66249aa8-373c-45b2-940f-74f7e6228bce. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:18:11 user nova-compute[70243]: DEBUG nova.network.neutron [req-4040443e-a245-4ec5-8c5b-1d0ee438f3e8 req-3eea041e-80a1-4471-9672-4c8bb819d65f service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Updating instance_info_cache with network_info: [{"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:18:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4040443e-a245-4ec5-8c5b-1d0ee438f3e8 req-3eea041e-80a1-4471-9672-4c8bb819d65f service nova] Releasing lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:18:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:12 user nova-compute[70243]: DEBUG nova.compute.manager [req-87bebdb8-d767-417e-a8e3-1bfaa2cbd1f2 req-9ca4372a-6dd8-42c7-b15e-c42321f0fd94 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received event network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-87bebdb8-d767-417e-a8e3-1bfaa2cbd1f2 req-9ca4372a-6dd8-42c7-b15e-c42321f0fd94 service nova] Acquiring lock "5f70528b-33db-4257-96fe-e5fad869a224-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-87bebdb8-d767-417e-a8e3-1bfaa2cbd1f2 req-9ca4372a-6dd8-42c7-b15e-c42321f0fd94 service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-87bebdb8-d767-417e-a8e3-1bfaa2cbd1f2 req-9ca4372a-6dd8-42c7-b15e-c42321f0fd94 service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:12 user nova-compute[70243]: DEBUG nova.compute.manager [req-87bebdb8-d767-417e-a8e3-1bfaa2cbd1f2 req-9ca4372a-6dd8-42c7-b15e-c42321f0fd94 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] No waiting events found dispatching network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:18:12 user nova-compute[70243]: WARNING nova.compute.manager [req-87bebdb8-d767-417e-a8e3-1bfaa2cbd1f2 req-9ca4372a-6dd8-42c7-b15e-c42321f0fd94 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received unexpected event network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce for instance with vm_state building and task_state spawning.
Jul 24 16:18:12 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215492.7673883, de22ea98-b041-4f3f-8986-435c43267a2e => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:18:12 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] VM Resumed (Lifecycle Event)
Jul 24 16:18:12 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:18:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:18:12 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Instance spawned successfully.
Jul 24 16:18:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:18:12 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:12 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:18:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:12 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:18:12 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215492.771238, de22ea98-b041-4f3f-8986-435c43267a2e => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:18:12 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] VM Started (Lifecycle Event)
Jul 24 16:18:12 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:18:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:18:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Took 18.65 seconds to spawn the instance on the hypervisor.
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Took 19.45 seconds to build instance.
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215493.3067849, ad611655-ba4d-4a66-b78e-a82c058f4414 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:18:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] VM Resumed (Lifecycle Event)
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.compute.manager [req-60cbc7e0-1a6b-4c5c-96d9-7a65abcaa78f req-e2aea1ea-5063-4550-8206-25023bc407d1 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received event network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-60cbc7e0-1a6b-4c5c-96d9-7a65abcaa78f req-e2aea1ea-5063-4550-8206-25023bc407d1 service nova] Acquiring lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-60cbc7e0-1a6b-4c5c-96d9-7a65abcaa78f req-e2aea1ea-5063-4550-8206-25023bc407d1 service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-60cbc7e0-1a6b-4c5c-96d9-7a65abcaa78f req-e2aea1ea-5063-4550-8206-25023bc407d1 service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.compute.manager [req-60cbc7e0-1a6b-4c5c-96d9-7a65abcaa78f req-e2aea1ea-5063-4550-8206-25023bc407d1 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] No waiting events found dispatching network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:18:13 user nova-compute[70243]: WARNING nova.compute.manager [req-60cbc7e0-1a6b-4c5c-96d9-7a65abcaa78f req-e2aea1ea-5063-4550-8206-25023bc407d1 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received unexpected event network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 for instance with vm_state building and task_state spawning.
Jul 24 16:18:13 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Instance spawned successfully.
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b2c7d9d0-a8f4-463d-98f2-5c0b5a99cd64 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "de22ea98-b041-4f3f-8986-435c43267a2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.641s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215493.3079443, ad611655-ba4d-4a66-b78e-a82c058f4414 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:18:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] VM Started (Lifecycle Event)
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:18:13 user nova-compute[70243]: INFO nova.compute.manager [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Took 15.32 seconds to spawn the instance on the hypervisor.
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:13 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Instance spawned successfully.
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:18:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215493.4923143, a13c243a-2b98-4ef1-b17c-e2e15ba005fd => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:18:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] VM Resumed (Lifecycle Event)
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:13 user nova-compute[70243]: INFO nova.compute.manager [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Took 16.64 seconds to spawn the instance on the hypervisor.
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:13 user nova-compute[70243]: INFO nova.compute.manager [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Took 16.16 seconds to build instance.
Jul 24 16:18:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215493.4957128, a13c243a-2b98-4ef1-b17c-e2e15ba005fd => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:18:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] VM Started (Lifecycle Event)
Jul 24 16:18:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e69-513a-4918-a6cc-e72711cfa22a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.309s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:18:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:18:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:13 user nova-compute[70243]: INFO nova.compute.manager [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Took 18.11 seconds to build instance.
Jul 24 16:18:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-513a240f-e252-4e20-84d8-c5859305eecf tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.278s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:14 user nova-compute[70243]: DEBUG nova.compute.manager [req-cf0fbdd5-99c7-450e-bf0b-dfdf25b16f75 req-34dea321-8c4b-4197-b728-7c13d1b8410b service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received event network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cf0fbdd5-99c7-450e-bf0b-dfdf25b16f75 req-34dea321-8c4b-4197-b728-7c13d1b8410b service nova] Acquiring lock "5f70528b-33db-4257-96fe-e5fad869a224-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cf0fbdd5-99c7-450e-bf0b-dfdf25b16f75 req-34dea321-8c4b-4197-b728-7c13d1b8410b service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cf0fbdd5-99c7-450e-bf0b-dfdf25b16f75 req-34dea321-8c4b-4197-b728-7c13d1b8410b service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:14 user nova-compute[70243]: DEBUG nova.compute.manager [req-cf0fbdd5-99c7-450e-bf0b-dfdf25b16f75 req-34dea321-8c4b-4197-b728-7c13d1b8410b service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] No waiting events found dispatching network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:18:14 user nova-compute[70243]: WARNING nova.compute.manager [req-cf0fbdd5-99c7-450e-bf0b-dfdf25b16f75 req-34dea321-8c4b-4197-b728-7c13d1b8410b service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received unexpected event network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce for instance with vm_state building and task_state spawning.
Jul 24 16:18:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Acquiring lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:18:15 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215495.322828, 5f70528b-33db-4257-96fe-e5fad869a224 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:18:15 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] VM Resumed (Lifecycle Event)
Jul 24 16:18:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "c2ee17ba-3482-4caf-992e-30b3953d1e91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "c2ee17ba-3482-4caf-992e-30b3953d1e91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:18:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:18:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:18:15 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Instance spawned successfully.
Jul 24 16:18:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:18:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:18:15 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:18:15 user nova-compute[70243]: INFO nova.compute.claims [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Claim successful on node user
Jul 24 16:18:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:15 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:18:15 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215495.323222, 5f70528b-33db-4257-96fe-e5fad869a224 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:18:15 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] VM Started (Lifecycle Event)
Jul 24 16:18:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:15 user nova-compute[70243]: INFO nova.compute.manager [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Took 14.75 seconds to spawn the instance on the hypervisor.
Jul 24 16:18:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:18:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:15 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:18:15 user nova-compute[70243]: INFO nova.compute.manager [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Took 16.04 seconds to build instance.
Jul 24 16:18:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dcd33b6d-be1d-4d5b-9148-832c44a99f1f tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "5f70528b-33db-4257-96fe-e5fad869a224" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.170s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:16 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:18:16 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:18:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.716s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:18:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.522s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:16 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:18:16 user nova-compute[70243]: INFO nova.compute.claims [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Claim successful on node user
Jul 24 16:18:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:18:16 user nova-compute[70243]: DEBUG nova.network.neutron [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:18:16 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Jul 24 16:18:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:18:16 user nova-compute[70243]: DEBUG nova.policy [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e8e691b69b04b338729b8edfee01d03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c896c3ac00cb4843b0b82f360cf4d578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:18:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:18:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:18:16 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Creating image(s)
Jul 24 16:18:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Acquiring lock "/opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "/opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "/opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Acquiring lock "9fabeff47555798f108b08e62af7f15380c69abe" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "9fabeff47555798f108b08e62af7f15380c69abe" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fabeff47555798f108b08e62af7f15380c69abe.part --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fabeff47555798f108b08e62af7f15380c69abe.part --force-share --output=json" returned: 0 in 0.214s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:17 user nova-compute[70243]: DEBUG nova.virt.images [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] 42ec1bfc-8994-4142-a246-dc98cb002d83 was qcow2, converting to raw {{(pid=70243) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 16:18:17 user nova-compute[70243]: DEBUG nova.privsep.utils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70243) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 16:18:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9fabeff47555798f108b08e62af7f15380c69abe.part /opt/stack/data/nova/instances/_base/9fabeff47555798f108b08e62af7f15380c69abe.converted {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:17 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:18:17 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:18:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9fabeff47555798f108b08e62af7f15380c69abe.part /opt/stack/data/nova/instances/_base/9fabeff47555798f108b08e62af7f15380c69abe.converted" returned: 0 in 0.310s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fabeff47555798f108b08e62af7f15380c69abe.converted --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.548s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:18:17 user nova-compute[70243]: DEBUG nova.network.neutron [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Successfully created port: 94a5d835-5e78-4c88-aae0-d00bd2adc163 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:18:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:18:17 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:18:17 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:18:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fabeff47555798f108b08e62af7f15380c69abe.converted --force-share --output=json" returned: 0 in 0.228s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "9fabeff47555798f108b08e62af7f15380c69abe" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.358s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fabeff47555798f108b08e62af7f15380c69abe --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG nova.policy [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e6294a2931e4959be1440678b174828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6973a869545f43e1bd096a5f6eaf921c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fabeff47555798f108b08e62af7f15380c69abe --force-share --output=json" returned: 0 in 0.198s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Acquiring lock "9fabeff47555798f108b08e62af7f15380c69abe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "9fabeff47555798f108b08e62af7f15380c69abe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fabeff47555798f108b08e62af7f15380c69abe --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:18:18 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Creating image(s)
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "/opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "/opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fabeff47555798f108b08e62af7f15380c69abe --force-share --output=json" returned: 0 in 0.220s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9fabeff47555798f108b08e62af7f15380c69abe,backing_fmt=raw /opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.195s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9fabeff47555798f108b08e62af7f15380c69abe,backing_fmt=raw /opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/disk 1073741824" returned: 0 in 0.089s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "9fabeff47555798f108b08e62af7f15380c69abe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fabeff47555798f108b08e62af7f15380c69abe --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.211s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk 1073741824" returned: 0 in 0.081s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fabeff47555798f108b08e62af7f15380c69abe --force-share --output=json" returned: 0 in 0.324s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.221s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:18:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Cannot resize image /opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG nova.objects.instance [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lazy-loading 'migration_context' on Instance uuid 8cd7a53c-c100-4e43-a9d6-0d4517239e15 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Successfully created port: da8433ea-b1c3-497e-b77c-fe0e87674dac {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Ensure instance console log exists: /opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG nova.network.neutron [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Successfully updated port: 94a5d835-5e78-4c88-aae0-d00bd2adc163 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Acquiring lock "refresh_cache-8cd7a53c-c100-4e43-a9d6-0d4517239e15" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Acquired lock "refresh_cache-8cd7a53c-c100-4e43-a9d6-0d4517239e15" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG nova.network.neutron [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Cannot resize image /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG nova.objects.instance [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lazy-loading 'migration_context' on Instance uuid c2ee17ba-3482-4caf-992e-30b3953d1e91 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Ensure instance console log exists: /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-8d37ac56-630c-4131-b8f3-f0d36304ccaa req-fc734bfd-7941-4927-91ca-2ac64c964ba2 service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Received event network-changed-94a5d835-5e78-4c88-aae0-d00bd2adc163 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-8d37ac56-630c-4131-b8f3-f0d36304ccaa req-fc734bfd-7941-4927-91ca-2ac64c964ba2 service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Refreshing instance network info cache due to event network-changed-94a5d835-5e78-4c88-aae0-d00bd2adc163. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8d37ac56-630c-4131-b8f3-f0d36304ccaa req-fc734bfd-7941-4927-91ca-2ac64c964ba2 service nova] Acquiring lock "refresh_cache-8cd7a53c-c100-4e43-a9d6-0d4517239e15" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG nova.network.neutron [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:18:19 user nova-compute[70243]: DEBUG nova.network.neutron [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Updating instance_info_cache with network_info: [{"id": "94a5d835-5e78-4c88-aae0-d00bd2adc163", "address": "fa:16:3e:16:5d:65", "network": {"id": "bd848428-14ae-4e21-a751-e2fd2550be5b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-174143408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c896c3ac00cb4843b0b82f360cf4d578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a5d835-5e", "ovs_interfaceid": "94a5d835-5e78-4c88-aae0-d00bd2adc163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Releasing lock "refresh_cache-8cd7a53c-c100-4e43-a9d6-0d4517239e15" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.compute.manager [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Instance network_info: |[{"id": "94a5d835-5e78-4c88-aae0-d00bd2adc163", "address": "fa:16:3e:16:5d:65", "network": {"id": "bd848428-14ae-4e21-a751-e2fd2550be5b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-174143408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c896c3ac00cb4843b0b82f360cf4d578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a5d835-5e", "ovs_interfaceid": "94a5d835-5e78-4c88-aae0-d00bd2adc163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8d37ac56-630c-4131-b8f3-f0d36304ccaa req-fc734bfd-7941-4927-91ca-2ac64c964ba2 service nova] Acquired lock "refresh_cache-8cd7a53c-c100-4e43-a9d6-0d4517239e15" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.network.neutron [req-8d37ac56-630c-4131-b8f3-f0d36304ccaa req-fc734bfd-7941-4927-91ca-2ac64c964ba2 service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Refreshing network info cache for port 94a5d835-5e78-4c88-aae0-d00bd2adc163 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Start _get_guest_xml network_info=[{"id": "94a5d835-5e78-4c88-aae0-d00bd2adc163", "address": "fa:16:3e:16:5d:65", "network": {"id": "bd848428-14ae-4e21-a751-e2fd2550be5b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-174143408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c896c3ac00cb4843b0b82f360cf4d578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a5d835-5e", "ovs_interfaceid": "94a5d835-5e78-4c88-aae0-d00bd2adc163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:18:04Z,direct_url=<?>,disk_format='qcow2',id=42ec1bfc-8994-4142-a246-dc98cb002d83,min_disk=0,min_ram=0,name='',owner='0d90172dc08249ffa40aaf100a9bf3b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:18:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'scsi', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/sda', 'encryption_options': None, 'size': 0, 'image_id': '42ec1bfc-8994-4142-a246-dc98cb002d83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:18:20 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:18:20 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Successfully updated port: da8433ea-b1c3-497e-b77c-fe0e87674dac {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:18:04Z,direct_url=<?>,disk_format='qcow2',id=42ec1bfc-8994-4142-a246-dc98cb002d83,min_disk=0,min_ram=0,name='',owner='0d90172dc08249ffa40aaf100a9bf3b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:18:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-929650101',display_name='tempest-AttachSCSIVolumeTestJSON-server-929650101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-929650101',id=7,image_ref='42ec1bfc-8994-4142-a246-dc98cb002d83',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxuVCAoUfk9SBeJqJzDJUIEVPbaxgmNLfYvsMJ7hilqx8i5Nrymk6UtpgK8slhfnIdYFqZhPuOvROyPOZSc/9o4sBuESU3pEE0oIkGezS2KT8ziy4z0iCPCy/du304tpg==',key_name='tempest-keypair-995268334',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c896c3ac00cb4843b0b82f360cf4d578',ramdisk_id='',reservation_id='r-zrok6b8h',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42ec1bfc-8994-4142-a246-dc98cb002d83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1678269418',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1678269418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:18:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e8e691b69b04b338729b8edfee01d03',uuid=8cd7a53c-c100-4e43-a9d6-0d4517239e15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94a5d835-5e78-4c88-aae0-d00bd2adc163", "address": "fa:16:3e:16:5d:65", "network": {"id": "bd848428-14ae-4e21-a751-e2fd2550be5b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-174143408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c896c3ac00cb4843b0b82f360cf4d578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a5d835-5e", "ovs_interfaceid": "94a5d835-5e78-4c88-aae0-d00bd2adc163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Converting VIF {"id": "94a5d835-5e78-4c88-aae0-d00bd2adc163", "address": "fa:16:3e:16:5d:65", "network": {"id": "bd848428-14ae-4e21-a751-e2fd2550be5b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-174143408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c896c3ac00cb4843b0b82f360cf4d578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a5d835-5e", "ovs_interfaceid": "94a5d835-5e78-4c88-aae0-d00bd2adc163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:5d:65,bridge_name='br-int',has_traffic_filtering=True,id=94a5d835-5e78-4c88-aae0-d00bd2adc163,network=Network(bd848428-14ae-4e21-a751-e2fd2550be5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a5d835-5e') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.objects.instance [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lazy-loading 'pci_devices' on Instance uuid 8cd7a53c-c100-4e43-a9d6-0d4517239e15 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-42e22ba8-fe33-4a60-87a9-e167fc1b9b64 req-da014201-18d1-4b97-9ad9-b1e24f1b6509 service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Received event network-changed-da8433ea-b1c3-497e-b77c-fe0e87674dac {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-42e22ba8-fe33-4a60-87a9-e167fc1b9b64 req-da014201-18d1-4b97-9ad9-b1e24f1b6509 service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Refreshing instance network info cache due to event network-changed-da8433ea-b1c3-497e-b77c-fe0e87674dac. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-42e22ba8-fe33-4a60-87a9-e167fc1b9b64 req-da014201-18d1-4b97-9ad9-b1e24f1b6509 service nova] Acquiring lock "refresh_cache-c2ee17ba-3482-4caf-992e-30b3953d1e91" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-42e22ba8-fe33-4a60-87a9-e167fc1b9b64 req-da014201-18d1-4b97-9ad9-b1e24f1b6509 service nova] Acquired lock "refresh_cache-c2ee17ba-3482-4caf-992e-30b3953d1e91" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.network.neutron [req-42e22ba8-fe33-4a60-87a9-e167fc1b9b64 req-da014201-18d1-4b97-9ad9-b1e24f1b6509 service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Refreshing network info cache for port da8433ea-b1c3-497e-b77c-fe0e87674dac {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:18:20 user nova-compute[70243]:   <uuid>8cd7a53c-c100-4e43-a9d6-0d4517239e15</uuid>
Jul 24 16:18:20 user nova-compute[70243]:   <name>instance-00000007</name>
Jul 24 16:18:20 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:18:20 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:18:20 user nova-compute[70243]:   <metadata>
Jul 24 16:18:20 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:18:20 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:18:20 user nova-compute[70243]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-929650101</nova:name>
Jul 24 16:18:20 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:18:20</nova:creationTime>
Jul 24 16:18:20 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:18:20 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:18:20 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:18:20 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:18:20 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:18:20 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:18:20 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:18:20 user nova-compute[70243]:       <nova:owner>
Jul 24 16:18:20 user nova-compute[70243]:         <nova:user uuid="7e8e691b69b04b338729b8edfee01d03">tempest-AttachSCSIVolumeTestJSON-1678269418-project-member</nova:user>
Jul 24 16:18:20 user nova-compute[70243]:         <nova:project uuid="c896c3ac00cb4843b0b82f360cf4d578">tempest-AttachSCSIVolumeTestJSON-1678269418</nova:project>
Jul 24 16:18:20 user nova-compute[70243]:       </nova:owner>
Jul 24 16:18:20 user nova-compute[70243]:       <nova:root type="image" uuid="42ec1bfc-8994-4142-a246-dc98cb002d83"/>
Jul 24 16:18:20 user nova-compute[70243]:       <nova:ports>
Jul 24 16:18:20 user nova-compute[70243]:         <nova:port uuid="94a5d835-5e78-4c88-aae0-d00bd2adc163">
Jul 24 16:18:20 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 24 16:18:20 user nova-compute[70243]:         </nova:port>
Jul 24 16:18:20 user nova-compute[70243]:       </nova:ports>
Jul 24 16:18:20 user nova-compute[70243]:     </nova:instance>
Jul 24 16:18:20 user nova-compute[70243]:   </metadata>
Jul 24 16:18:20 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:18:20 user nova-compute[70243]:     <system>
Jul 24 16:18:20 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:18:20 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:18:20 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:18:20 user nova-compute[70243]:       <entry name="serial">8cd7a53c-c100-4e43-a9d6-0d4517239e15</entry>
Jul 24 16:18:20 user nova-compute[70243]:       <entry name="uuid">8cd7a53c-c100-4e43-a9d6-0d4517239e15</entry>
Jul 24 16:18:20 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:18:20 user nova-compute[70243]:     </system>
Jul 24 16:18:20 user nova-compute[70243]:   </sysinfo>
Jul 24 16:18:20 user nova-compute[70243]:   <os>
Jul 24 16:18:20 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:18:20 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:18:20 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:18:20 user nova-compute[70243]:   </os>
Jul 24 16:18:20 user nova-compute[70243]:   <features>
Jul 24 16:18:20 user nova-compute[70243]:     <acpi/>
Jul 24 16:18:20 user nova-compute[70243]:     <apic/>
Jul 24 16:18:20 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:18:20 user nova-compute[70243]:   </features>
Jul 24 16:18:20 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:18:20 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:18:20 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:18:20 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:18:20 user nova-compute[70243]:   </clock>
Jul 24 16:18:20 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:18:20 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:18:20 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:18:20 user nova-compute[70243]:   </cpu>
Jul 24 16:18:20 user nova-compute[70243]:   <devices>
Jul 24 16:18:20 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:18:20 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:18:20 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/disk"/>
Jul 24 16:18:20 user nova-compute[70243]:       <target dev="sda" bus="scsi"/>
Jul 24 16:18:20 user nova-compute[70243]:       <address type="drive" controller="0" unit="0"/>
Jul 24 16:18:20 user nova-compute[70243]:     </disk>
Jul 24 16:18:20 user nova-compute[70243]:     <disk type="file" device="cdrom">
Jul 24 16:18:20 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none"/>
Jul 24 16:18:20 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/disk.config"/>
Jul 24 16:18:20 user nova-compute[70243]:       <target dev="sdb" bus="scsi"/>
Jul 24 16:18:20 user nova-compute[70243]:       <address type="drive" controller="0" unit="1"/>
Jul 24 16:18:20 user nova-compute[70243]:     </disk>
Jul 24 16:18:20 user nova-compute[70243]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Jul 24 16:18:20 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:18:20 user nova-compute[70243]:       <mac address="fa:16:3e:16:5d:65"/>
Jul 24 16:18:20 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:18:20 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:18:20 user nova-compute[70243]:       <target dev="tap94a5d835-5e"/>
Jul 24 16:18:20 user nova-compute[70243]:     </interface>
Jul 24 16:18:20 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:18:20 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/console.log" append="off"/>
Jul 24 16:18:20 user nova-compute[70243]:     </serial>
Jul 24 16:18:20 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:18:20 user nova-compute[70243]:     <video>
Jul 24 16:18:20 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:18:20 user nova-compute[70243]:     </video>
Jul 24 16:18:20 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:18:20 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:18:20 user nova-compute[70243]:     </rng>
Jul 24 16:18:20 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:18:20 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:18:20 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:18:20 user nova-compute[70243]:     </memballoon>
Jul 24 16:18:20 user nova-compute[70243]:   </devices>
Jul 24 16:18:20 user nova-compute[70243]: </domain>
Jul 24 16:18:20 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-929650101',display_name='tempest-AttachSCSIVolumeTestJSON-server-929650101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-929650101',id=7,image_ref='42ec1bfc-8994-4142-a246-dc98cb002d83',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxuVCAoUfk9SBeJqJzDJUIEVPbaxgmNLfYvsMJ7hilqx8i5Nrymk6UtpgK8slhfnIdYFqZhPuOvROyPOZSc/9o4sBuESU3pEE0oIkGezS2KT8ziy4z0iCPCy/du304tpg==',key_name='tempest-keypair-995268334',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c896c3ac00cb4843b0b82f360cf4d578',ramdisk_id='',reservation_id='r-zrok6b8h',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42ec1bfc-8994-4142-a246-dc98cb002d83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1678269418',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1678269418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:18:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e8e691b69b04b338729b8edfee01d03',uuid=8cd7a53c-c100-4e43-a9d6-0d4517239e15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94a5d835-5e78-4c88-aae0-d00bd2adc163", "address": "fa:16:3e:16:5d:65", "network": {"id": "bd848428-14ae-4e21-a751-e2fd2550be5b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-174143408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c896c3ac00cb4843b0b82f360cf4d578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a5d835-5e", "ovs_interfaceid": "94a5d835-5e78-4c88-aae0-d00bd2adc163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Converting VIF {"id": "94a5d835-5e78-4c88-aae0-d00bd2adc163", "address": "fa:16:3e:16:5d:65", "network": {"id": "bd848428-14ae-4e21-a751-e2fd2550be5b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-174143408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c896c3ac00cb4843b0b82f360cf4d578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a5d835-5e", "ovs_interfaceid": "94a5d835-5e78-4c88-aae0-d00bd2adc163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:5d:65,bridge_name='br-int',has_traffic_filtering=True,id=94a5d835-5e78-4c88-aae0-d00bd2adc163,network=Network(bd848428-14ae-4e21-a751-e2fd2550be5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a5d835-5e') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG os_vif [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:5d:65,bridge_name='br-int',has_traffic_filtering=True,id=94a5d835-5e78-4c88-aae0-d00bd2adc163,network=Network(bd848428-14ae-4e21-a751-e2fd2550be5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a5d835-5e') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94a5d835-5e, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94a5d835-5e, col_values=(('external_ids', {'iface-id': '94a5d835-5e78-4c88-aae0-d00bd2adc163', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:5d:65', 'vm-uuid': '8cd7a53c-c100-4e43-a9d6-0d4517239e15'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:20 user nova-compute[70243]: INFO os_vif [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:5d:65,bridge_name='br-int',has_traffic_filtering=True,id=94a5d835-5e78-4c88-aae0-d00bd2adc163,network=Network(bd848428-14ae-4e21-a751-e2fd2550be5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a5d835-5e')
Jul 24 16:18:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "refresh_cache-c2ee17ba-3482-4caf-992e-30b3953d1e91" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.network.neutron [req-42e22ba8-fe33-4a60-87a9-e167fc1b9b64 req-da014201-18d1-4b97-9ad9-b1e24f1b6509 service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] No BDM found with device name sda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] No BDM found with device name sdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] No VIF found with MAC fa:16:3e:16:5d:65, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:18:20 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Using config drive
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.network.neutron [req-8d37ac56-630c-4131-b8f3-f0d36304ccaa req-fc734bfd-7941-4927-91ca-2ac64c964ba2 service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Updated VIF entry in instance network info cache for port 94a5d835-5e78-4c88-aae0-d00bd2adc163. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:18:20 user nova-compute[70243]: DEBUG nova.network.neutron [req-8d37ac56-630c-4131-b8f3-f0d36304ccaa req-fc734bfd-7941-4927-91ca-2ac64c964ba2 service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Updating instance_info_cache with network_info: [{"id": "94a5d835-5e78-4c88-aae0-d00bd2adc163", "address": "fa:16:3e:16:5d:65", "network": {"id": "bd848428-14ae-4e21-a751-e2fd2550be5b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-174143408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c896c3ac00cb4843b0b82f360cf4d578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a5d835-5e", "ovs_interfaceid": "94a5d835-5e78-4c88-aae0-d00bd2adc163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:18:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8d37ac56-630c-4131-b8f3-f0d36304ccaa req-fc734bfd-7941-4927-91ca-2ac64c964ba2 service nova] Releasing lock "refresh_cache-8cd7a53c-c100-4e43-a9d6-0d4517239e15" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:18:21 user nova-compute[70243]: DEBUG nova.network.neutron [req-42e22ba8-fe33-4a60-87a9-e167fc1b9b64 req-da014201-18d1-4b97-9ad9-b1e24f1b6509 service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:18:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-42e22ba8-fe33-4a60-87a9-e167fc1b9b64 req-da014201-18d1-4b97-9ad9-b1e24f1b6509 service nova] Releasing lock "refresh_cache-c2ee17ba-3482-4caf-992e-30b3953d1e91" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:18:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquired lock "refresh_cache-c2ee17ba-3482-4caf-992e-30b3953d1e91" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:18:21 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:18:21 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:18:21 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Creating config drive at /opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/disk.config
Jul 24 16:18:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbcab501c {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbcab501c" returned: 0 in 0.074s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Updating instance_info_cache with network_info: [{"id": "da8433ea-b1c3-497e-b77c-fe0e87674dac", "address": "fa:16:3e:43:e2:d2", "network": {"id": "798ddded-1cb9-4c01-9590-27f071d81a3c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1340440057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6973a869545f43e1bd096a5f6eaf921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda8433ea-b1", "ovs_interfaceid": "da8433ea-b1c3-497e-b77c-fe0e87674dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Releasing lock "refresh_cache-c2ee17ba-3482-4caf-992e-30b3953d1e91" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Instance network_info: |[{"id": "da8433ea-b1c3-497e-b77c-fe0e87674dac", "address": "fa:16:3e:43:e2:d2", "network": {"id": "798ddded-1cb9-4c01-9590-27f071d81a3c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1340440057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6973a869545f43e1bd096a5f6eaf921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda8433ea-b1", "ovs_interfaceid": "da8433ea-b1c3-497e-b77c-fe0e87674dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Start _get_guest_xml network_info=[{"id": "da8433ea-b1c3-497e-b77c-fe0e87674dac", "address": "fa:16:3e:43:e2:d2", "network": {"id": "798ddded-1cb9-4c01-9590-27f071d81a3c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1340440057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6973a869545f43e1bd096a5f6eaf921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda8433ea-b1", "ovs_interfaceid": "da8433ea-b1c3-497e-b77c-fe0e87674dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:18:22 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:18:22 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:18:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1193531302',display_name='tempest-VolumesAdminNegativeTest-server-1193531302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1193531302',id=8,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqLydVX6AhOLep2FAIets1EybmqCpNpMS0yXEatcKbemtKcga1/ReYoz9a9HygS1aFXaMUzBIqOBwAQBOzJZUYnsOA33wo17IWb8+V7jGA4GBnWnzhyQDo/xGIePao8fQ==',key_name='tempest-keypair-493675553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6973a869545f43e1bd096a5f6eaf921c',ramdisk_id='',reservation_id='r-ctp5sl28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2091650987',owner_user_name='tempest-VolumesAdminNegativeTest-2091650987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:18:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e6294a2931e4959be1440678b174828',uuid=c2ee17ba-3482-4caf-992e-30b3953d1e91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da8433ea-b1c3-497e-b77c-fe0e87674dac", "address": "fa:16:3e:43:e2:d2", "network": {"id": "798ddded-1cb9-4c01-9590-27f071d81a3c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1340440057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6973a869545f43e1bd096a5f6eaf921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda8433ea-b1", "ovs_interfaceid": "da8433ea-b1c3-497e-b77c-fe0e87674dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Converting VIF {"id": "da8433ea-b1c3-497e-b77c-fe0e87674dac", "address": "fa:16:3e:43:e2:d2", "network": {"id": "798ddded-1cb9-4c01-9590-27f071d81a3c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1340440057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6973a869545f43e1bd096a5f6eaf921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda8433ea-b1", "ovs_interfaceid": "da8433ea-b1c3-497e-b77c-fe0e87674dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:e2:d2,bridge_name='br-int',has_traffic_filtering=True,id=da8433ea-b1c3-497e-b77c-fe0e87674dac,network=Network(798ddded-1cb9-4c01-9590-27f071d81a3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda8433ea-b1') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.objects.instance [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lazy-loading 'pci_devices' on Instance uuid c2ee17ba-3482-4caf-992e-30b3953d1e91 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:18:22 user nova-compute[70243]:   <uuid>c2ee17ba-3482-4caf-992e-30b3953d1e91</uuid>
Jul 24 16:18:22 user nova-compute[70243]:   <name>instance-00000008</name>
Jul 24 16:18:22 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:18:22 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:18:22 user nova-compute[70243]:   <metadata>
Jul 24 16:18:22 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:18:22 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:18:22 user nova-compute[70243]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1193531302</nova:name>
Jul 24 16:18:22 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:18:22</nova:creationTime>
Jul 24 16:18:22 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:18:22 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:18:22 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:18:22 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:18:22 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:18:22 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:18:22 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:18:22 user nova-compute[70243]:       <nova:owner>
Jul 24 16:18:22 user nova-compute[70243]:         <nova:user uuid="4e6294a2931e4959be1440678b174828">tempest-VolumesAdminNegativeTest-2091650987-project-member</nova:user>
Jul 24 16:18:22 user nova-compute[70243]:         <nova:project uuid="6973a869545f43e1bd096a5f6eaf921c">tempest-VolumesAdminNegativeTest-2091650987</nova:project>
Jul 24 16:18:22 user nova-compute[70243]:       </nova:owner>
Jul 24 16:18:22 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:18:22 user nova-compute[70243]:       <nova:ports>
Jul 24 16:18:22 user nova-compute[70243]:         <nova:port uuid="da8433ea-b1c3-497e-b77c-fe0e87674dac">
Jul 24 16:18:22 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 24 16:18:22 user nova-compute[70243]:         </nova:port>
Jul 24 16:18:22 user nova-compute[70243]:       </nova:ports>
Jul 24 16:18:22 user nova-compute[70243]:     </nova:instance>
Jul 24 16:18:22 user nova-compute[70243]:   </metadata>
Jul 24 16:18:22 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:18:22 user nova-compute[70243]:     <system>
Jul 24 16:18:22 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:18:22 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:18:22 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:18:22 user nova-compute[70243]:       <entry name="serial">c2ee17ba-3482-4caf-992e-30b3953d1e91</entry>
Jul 24 16:18:22 user nova-compute[70243]:       <entry name="uuid">c2ee17ba-3482-4caf-992e-30b3953d1e91</entry>
Jul 24 16:18:22 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:18:22 user nova-compute[70243]:     </system>
Jul 24 16:18:22 user nova-compute[70243]:   </sysinfo>
Jul 24 16:18:22 user nova-compute[70243]:   <os>
Jul 24 16:18:22 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:18:22 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:18:22 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:18:22 user nova-compute[70243]:   </os>
Jul 24 16:18:22 user nova-compute[70243]:   <features>
Jul 24 16:18:22 user nova-compute[70243]:     <acpi/>
Jul 24 16:18:22 user nova-compute[70243]:     <apic/>
Jul 24 16:18:22 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:18:22 user nova-compute[70243]:   </features>
Jul 24 16:18:22 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:18:22 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:18:22 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:18:22 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:18:22 user nova-compute[70243]:   </clock>
Jul 24 16:18:22 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:18:22 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:18:22 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:18:22 user nova-compute[70243]:   </cpu>
Jul 24 16:18:22 user nova-compute[70243]:   <devices>
Jul 24 16:18:22 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:18:22 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:18:22 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk"/>
Jul 24 16:18:22 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:18:22 user nova-compute[70243]:     </disk>
Jul 24 16:18:22 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:18:22 user nova-compute[70243]:       <mac address="fa:16:3e:43:e2:d2"/>
Jul 24 16:18:22 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:18:22 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:18:22 user nova-compute[70243]:       <target dev="tapda8433ea-b1"/>
Jul 24 16:18:22 user nova-compute[70243]:     </interface>
Jul 24 16:18:22 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:18:22 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/console.log" append="off"/>
Jul 24 16:18:22 user nova-compute[70243]:     </serial>
Jul 24 16:18:22 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:18:22 user nova-compute[70243]:     <video>
Jul 24 16:18:22 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:18:22 user nova-compute[70243]:     </video>
Jul 24 16:18:22 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:18:22 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:18:22 user nova-compute[70243]:     </rng>
Jul 24 16:18:22 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:18:22 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:18:22 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:18:22 user nova-compute[70243]:     </memballoon>
Jul 24 16:18:22 user nova-compute[70243]:   </devices>
Jul 24 16:18:22 user nova-compute[70243]: </domain>
Jul 24 16:18:22 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:18:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1193531302',display_name='tempest-VolumesAdminNegativeTest-server-1193531302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1193531302',id=8,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqLydVX6AhOLep2FAIets1EybmqCpNpMS0yXEatcKbemtKcga1/ReYoz9a9HygS1aFXaMUzBIqOBwAQBOzJZUYnsOA33wo17IWb8+V7jGA4GBnWnzhyQDo/xGIePao8fQ==',key_name='tempest-keypair-493675553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6973a869545f43e1bd096a5f6eaf921c',ramdisk_id='',reservation_id='r-ctp5sl28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2091650987',owner_user_name='tempest-VolumesAdminNegativeTest-2091650987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:18:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e6294a2931e4959be1440678b174828',uuid=c2ee17ba-3482-4caf-992e-30b3953d1e91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da8433ea-b1c3-497e-b77c-fe0e87674dac", "address": "fa:16:3e:43:e2:d2", "network": {"id": "798ddded-1cb9-4c01-9590-27f071d81a3c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1340440057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6973a869545f43e1bd096a5f6eaf921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda8433ea-b1", "ovs_interfaceid": "da8433ea-b1c3-497e-b77c-fe0e87674dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Converting VIF {"id": "da8433ea-b1c3-497e-b77c-fe0e87674dac", "address": "fa:16:3e:43:e2:d2", "network": {"id": "798ddded-1cb9-4c01-9590-27f071d81a3c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1340440057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6973a869545f43e1bd096a5f6eaf921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda8433ea-b1", "ovs_interfaceid": "da8433ea-b1c3-497e-b77c-fe0e87674dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:e2:d2,bridge_name='br-int',has_traffic_filtering=True,id=da8433ea-b1c3-497e-b77c-fe0e87674dac,network=Network(798ddded-1cb9-4c01-9590-27f071d81a3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda8433ea-b1') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG os_vif [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:e2:d2,bridge_name='br-int',has_traffic_filtering=True,id=da8433ea-b1c3-497e-b77c-fe0e87674dac,network=Network(798ddded-1cb9-4c01-9590-27f071d81a3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda8433ea-b1') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda8433ea-b1, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapda8433ea-b1, col_values=(('external_ids', {'iface-id': 'da8433ea-b1c3-497e-b77c-fe0e87674dac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:e2:d2', 'vm-uuid': 'c2ee17ba-3482-4caf-992e-30b3953d1e91'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:22 user nova-compute[70243]: INFO os_vif [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:e2:d2,bridge_name='br-int',has_traffic_filtering=True,id=da8433ea-b1c3-497e-b77c-fe0e87674dac,network=Network(798ddded-1cb9-4c01-9590-27f071d81a3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda8433ea-b1')
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:18:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] No VIF found with MAC fa:16:3e:43:e2:d2, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:18:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Acquiring lock "5e6a5fff-570c-4ee2-b883-415ec828ef97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:18:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:24 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:18:24 user nova-compute[70243]: INFO nova.compute.claims [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Claim successful on node user
Jul 24 16:18:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:25 user nova-compute[70243]: DEBUG nova.compute.manager [req-2aeb72ac-9800-4ecc-93c1-e04dc738a35c req-4fd24f73-303a-499c-95ae-28a32e6f3ad3 service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Received event network-vif-plugged-94a5d835-5e78-4c88-aae0-d00bd2adc163 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2aeb72ac-9800-4ecc-93c1-e04dc738a35c req-4fd24f73-303a-499c-95ae-28a32e6f3ad3 service nova] Acquiring lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2aeb72ac-9800-4ecc-93c1-e04dc738a35c req-4fd24f73-303a-499c-95ae-28a32e6f3ad3 service nova] Lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2aeb72ac-9800-4ecc-93c1-e04dc738a35c req-4fd24f73-303a-499c-95ae-28a32e6f3ad3 service nova] Lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:25 user nova-compute[70243]: DEBUG nova.compute.manager [req-2aeb72ac-9800-4ecc-93c1-e04dc738a35c req-4fd24f73-303a-499c-95ae-28a32e6f3ad3 service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] No waiting events found dispatching network-vif-plugged-94a5d835-5e78-4c88-aae0-d00bd2adc163 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:18:25 user nova-compute[70243]: WARNING nova.compute.manager [req-2aeb72ac-9800-4ecc-93c1-e04dc738a35c req-4fd24f73-303a-499c-95ae-28a32e6f3ad3 service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Received unexpected event network-vif-plugged-94a5d835-5e78-4c88-aae0-d00bd2adc163 for instance with vm_state building and task_state spawning.
Jul 24 16:18:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:25 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:18:25 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:18:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.948s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:25 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:18:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-d289152e-1474-43a3-a843-8b1182fc3af2 req-54d6eb42-2755-49d2-a51d-f179b5aebdd8 service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Received event network-vif-plugged-da8433ea-b1c3-497e-b77c-fe0e87674dac {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d289152e-1474-43a3-a843-8b1182fc3af2 req-54d6eb42-2755-49d2-a51d-f179b5aebdd8 service nova] Acquiring lock "c2ee17ba-3482-4caf-992e-30b3953d1e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d289152e-1474-43a3-a843-8b1182fc3af2 req-54d6eb42-2755-49d2-a51d-f179b5aebdd8 service nova] Lock "c2ee17ba-3482-4caf-992e-30b3953d1e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d289152e-1474-43a3-a843-8b1182fc3af2 req-54d6eb42-2755-49d2-a51d-f179b5aebdd8 service nova] Lock "c2ee17ba-3482-4caf-992e-30b3953d1e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-d289152e-1474-43a3-a843-8b1182fc3af2 req-54d6eb42-2755-49d2-a51d-f179b5aebdd8 service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] No waiting events found dispatching network-vif-plugged-da8433ea-b1c3-497e-b77c-fe0e87674dac {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:18:26 user nova-compute[70243]: WARNING nova.compute.manager [req-d289152e-1474-43a3-a843-8b1182fc3af2 req-54d6eb42-2755-49d2-a51d-f179b5aebdd8 service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Received unexpected event network-vif-plugged-da8433ea-b1c3-497e-b77c-fe0e87674dac for instance with vm_state building and task_state spawning.
Jul 24 16:18:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG nova.network.neutron [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:26 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:18:26 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG nova.policy [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4e6f1d320714d0cafd63cbab32f11ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cd7d48387343179ba49b66c119c405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:18:26 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Creating image(s)
Jul 24 16:18:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "/opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "/opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.186s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.165s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk 1073741824" returned: 0 in 0.060s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.235s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:27 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:18:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:27 user nova-compute[70243]: DEBUG nova.network.neutron [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Successfully created port: 0bfc720a-e7ed-4eb1-b945-6565c661adef {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:18:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:27 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Cannot resize image /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:18:27 user nova-compute[70243]: DEBUG nova.objects.instance [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lazy-loading 'migration_context' on Instance uuid 5e6a5fff-570c-4ee2-b883-415ec828ef97 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:18:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:18:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Ensure instance console log exists: /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:18:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:27 user nova-compute[70243]: DEBUG nova.compute.manager [req-586788b7-1fff-48a5-b4ef-5040a5041d01 req-dca7b8b2-60fe-489c-aefd-8b23331c82dd service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Received event network-vif-plugged-94a5d835-5e78-4c88-aae0-d00bd2adc163 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-586788b7-1fff-48a5-b4ef-5040a5041d01 req-dca7b8b2-60fe-489c-aefd-8b23331c82dd service nova] Acquiring lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-586788b7-1fff-48a5-b4ef-5040a5041d01 req-dca7b8b2-60fe-489c-aefd-8b23331c82dd service nova] Lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-586788b7-1fff-48a5-b4ef-5040a5041d01 req-dca7b8b2-60fe-489c-aefd-8b23331c82dd service nova] Lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:27 user nova-compute[70243]: DEBUG nova.compute.manager [req-586788b7-1fff-48a5-b4ef-5040a5041d01 req-dca7b8b2-60fe-489c-aefd-8b23331c82dd service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] No waiting events found dispatching network-vif-plugged-94a5d835-5e78-4c88-aae0-d00bd2adc163 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:18:27 user nova-compute[70243]: WARNING nova.compute.manager [req-586788b7-1fff-48a5-b4ef-5040a5041d01 req-dca7b8b2-60fe-489c-aefd-8b23331c82dd service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Received unexpected event network-vif-plugged-94a5d835-5e78-4c88-aae0-d00bd2adc163 for instance with vm_state building and task_state spawning.
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-ceb475ea-ca4d-4371-a7a9-d78b0a7c3f64 req-aad9a789-d863-468c-a8a0-5fd05af3861d service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Received event network-vif-plugged-da8433ea-b1c3-497e-b77c-fe0e87674dac {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ceb475ea-ca4d-4371-a7a9-d78b0a7c3f64 req-aad9a789-d863-468c-a8a0-5fd05af3861d service nova] Acquiring lock "c2ee17ba-3482-4caf-992e-30b3953d1e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ceb475ea-ca4d-4371-a7a9-d78b0a7c3f64 req-aad9a789-d863-468c-a8a0-5fd05af3861d service nova] Lock "c2ee17ba-3482-4caf-992e-30b3953d1e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ceb475ea-ca4d-4371-a7a9-d78b0a7c3f64 req-aad9a789-d863-468c-a8a0-5fd05af3861d service nova] Lock "c2ee17ba-3482-4caf-992e-30b3953d1e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-ceb475ea-ca4d-4371-a7a9-d78b0a7c3f64 req-aad9a789-d863-468c-a8a0-5fd05af3861d service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] No waiting events found dispatching network-vif-plugged-da8433ea-b1c3-497e-b77c-fe0e87674dac {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:18:28 user nova-compute[70243]: WARNING nova.compute.manager [req-ceb475ea-ca4d-4371-a7a9-d78b0a7c3f64 req-aad9a789-d863-468c-a8a0-5fd05af3861d service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Received unexpected event network-vif-plugged-da8433ea-b1c3-497e-b77c-fe0e87674dac for instance with vm_state building and task_state spawning.
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.network.neutron [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Successfully updated port: 0bfc720a-e7ed-4eb1-b945-6565c661adef {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Acquiring lock "refresh_cache-5e6a5fff-570c-4ee2-b883-415ec828ef97" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Acquired lock "refresh_cache-5e6a5fff-570c-4ee2-b883-415ec828ef97" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.network.neutron [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.network.neutron [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.network.neutron [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Updating instance_info_cache with network_info: [{"id": "0bfc720a-e7ed-4eb1-b945-6565c661adef", "address": "fa:16:3e:bb:31:a5", "network": {"id": "97e0a268-3307-41b7-a748-0a9f3dfc8629", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1229538256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18cd7d48387343179ba49b66c119c405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfc720a-e7", "ovs_interfaceid": "0bfc720a-e7ed-4eb1-b945-6565c661adef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Releasing lock "refresh_cache-5e6a5fff-570c-4ee2-b883-415ec828ef97" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Instance network_info: |[{"id": "0bfc720a-e7ed-4eb1-b945-6565c661adef", "address": "fa:16:3e:bb:31:a5", "network": {"id": "97e0a268-3307-41b7-a748-0a9f3dfc8629", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1229538256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18cd7d48387343179ba49b66c119c405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfc720a-e7", "ovs_interfaceid": "0bfc720a-e7ed-4eb1-b945-6565c661adef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Start _get_guest_xml network_info=[{"id": "0bfc720a-e7ed-4eb1-b945-6565c661adef", "address": "fa:16:3e:bb:31:a5", "network": {"id": "97e0a268-3307-41b7-a748-0a9f3dfc8629", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1229538256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18cd7d48387343179ba49b66c119c405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfc720a-e7", "ovs_interfaceid": "0bfc720a-e7ed-4eb1-b945-6565c661adef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:18:28 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:18:28 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:18:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-625221097',display_name='tempest-TestVolumeSwap-server-625221097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-625221097',id=9,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJ/6GGyx1iFH1aLbXDBI/tVztmCtMhcxG8x49FhD2BMWE83p8XS//eIcium/yItjUwpLQcYx12Ou8E0mxGcZi0pr+B65YyGCnSbEjKNId0m93egXbiIrr/5Q+ei+x+lsg==',key_name='tempest-keypair-1521821379',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18cd7d48387343179ba49b66c119c405',ramdisk_id='',reservation_id='r-aqkuk644',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1908203650',owner_user_name='tempest-TestVolumeSwap-1908203650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4e6f1d320714d0cafd63cbab32f11ea',uuid=5e6a5fff-570c-4ee2-b883-415ec828ef97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bfc720a-e7ed-4eb1-b945-6565c661adef", "address": "fa:16:3e:bb:31:a5", "network": {"id": "97e0a268-3307-41b7-a748-0a9f3dfc8629", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1229538256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18cd7d48387343179ba49b66c119c405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfc720a-e7", "ovs_interfaceid": "0bfc720a-e7ed-4eb1-b945-6565c661adef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Converting VIF {"id": "0bfc720a-e7ed-4eb1-b945-6565c661adef", "address": "fa:16:3e:bb:31:a5", "network": {"id": "97e0a268-3307-41b7-a748-0a9f3dfc8629", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1229538256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18cd7d48387343179ba49b66c119c405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfc720a-e7", "ovs_interfaceid": "0bfc720a-e7ed-4eb1-b945-6565c661adef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:31:a5,bridge_name='br-int',has_traffic_filtering=True,id=0bfc720a-e7ed-4eb1-b945-6565c661adef,network=Network(97e0a268-3307-41b7-a748-0a9f3dfc8629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfc720a-e7') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.objects.instance [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e6a5fff-570c-4ee2-b883-415ec828ef97 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:18:28 user nova-compute[70243]:   <uuid>5e6a5fff-570c-4ee2-b883-415ec828ef97</uuid>
Jul 24 16:18:28 user nova-compute[70243]:   <name>instance-00000009</name>
Jul 24 16:18:28 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:18:28 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:18:28 user nova-compute[70243]:   <metadata>
Jul 24 16:18:28 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:18:28 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:18:28 user nova-compute[70243]:       <nova:name>tempest-TestVolumeSwap-server-625221097</nova:name>
Jul 24 16:18:28 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:18:28</nova:creationTime>
Jul 24 16:18:28 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:18:28 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:18:28 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:18:28 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:18:28 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:18:28 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:18:28 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:18:28 user nova-compute[70243]:       <nova:owner>
Jul 24 16:18:28 user nova-compute[70243]:         <nova:user uuid="b4e6f1d320714d0cafd63cbab32f11ea">tempest-TestVolumeSwap-1908203650-project-member</nova:user>
Jul 24 16:18:28 user nova-compute[70243]:         <nova:project uuid="18cd7d48387343179ba49b66c119c405">tempest-TestVolumeSwap-1908203650</nova:project>
Jul 24 16:18:28 user nova-compute[70243]:       </nova:owner>
Jul 24 16:18:28 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:18:28 user nova-compute[70243]:       <nova:ports>
Jul 24 16:18:28 user nova-compute[70243]:         <nova:port uuid="0bfc720a-e7ed-4eb1-b945-6565c661adef">
Jul 24 16:18:28 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 24 16:18:28 user nova-compute[70243]:         </nova:port>
Jul 24 16:18:28 user nova-compute[70243]:       </nova:ports>
Jul 24 16:18:28 user nova-compute[70243]:     </nova:instance>
Jul 24 16:18:28 user nova-compute[70243]:   </metadata>
Jul 24 16:18:28 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:18:28 user nova-compute[70243]:     <system>
Jul 24 16:18:28 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:18:28 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:18:28 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:18:28 user nova-compute[70243]:       <entry name="serial">5e6a5fff-570c-4ee2-b883-415ec828ef97</entry>
Jul 24 16:18:28 user nova-compute[70243]:       <entry name="uuid">5e6a5fff-570c-4ee2-b883-415ec828ef97</entry>
Jul 24 16:18:28 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:18:28 user nova-compute[70243]:     </system>
Jul 24 16:18:28 user nova-compute[70243]:   </sysinfo>
Jul 24 16:18:28 user nova-compute[70243]:   <os>
Jul 24 16:18:28 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:18:28 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:18:28 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:18:28 user nova-compute[70243]:   </os>
Jul 24 16:18:28 user nova-compute[70243]:   <features>
Jul 24 16:18:28 user nova-compute[70243]:     <acpi/>
Jul 24 16:18:28 user nova-compute[70243]:     <apic/>
Jul 24 16:18:28 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:18:28 user nova-compute[70243]:   </features>
Jul 24 16:18:28 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:18:28 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:18:28 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:18:28 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:18:28 user nova-compute[70243]:   </clock>
Jul 24 16:18:28 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:18:28 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:18:28 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:18:28 user nova-compute[70243]:   </cpu>
Jul 24 16:18:28 user nova-compute[70243]:   <devices>
Jul 24 16:18:28 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:18:28 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:18:28 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk"/>
Jul 24 16:18:28 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:18:28 user nova-compute[70243]:     </disk>
Jul 24 16:18:28 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:18:28 user nova-compute[70243]:       <mac address="fa:16:3e:bb:31:a5"/>
Jul 24 16:18:28 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:18:28 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:18:28 user nova-compute[70243]:       <target dev="tap0bfc720a-e7"/>
Jul 24 16:18:28 user nova-compute[70243]:     </interface>
Jul 24 16:18:28 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:18:28 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/console.log" append="off"/>
Jul 24 16:18:28 user nova-compute[70243]:     </serial>
Jul 24 16:18:28 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:18:28 user nova-compute[70243]:     <video>
Jul 24 16:18:28 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:18:28 user nova-compute[70243]:     </video>
Jul 24 16:18:28 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:18:28 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:18:28 user nova-compute[70243]:     </rng>
Jul 24 16:18:28 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:18:28 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:18:28 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:18:28 user nova-compute[70243]:     </memballoon>
Jul 24 16:18:28 user nova-compute[70243]:   </devices>
Jul 24 16:18:28 user nova-compute[70243]: </domain>
Jul 24 16:18:28 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:18:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-625221097',display_name='tempest-TestVolumeSwap-server-625221097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-625221097',id=9,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJ/6GGyx1iFH1aLbXDBI/tVztmCtMhcxG8x49FhD2BMWE83p8XS//eIcium/yItjUwpLQcYx12Ou8E0mxGcZi0pr+B65YyGCnSbEjKNId0m93egXbiIrr/5Q+ei+x+lsg==',key_name='tempest-keypair-1521821379',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18cd7d48387343179ba49b66c119c405',ramdisk_id='',reservation_id='r-aqkuk644',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1908203650',owner_user_name='tempest-TestVolumeSwap-1908203650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4e6f1d320714d0cafd63cbab32f11ea',uuid=5e6a5fff-570c-4ee2-b883-415ec828ef97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bfc720a-e7ed-4eb1-b945-6565c661adef", "address": "fa:16:3e:bb:31:a5", "network": {"id": "97e0a268-3307-41b7-a748-0a9f3dfc8629", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1229538256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18cd7d48387343179ba49b66c119c405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfc720a-e7", "ovs_interfaceid": "0bfc720a-e7ed-4eb1-b945-6565c661adef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Converting VIF {"id": "0bfc720a-e7ed-4eb1-b945-6565c661adef", "address": "fa:16:3e:bb:31:a5", "network": {"id": "97e0a268-3307-41b7-a748-0a9f3dfc8629", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1229538256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18cd7d48387343179ba49b66c119c405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfc720a-e7", "ovs_interfaceid": "0bfc720a-e7ed-4eb1-b945-6565c661adef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:31:a5,bridge_name='br-int',has_traffic_filtering=True,id=0bfc720a-e7ed-4eb1-b945-6565c661adef,network=Network(97e0a268-3307-41b7-a748-0a9f3dfc8629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfc720a-e7') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG os_vif [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:31:a5,bridge_name='br-int',has_traffic_filtering=True,id=0bfc720a-e7ed-4eb1-b945-6565c661adef,network=Network(97e0a268-3307-41b7-a748-0a9f3dfc8629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfc720a-e7') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bfc720a-e7, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0bfc720a-e7, col_values=(('external_ids', {'iface-id': '0bfc720a-e7ed-4eb1-b945-6565c661adef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:31:a5', 'vm-uuid': '5e6a5fff-570c-4ee2-b883-415ec828ef97'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:28 user nova-compute[70243]: INFO os_vif [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:31:a5,bridge_name='br-int',has_traffic_filtering=True,id=0bfc720a-e7ed-4eb1-b945-6565c661adef,network=Network(97e0a268-3307-41b7-a748-0a9f3dfc8629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfc720a-e7')
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] No VIF found with MAC fa:16:3e:bb:31:a5, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:18:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215509.045363, 8cd7a53c-c100-4e43-a9d6-0d4517239e15 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:18:29 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] VM Resumed (Lifecycle Event)
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.compute.manager [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:18:29 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Instance spawned successfully.
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:18:29 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Instance spawned successfully.
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:18:29 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215509.0475636, 8cd7a53c-c100-4e43-a9d6-0d4517239e15 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:18:29 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] VM Started (Lifecycle Event)
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:29 user nova-compute[70243]: INFO nova.compute.manager [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Took 12.65 seconds to spawn the instance on the hypervisor.
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.compute.manager [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:18:29 user nova-compute[70243]: INFO nova.compute.manager [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Took 11.07 seconds to spawn the instance on the hypervisor.
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:29 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215509.0884671, c2ee17ba-3482-4caf-992e-30b3953d1e91 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:18:29 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] VM Resumed (Lifecycle Event)
Jul 24 16:18:29 user nova-compute[70243]: INFO nova.compute.manager [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Took 13.90 seconds to build instance.
Jul 24 16:18:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-dafabe0c-489a-43e5-89ed-1ec6e62e4b3f tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.113s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:18:29 user nova-compute[70243]: INFO nova.compute.manager [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Took 13.82 seconds to build instance.
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215509.0919588, c2ee17ba-3482-4caf-992e-30b3953d1e91 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:18:29 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] VM Started (Lifecycle Event)
Jul 24 16:18:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b5f0381-8fbf-415a-a756-b13e92586905 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "c2ee17ba-3482-4caf-992e-30b3953d1e91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.068s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.compute.manager [req-b3fd1b62-65ee-416f-b60a-0db51cee61a8 req-350248a7-167f-410b-86fa-087b8eecbe50 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Received event network-changed-0bfc720a-e7ed-4eb1-b945-6565c661adef {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.compute.manager [req-b3fd1b62-65ee-416f-b60a-0db51cee61a8 req-350248a7-167f-410b-86fa-087b8eecbe50 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Refreshing instance network info cache due to event network-changed-0bfc720a-e7ed-4eb1-b945-6565c661adef. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b3fd1b62-65ee-416f-b60a-0db51cee61a8 req-350248a7-167f-410b-86fa-087b8eecbe50 service nova] Acquiring lock "refresh_cache-5e6a5fff-570c-4ee2-b883-415ec828ef97" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b3fd1b62-65ee-416f-b60a-0db51cee61a8 req-350248a7-167f-410b-86fa-087b8eecbe50 service nova] Acquired lock "refresh_cache-5e6a5fff-570c-4ee2-b883-415ec828ef97" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:18:29 user nova-compute[70243]: DEBUG nova.network.neutron [req-b3fd1b62-65ee-416f-b60a-0db51cee61a8 req-350248a7-167f-410b-86fa-087b8eecbe50 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Refreshing network info cache for port 0bfc720a-e7ed-4eb1-b945-6565c661adef {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:18:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:30 user nova-compute[70243]: DEBUG nova.network.neutron [req-b3fd1b62-65ee-416f-b60a-0db51cee61a8 req-350248a7-167f-410b-86fa-087b8eecbe50 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Updated VIF entry in instance network info cache for port 0bfc720a-e7ed-4eb1-b945-6565c661adef. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:18:30 user nova-compute[70243]: DEBUG nova.network.neutron [req-b3fd1b62-65ee-416f-b60a-0db51cee61a8 req-350248a7-167f-410b-86fa-087b8eecbe50 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Updating instance_info_cache with network_info: [{"id": "0bfc720a-e7ed-4eb1-b945-6565c661adef", "address": "fa:16:3e:bb:31:a5", "network": {"id": "97e0a268-3307-41b7-a748-0a9f3dfc8629", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1229538256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18cd7d48387343179ba49b66c119c405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfc720a-e7", "ovs_interfaceid": "0bfc720a-e7ed-4eb1-b945-6565c661adef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:18:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b3fd1b62-65ee-416f-b60a-0db51cee61a8 req-350248a7-167f-410b-86fa-087b8eecbe50 service nova] Releasing lock "refresh_cache-5e6a5fff-570c-4ee2-b883-415ec828ef97" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:18:31 user nova-compute[70243]: DEBUG nova.compute.manager [req-7753b0da-aec3-4cbd-9784-353e9af87330 req-5879e522-2e26-4ee7-bfd8-70adf70a0059 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Received event network-vif-plugged-0bfc720a-e7ed-4eb1-b945-6565c661adef {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7753b0da-aec3-4cbd-9784-353e9af87330 req-5879e522-2e26-4ee7-bfd8-70adf70a0059 service nova] Acquiring lock "5e6a5fff-570c-4ee2-b883-415ec828ef97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7753b0da-aec3-4cbd-9784-353e9af87330 req-5879e522-2e26-4ee7-bfd8-70adf70a0059 service nova] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7753b0da-aec3-4cbd-9784-353e9af87330 req-5879e522-2e26-4ee7-bfd8-70adf70a0059 service nova] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:31 user nova-compute[70243]: DEBUG nova.compute.manager [req-7753b0da-aec3-4cbd-9784-353e9af87330 req-5879e522-2e26-4ee7-bfd8-70adf70a0059 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] No waiting events found dispatching network-vif-plugged-0bfc720a-e7ed-4eb1-b945-6565c661adef {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:18:31 user nova-compute[70243]: WARNING nova.compute.manager [req-7753b0da-aec3-4cbd-9784-353e9af87330 req-5879e522-2e26-4ee7-bfd8-70adf70a0059 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Received unexpected event network-vif-plugged-0bfc720a-e7ed-4eb1-b945-6565c661adef for instance with vm_state building and task_state spawning.
Jul 24 16:18:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:33 user nova-compute[70243]: DEBUG nova.compute.manager [req-d85caf8e-0528-40bf-863b-28381aae2864 req-18b3fa78-6036-4c67-9295-c6dbcc9e3e45 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Received event network-vif-plugged-0bfc720a-e7ed-4eb1-b945-6565c661adef {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:18:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d85caf8e-0528-40bf-863b-28381aae2864 req-18b3fa78-6036-4c67-9295-c6dbcc9e3e45 service nova] Acquiring lock "5e6a5fff-570c-4ee2-b883-415ec828ef97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d85caf8e-0528-40bf-863b-28381aae2864 req-18b3fa78-6036-4c67-9295-c6dbcc9e3e45 service nova] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d85caf8e-0528-40bf-863b-28381aae2864 req-18b3fa78-6036-4c67-9295-c6dbcc9e3e45 service nova] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:33 user nova-compute[70243]: DEBUG nova.compute.manager [req-d85caf8e-0528-40bf-863b-28381aae2864 req-18b3fa78-6036-4c67-9295-c6dbcc9e3e45 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] No waiting events found dispatching network-vif-plugged-0bfc720a-e7ed-4eb1-b945-6565c661adef {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:18:33 user nova-compute[70243]: WARNING nova.compute.manager [req-d85caf8e-0528-40bf-863b-28381aae2864 req-18b3fa78-6036-4c67-9295-c6dbcc9e3e45 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Received unexpected event network-vif-plugged-0bfc720a-e7ed-4eb1-b945-6565c661adef for instance with vm_state building and task_state spawning.
Jul 24 16:18:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:33 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215513.9189963, 5e6a5fff-570c-4ee2-b883-415ec828ef97 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:18:33 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] VM Resumed (Lifecycle Event)
Jul 24 16:18:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:18:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:18:33 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Instance spawned successfully.
Jul 24 16:18:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:18:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:18:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:18:34 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:18:34 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215513.9203954, 5e6a5fff-570c-4ee2-b883-415ec828ef97 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:18:34 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] VM Started (Lifecycle Event)
Jul 24 16:18:34 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:34 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:18:34 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:18:34 user nova-compute[70243]: INFO nova.compute.manager [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Took 7.76 seconds to spawn the instance on the hypervisor.
Jul 24 16:18:34 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:18:34 user nova-compute[70243]: INFO nova.compute.manager [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Took 9.38 seconds to build instance.
Jul 24 16:18:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d25d9749-bf83-4908-a8ee-64e3b5544df8 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.589s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:34 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:18:34 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Cleaning up deleted instances {{(pid=70243) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 16:18:34 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] There are 0 instances to clean {{(pid=70243) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 16:18:34 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:18:34 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70243) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 16:18:34 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:18:35 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:18:36 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:18:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:36 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:18:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e637a0d4-d38e-46e0-8fde-3b45c2410439/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e637a0d4-d38e-46e0-8fde-3b45c2410439/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e637a0d4-d38e-46e0-8fde-3b45c2410439/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e637a0d4-d38e-46e0-8fde-3b45c2410439/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:18:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:18:40 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:18:40 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:18:40 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=7514MB free_disk=24.663063049316406GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:18:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:18:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:18:41 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance e637a0d4-d38e-46e0-8fde-3b45c2410439 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:18:41 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance de22ea98-b041-4f3f-8986-435c43267a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:18:41 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance de484cb2-7f20-4bf1-927b-c066735bfeca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:18:41 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance a13c243a-2b98-4ef1-b17c-e2e15ba005fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:18:41 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance ad611655-ba4d-4a66-b78e-a82c058f4414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:18:41 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5f70528b-33db-4257-96fe-e5fad869a224 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:18:41 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8cd7a53c-c100-4e43-a9d6-0d4517239e15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:18:41 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance c2ee17ba-3482-4caf-992e-30b3953d1e91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:18:41 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5e6a5fff-570c-4ee2-b883-415ec828ef97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:18:41 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:18:41 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:18:41 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:18:41 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:18:41 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:18:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.842s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:18:42 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:18:42 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:18:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:18:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 16:18:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-e637a0d4-d38e-46e0-8fde-3b45c2410439" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:18:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-e637a0d4-d38e-46e0-8fde-3b45c2410439" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:18:42 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:18:42 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lazy-loading 'info_cache' on Instance uuid e637a0d4-d38e-46e0-8fde-3b45c2410439 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:18:43 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Updating instance_info_cache with network_info: [{"id": "49a60955-c322-46d8-910d-31d4302f9f27", "address": "fa:16:3e:6b:ce:ba", "network": {"id": "57522509-2606-4962-aa15-fad15bf1dc6e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-863116301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcc401d03db549a7b4082dc30655d9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a60955-c3", "ovs_interfaceid": "49a60955-c322-46d8-910d-31d4302f9f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:18:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-e637a0d4-d38e-46e0-8fde-3b45c2410439" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:18:43 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:18:43 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:18:43 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:18:43 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:18:43 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:18:43 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:18:43 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:18:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:18:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:19:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:07 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:19:07 user nova-compute[70243]: INFO nova.compute.claims [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Claim successful on node user
Jul 24 16:19:07 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Refreshing inventories for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 16:19:07 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Updating ProviderTree inventory for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 16:19:07 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Updating inventory in ProviderTree for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 16:19:07 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Refreshing aggregate associations for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0, aggregates: None {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 16:19:07 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Refreshing trait associations for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0, traits: HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 16:19:07 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:19:08 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:19:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:08 user nova-compute[70243]: DEBUG nova.compute.manager [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:19:08 user nova-compute[70243]: DEBUG nova.compute.manager [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:19:08 user nova-compute[70243]: DEBUG nova.network.neutron [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:19:08 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:19:08 user nova-compute[70243]: DEBUG nova.compute.manager [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:19:08 user nova-compute[70243]: INFO nova.virt.block_device [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Booting with volume 2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 at /dev/vda
Jul 24 16:19:08 user nova-compute[70243]: DEBUG os_brick.utils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:19:08 user nova-compute[70243]: INFO oslo.privsep.daemon [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp3_5sxpap/privsep.sock']
Jul 24 16:19:08 user sudo[81257]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp3_5sxpap/privsep.sock
Jul 24 16:19:08 user sudo[81257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 24 16:19:08 user nova-compute[70243]: DEBUG nova.policy [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c02b728391bb474eb7081a2e64d7b15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cefa0481ae64474dbe0b5954a6de0b40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:19:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:09 user nova-compute[70243]: DEBUG nova.network.neutron [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Successfully created port: 6d0870b4-5264-46ca-a291-3c99a1c27546 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:19:09 user nova-compute[70243]: DEBUG nova.network.neutron [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Successfully created port: f5f10c24-54e5-4105-b3a0-92771126688c {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:19:10 user sudo[81257]: pam_unix(sudo:session): session closed for user root
Jul 24 16:19:10 user nova-compute[70243]: INFO oslo.privsep.daemon [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Spawned new privsep daemon via rootwrap
Jul 24 16:19:10 user nova-compute[70243]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 24 16:19:10 user nova-compute[70243]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 24 16:19:10 user nova-compute[70243]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Jul 24 16:19:10 user nova-compute[70243]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81266
Jul 24 16:19:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ad2183-0c4f-4042-993d-3af1713b5b30]: (2,) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:10 user nova-compute[70243]: DEBUG nova.network.neutron [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Successfully created port: e6ac05d7-63c0-477d-89f5-d2612b39e976 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:19:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[981ec849-670b-4403-a0c2-2753c03e7b9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:10 user nova-compute[70243]: WARNING os_brick.initiator.connectors.nvmeof [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Jul 24 16:19:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5d184f-2f42-4f4b-bc4f-769e5a382129]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[442c5519-893a-4947-8be9-614f416038a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1046580-bc99-43b8-b4ca-d50eab7d23e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:19:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:19:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:19:10 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:19:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddadff4-b525-4010-870f-66fa3f3a45dd]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:19:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:19:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:19:10 user nova-compute[70243]: DEBUG os_brick.utils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] <== get_connector_properties: return (2059ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:19:10 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Updating existing volume attachment record: f7843b0f-f810-4325-9042-7e985341e5d9 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:19:11 user nova-compute[70243]: DEBUG nova.network.neutron [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Successfully created port: 5980d7b6-c38c-4388-976b-039bcf31e766 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:19:11 user nova-compute[70243]: DEBUG nova.network.neutron [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Successfully created port: 4b19372c-785f-4c41-8e00-31689097491b {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:19:12 user nova-compute[70243]: DEBUG nova.network.neutron [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Successfully updated port: 6d0870b4-5264-46ca-a291-3c99a1c27546 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:19:12 user nova-compute[70243]: DEBUG nova.compute.manager [req-8b83db00-9711-4743-860b-c4be8c08596f req-0b2d12c8-634e-4f75-b6ef-3433974b1076 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-changed-6d0870b4-5264-46ca-a291-3c99a1c27546 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:12 user nova-compute[70243]: DEBUG nova.compute.manager [req-8b83db00-9711-4743-860b-c4be8c08596f req-0b2d12c8-634e-4f75-b6ef-3433974b1076 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Refreshing instance network info cache due to event network-changed-6d0870b4-5264-46ca-a291-3c99a1c27546. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:19:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8b83db00-9711-4743-860b-c4be8c08596f req-0b2d12c8-634e-4f75-b6ef-3433974b1076 service nova] Acquiring lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:19:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8b83db00-9711-4743-860b-c4be8c08596f req-0b2d12c8-634e-4f75-b6ef-3433974b1076 service nova] Acquired lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:19:12 user nova-compute[70243]: DEBUG nova.network.neutron [req-8b83db00-9711-4743-860b-c4be8c08596f req-0b2d12c8-634e-4f75-b6ef-3433974b1076 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Refreshing network info cache for port 6d0870b4-5264-46ca-a291-3c99a1c27546 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:19:12 user nova-compute[70243]: DEBUG nova.network.neutron [req-8b83db00-9711-4743-860b-c4be8c08596f req-0b2d12c8-634e-4f75-b6ef-3433974b1076 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:19:13 user nova-compute[70243]: DEBUG nova.network.neutron [req-8b83db00-9711-4743-860b-c4be8c08596f req-0b2d12c8-634e-4f75-b6ef-3433974b1076 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:19:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8b83db00-9711-4743-860b-c4be8c08596f req-0b2d12c8-634e-4f75-b6ef-3433974b1076 service nova] Releasing lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:19:13 user nova-compute[70243]: DEBUG nova.network.neutron [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Successfully updated port: 9b943a9e-f326-4526-8e6c-0462cb3860a4 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:19:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:14 user nova-compute[70243]: DEBUG nova.network.neutron [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Successfully updated port: 2b3b9944-66d7-44fb-b3fe-b361e73a8509 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:19:14 user nova-compute[70243]: DEBUG nova.compute.manager [req-124c1a85-8dd2-4206-b130-b5cf220b6abe req-fdea2601-6e6b-4693-8899-4f87a1fe82a4 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-changed-9b943a9e-f326-4526-8e6c-0462cb3860a4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:14 user nova-compute[70243]: DEBUG nova.compute.manager [req-124c1a85-8dd2-4206-b130-b5cf220b6abe req-fdea2601-6e6b-4693-8899-4f87a1fe82a4 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Refreshing instance network info cache due to event network-changed-9b943a9e-f326-4526-8e6c-0462cb3860a4. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:19:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-124c1a85-8dd2-4206-b130-b5cf220b6abe req-fdea2601-6e6b-4693-8899-4f87a1fe82a4 service nova] Acquiring lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:19:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-124c1a85-8dd2-4206-b130-b5cf220b6abe req-fdea2601-6e6b-4693-8899-4f87a1fe82a4 service nova] Acquired lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:19:14 user nova-compute[70243]: DEBUG nova.network.neutron [req-124c1a85-8dd2-4206-b130-b5cf220b6abe req-fdea2601-6e6b-4693-8899-4f87a1fe82a4 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Refreshing network info cache for port 9b943a9e-f326-4526-8e6c-0462cb3860a4 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:19:15 user nova-compute[70243]: DEBUG nova.network.neutron [req-124c1a85-8dd2-4206-b130-b5cf220b6abe req-fdea2601-6e6b-4693-8899-4f87a1fe82a4 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:19:15 user nova-compute[70243]: DEBUG nova.network.neutron [req-124c1a85-8dd2-4206-b130-b5cf220b6abe req-fdea2601-6e6b-4693-8899-4f87a1fe82a4 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:19:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-124c1a85-8dd2-4206-b130-b5cf220b6abe req-fdea2601-6e6b-4693-8899-4f87a1fe82a4 service nova] Releasing lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:19:15 user nova-compute[70243]: DEBUG nova.compute.manager [req-124c1a85-8dd2-4206-b130-b5cf220b6abe req-fdea2601-6e6b-4693-8899-4f87a1fe82a4 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-changed-2b3b9944-66d7-44fb-b3fe-b361e73a8509 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:15 user nova-compute[70243]: DEBUG nova.compute.manager [req-124c1a85-8dd2-4206-b130-b5cf220b6abe req-fdea2601-6e6b-4693-8899-4f87a1fe82a4 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Refreshing instance network info cache due to event network-changed-2b3b9944-66d7-44fb-b3fe-b361e73a8509. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:19:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-124c1a85-8dd2-4206-b130-b5cf220b6abe req-fdea2601-6e6b-4693-8899-4f87a1fe82a4 service nova] Acquiring lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:19:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-124c1a85-8dd2-4206-b130-b5cf220b6abe req-fdea2601-6e6b-4693-8899-4f87a1fe82a4 service nova] Acquired lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:19:15 user nova-compute[70243]: DEBUG nova.network.neutron [req-124c1a85-8dd2-4206-b130-b5cf220b6abe req-fdea2601-6e6b-4693-8899-4f87a1fe82a4 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Refreshing network info cache for port 2b3b9944-66d7-44fb-b3fe-b361e73a8509 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:19:15 user nova-compute[70243]: DEBUG nova.network.neutron [req-124c1a85-8dd2-4206-b130-b5cf220b6abe req-fdea2601-6e6b-4693-8899-4f87a1fe82a4 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:19:15 user nova-compute[70243]: DEBUG nova.network.neutron [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Successfully updated port: f5f10c24-54e5-4105-b3a0-92771126688c {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:19:15 user nova-compute[70243]: DEBUG nova.network.neutron [req-124c1a85-8dd2-4206-b130-b5cf220b6abe req-fdea2601-6e6b-4693-8899-4f87a1fe82a4 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:19:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-124c1a85-8dd2-4206-b130-b5cf220b6abe req-fdea2601-6e6b-4693-8899-4f87a1fe82a4 service nova] Releasing lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:19:16 user nova-compute[70243]: DEBUG nova.network.neutron [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Successfully updated port: e6ac05d7-63c0-477d-89f5-d2612b39e976 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:19:16 user nova-compute[70243]: DEBUG nova.compute.manager [req-dbc5a3c2-14ff-47bd-a95b-b2ad1ecc6937 req-b25d852b-8f3f-4769-9815-1b9f28634ed5 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-changed-f5f10c24-54e5-4105-b3a0-92771126688c {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:16 user nova-compute[70243]: DEBUG nova.compute.manager [req-dbc5a3c2-14ff-47bd-a95b-b2ad1ecc6937 req-b25d852b-8f3f-4769-9815-1b9f28634ed5 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Refreshing instance network info cache due to event network-changed-f5f10c24-54e5-4105-b3a0-92771126688c. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:19:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbc5a3c2-14ff-47bd-a95b-b2ad1ecc6937 req-b25d852b-8f3f-4769-9815-1b9f28634ed5 service nova] Acquiring lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:19:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbc5a3c2-14ff-47bd-a95b-b2ad1ecc6937 req-b25d852b-8f3f-4769-9815-1b9f28634ed5 service nova] Acquired lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:19:16 user nova-compute[70243]: DEBUG nova.network.neutron [req-dbc5a3c2-14ff-47bd-a95b-b2ad1ecc6937 req-b25d852b-8f3f-4769-9815-1b9f28634ed5 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Refreshing network info cache for port f5f10c24-54e5-4105-b3a0-92771126688c {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:19:17 user nova-compute[70243]: INFO nova.virt.block_device [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Booting with volume 3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 at /dev/vdb
Jul 24 16:19:17 user nova-compute[70243]: DEBUG os_brick.utils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0850ea33-0865-47cf-a077-2ec68c404ead]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ca5514-c77a-4a88-862f-134a72a0e950]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7ccb94-098c-4796-a343-9687832c7761]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f5d32a-8529-464a-8a6c-f1f1565c3dd3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:19:17 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:19:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4cc539-a3a5-4cfc-81dc-b9b3412f21fe]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG os_brick.utils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Updating existing volume attachment record: 29e30cf0-0a7a-4330-845e-9fa64419776a {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG nova.network.neutron [req-dbc5a3c2-14ff-47bd-a95b-b2ad1ecc6937 req-b25d852b-8f3f-4769-9815-1b9f28634ed5 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG nova.network.neutron [req-dbc5a3c2-14ff-47bd-a95b-b2ad1ecc6937 req-b25d852b-8f3f-4769-9815-1b9f28634ed5 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbc5a3c2-14ff-47bd-a95b-b2ad1ecc6937 req-b25d852b-8f3f-4769-9815-1b9f28634ed5 service nova] Releasing lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG nova.compute.manager [req-dbc5a3c2-14ff-47bd-a95b-b2ad1ecc6937 req-b25d852b-8f3f-4769-9815-1b9f28634ed5 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-changed-e6ac05d7-63c0-477d-89f5-d2612b39e976 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG nova.compute.manager [req-dbc5a3c2-14ff-47bd-a95b-b2ad1ecc6937 req-b25d852b-8f3f-4769-9815-1b9f28634ed5 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Refreshing instance network info cache due to event network-changed-e6ac05d7-63c0-477d-89f5-d2612b39e976. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbc5a3c2-14ff-47bd-a95b-b2ad1ecc6937 req-b25d852b-8f3f-4769-9815-1b9f28634ed5 service nova] Acquiring lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbc5a3c2-14ff-47bd-a95b-b2ad1ecc6937 req-b25d852b-8f3f-4769-9815-1b9f28634ed5 service nova] Acquired lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG nova.network.neutron [req-dbc5a3c2-14ff-47bd-a95b-b2ad1ecc6937 req-b25d852b-8f3f-4769-9815-1b9f28634ed5 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Refreshing network info cache for port e6ac05d7-63c0-477d-89f5-d2612b39e976 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:19:17 user nova-compute[70243]: DEBUG nova.network.neutron [req-dbc5a3c2-14ff-47bd-a95b-b2ad1ecc6937 req-b25d852b-8f3f-4769-9815-1b9f28634ed5 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:19:18 user nova-compute[70243]: DEBUG nova.network.neutron [req-dbc5a3c2-14ff-47bd-a95b-b2ad1ecc6937 req-b25d852b-8f3f-4769-9815-1b9f28634ed5 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:19:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbc5a3c2-14ff-47bd-a95b-b2ad1ecc6937 req-b25d852b-8f3f-4769-9815-1b9f28634ed5 service nova] Releasing lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:19:18 user nova-compute[70243]: DEBUG nova.network.neutron [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Successfully updated port: 5980d7b6-c38c-4388-976b-039bcf31e766 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:19:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:19:19 user nova-compute[70243]: DEBUG nova.network.neutron [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Successfully updated port: 4b19372c-785f-4c41-8e00-31689097491b {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:19:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Acquiring lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:19:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Acquired lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:19:19 user nova-compute[70243]: DEBUG nova.network.neutron [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:19:19 user nova-compute[70243]: DEBUG nova.network.neutron [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:19:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-b67913fe-5d45-40db-80f9-0d429ef7301c req-bf797990-9bb4-4f31-8f8b-cdc57f09ca84 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-changed-5980d7b6-c38c-4388-976b-039bcf31e766 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-b67913fe-5d45-40db-80f9-0d429ef7301c req-bf797990-9bb4-4f31-8f8b-cdc57f09ca84 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Refreshing instance network info cache due to event network-changed-5980d7b6-c38c-4388-976b-039bcf31e766. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:19:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b67913fe-5d45-40db-80f9-0d429ef7301c req-bf797990-9bb4-4f31-8f8b-cdc57f09ca84 service nova] Acquiring lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:19:21 user nova-compute[70243]: DEBUG nova.network.neutron [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Updating instance_info_cache with network_info: [{"id": "6d0870b4-5264-46ca-a291-3c99a1c27546", "address": "fa:16:3e:c6:f9:65", "network": {"id": "9da02be9-9a4a-40bb-8a9b-9399b8f16521", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1533875048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0870b4-52", "ovs_interfaceid": "6d0870b4-5264-46ca-a291-3c99a1c27546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "address": "fa:16:3e:a3:85:6c", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b943a9e-f3", "ovs_interfaceid": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "address": "fa:16:3e:13:6a:d5", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3b9944-66", "ovs_interfaceid": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5f10c24-54e5-4105-b3a0-92771126688c", "address": "fa:16:3e:8b:c5:06", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f10c24-54", "ovs_interfaceid": "f5f10c24-54e5-4105-b3a0-92771126688c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "address": "fa:16:3e:06:13:18", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ac05d7-63", "ovs_interfaceid": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5980d7b6-c38c-4388-976b-039bcf31e766", "address": "fa:16:3e:a4:99:41", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5980d7b6-c3", "ovs_interfaceid": "5980d7b6-c38c-4388-976b-039bcf31e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b19372c-785f-4c41-8e00-31689097491b", "address": "fa:16:3e:ca:61:08", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b19372c-78", "ovs_interfaceid": "4b19372c-785f-4c41-8e00-31689097491b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:19:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Releasing lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:19:21 user nova-compute[70243]: DEBUG nova.compute.manager [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Instance network_info: |[{"id": "6d0870b4-5264-46ca-a291-3c99a1c27546", "address": "fa:16:3e:c6:f9:65", "network": {"id": "9da02be9-9a4a-40bb-8a9b-9399b8f16521", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1533875048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0870b4-52", "ovs_interfaceid": "6d0870b4-5264-46ca-a291-3c99a1c27546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "address": "fa:16:3e:a3:85:6c", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b943a9e-f3", "ovs_interfaceid": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "address": "fa:16:3e:13:6a:d5", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3b9944-66", "ovs_interfaceid": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5f10c24-54e5-4105-b3a0-92771126688c", "address": "fa:16:3e:8b:c5:06", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f10c24-54", "ovs_interfaceid": "f5f10c24-54e5-4105-b3a0-92771126688c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "address": "fa:16:3e:06:13:18", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ac05d7-63", "ovs_interfaceid": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5980d7b6-c38c-4388-976b-039bcf31e766", "address": "fa:16:3e:a4:99:41", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5980d7b6-c3", "ovs_interfaceid": "5980d7b6-c38c-4388-976b-039bcf31e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b19372c-785f-4c41-8e00-31689097491b", "address": "fa:16:3e:ca:61:08", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b19372c-78", "ovs_interfaceid": "4b19372c-785f-4c41-8e00-31689097491b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:19:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b67913fe-5d45-40db-80f9-0d429ef7301c req-bf797990-9bb4-4f31-8f8b-cdc57f09ca84 service nova] Acquired lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:19:21 user nova-compute[70243]: DEBUG nova.network.neutron [req-b67913fe-5d45-40db-80f9-0d429ef7301c req-bf797990-9bb4-4f31-8f8b-cdc57f09ca84 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Refreshing network info cache for port 5980d7b6-c38c-4388-976b-039bcf31e766 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:19:22 user nova-compute[70243]: DEBUG nova.network.neutron [req-b67913fe-5d45-40db-80f9-0d429ef7301c req-bf797990-9bb4-4f31-8f8b-cdc57f09ca84 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Updated VIF entry in instance network info cache for port 5980d7b6-c38c-4388-976b-039bcf31e766. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:19:22 user nova-compute[70243]: DEBUG nova.network.neutron [req-b67913fe-5d45-40db-80f9-0d429ef7301c req-bf797990-9bb4-4f31-8f8b-cdc57f09ca84 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Updating instance_info_cache with network_info: [{"id": "6d0870b4-5264-46ca-a291-3c99a1c27546", "address": "fa:16:3e:c6:f9:65", "network": {"id": "9da02be9-9a4a-40bb-8a9b-9399b8f16521", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1533875048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0870b4-52", "ovs_interfaceid": "6d0870b4-5264-46ca-a291-3c99a1c27546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "address": "fa:16:3e:a3:85:6c", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b943a9e-f3", "ovs_interfaceid": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "address": "fa:16:3e:13:6a:d5", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3b9944-66", "ovs_interfaceid": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5f10c24-54e5-4105-b3a0-92771126688c", "address": "fa:16:3e:8b:c5:06", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f10c24-54", "ovs_interfaceid": "f5f10c24-54e5-4105-b3a0-92771126688c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "address": "fa:16:3e:06:13:18", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ac05d7-63", "ovs_interfaceid": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5980d7b6-c38c-4388-976b-039bcf31e766", "address": "fa:16:3e:a4:99:41", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5980d7b6-c3", "ovs_interfaceid": "5980d7b6-c38c-4388-976b-039bcf31e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b19372c-785f-4c41-8e00-31689097491b", "address": "fa:16:3e:ca:61:08", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b19372c-78", "ovs_interfaceid": "4b19372c-785f-4c41-8e00-31689097491b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:19:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b67913fe-5d45-40db-80f9-0d429ef7301c req-bf797990-9bb4-4f31-8f8b-cdc57f09ca84 service nova] Releasing lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:19:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-b67913fe-5d45-40db-80f9-0d429ef7301c req-bf797990-9bb4-4f31-8f8b-cdc57f09ca84 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-changed-4b19372c-785f-4c41-8e00-31689097491b {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-b67913fe-5d45-40db-80f9-0d429ef7301c req-bf797990-9bb4-4f31-8f8b-cdc57f09ca84 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Refreshing instance network info cache due to event network-changed-4b19372c-785f-4c41-8e00-31689097491b. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:19:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b67913fe-5d45-40db-80f9-0d429ef7301c req-bf797990-9bb4-4f31-8f8b-cdc57f09ca84 service nova] Acquiring lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:19:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b67913fe-5d45-40db-80f9-0d429ef7301c req-bf797990-9bb4-4f31-8f8b-cdc57f09ca84 service nova] Acquired lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:19:22 user nova-compute[70243]: DEBUG nova.network.neutron [req-b67913fe-5d45-40db-80f9-0d429ef7301c req-bf797990-9bb4-4f31-8f8b-cdc57f09ca84 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Refreshing network info cache for port 4b19372c-785f-4c41-8e00-31689097491b {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:19:23 user nova-compute[70243]: DEBUG nova.network.neutron [req-b67913fe-5d45-40db-80f9-0d429ef7301c req-bf797990-9bb4-4f31-8f8b-cdc57f09ca84 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Updated VIF entry in instance network info cache for port 4b19372c-785f-4c41-8e00-31689097491b. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:19:23 user nova-compute[70243]: DEBUG nova.network.neutron [req-b67913fe-5d45-40db-80f9-0d429ef7301c req-bf797990-9bb4-4f31-8f8b-cdc57f09ca84 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Updating instance_info_cache with network_info: [{"id": "6d0870b4-5264-46ca-a291-3c99a1c27546", "address": "fa:16:3e:c6:f9:65", "network": {"id": "9da02be9-9a4a-40bb-8a9b-9399b8f16521", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1533875048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0870b4-52", "ovs_interfaceid": "6d0870b4-5264-46ca-a291-3c99a1c27546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "address": "fa:16:3e:a3:85:6c", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b943a9e-f3", "ovs_interfaceid": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "address": "fa:16:3e:13:6a:d5", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3b9944-66", "ovs_interfaceid": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5f10c24-54e5-4105-b3a0-92771126688c", "address": "fa:16:3e:8b:c5:06", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f10c24-54", "ovs_interfaceid": "f5f10c24-54e5-4105-b3a0-92771126688c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "address": "fa:16:3e:06:13:18", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ac05d7-63", "ovs_interfaceid": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5980d7b6-c38c-4388-976b-039bcf31e766", "address": "fa:16:3e:a4:99:41", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5980d7b6-c3", "ovs_interfaceid": "5980d7b6-c38c-4388-976b-039bcf31e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b19372c-785f-4c41-8e00-31689097491b", "address": "fa:16:3e:ca:61:08", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b19372c-78", "ovs_interfaceid": "4b19372c-785f-4c41-8e00-31689097491b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:19:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b67913fe-5d45-40db-80f9-0d429ef7301c req-bf797990-9bb4-4f31-8f8b-cdc57f09ca84 service nova] Releasing lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:19:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:19:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:19:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:19:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:19:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:24 user nova-compute[70243]: INFO nova.virt.block_device [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Booting with volume 5d989fc2-833f-4097-bab6-738135612e1c at /dev/vdc
Jul 24 16:19:24 user nova-compute[70243]: DEBUG os_brick.utils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:19:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[69282960-8dfa-4450-b6a1-2358d1a6711d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eeb5ead-6a51-44a5-bb5e-5eaa8c298d11]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[594486aa-6080-4eb2-8c76-b0acf94d7bc1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[98902e04-f80b-4dc5-a2e7-b2ba0f911cf1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:19:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:19:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:19:24 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:19:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a708985-71fc-4e60-822c-5aec3502d193]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:19:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:19:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:19:24 user nova-compute[70243]: DEBUG os_brick.utils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:19:24 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Updating existing volume attachment record: a4f4e0cf-bee9-4675-adbe-974074989d09 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:19:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:19:33 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Creating image(s)
Jul 24 16:19:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Did not create local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Ensure instance console log exists: /opt/stack/data/nova/instances/236d3139-0c65-41af-a1a6-bc36e51fbf50/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Start _get_guest_xml network_info=[{"id": "6d0870b4-5264-46ca-a291-3c99a1c27546", "address": "fa:16:3e:c6:f9:65", "network": {"id": "9da02be9-9a4a-40bb-8a9b-9399b8f16521", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1533875048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0870b4-52", "ovs_interfaceid": "6d0870b4-5264-46ca-a291-3c99a1c27546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "address": "fa:16:3e:a3:85:6c", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b943a9e-f3", "ovs_interfaceid": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "address": "fa:16:3e:13:6a:d5", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3b9944-66", "ovs_interfaceid": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5f10c24-54e5-4105-b3a0-92771126688c", "address": "fa:16:3e:8b:c5:06", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f10c24-54", "ovs_interfaceid": "f5f10c24-54e5-4105-b3a0-92771126688c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "address": "fa:16:3e:06:13:18", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ac05d7-63", "ovs_interfaceid": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5980d7b6-c38c-4388-976b-039bcf31e766", "address": "fa:16:3e:a4:99:41", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5980d7b6-c3", "ovs_interfaceid": "5980d7b6-c38c-4388-976b-039bcf31e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b19372c-785f-4c41-8e00-31689097491b", "address": "fa:16:3e:ca:61:08", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b19372c-78", "ovs_interfaceid": "4b19372c-785f-4c41-8e00-31689097491b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwWUvBtN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '236d3139-0c65-41af-a1a6-bc36e51fbf50', 'attached_at': '', 'detached_at': '', 'volume_id': '2b92ea51-d2d2-4ecd-abbc-c288df9b3d22', 'serial': '2b92ea51-d2d2-4ecd-abbc-c288df9b3d22'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'f7843b0f-f810-4325-9042-7e985341e5d9', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXcawieE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '236d3139-0c65-41af-a1a6-bc36e51fbf50', 'attached_at': '', 'detached_at': '', 'volume_id': '3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0', 'serial': '3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0'}, 'disk_bus': 'virtio', 'boot_index': 1, 'attachment_id': '29e30cf0-0a7a-4330-845e-9fa64419776a', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IqjUpuRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '236d3139-0c65-41af-a1a6-bc36e51fbf50', 'attached_at': '', 'detached_at': '', 'volume_id': '5d989fc2-833f-4097-bab6-738135612e1c', 'serial': '5d989fc2-833f-4097-bab6-738135612e1c'}, 'disk_bus': 'virtio', 'boot_index': 2, 'attachment_id': 'a4f4e0cf-bee9-4675-adbe-974074989d09', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:19:33 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:19:33 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:19:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.connector [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Factory for ISCSI on None {{(pid=70243) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwWUvBtN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:19:33 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:19:33 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:19:33 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c57e8ff-6a19-4312-8b65-6774fddb31c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:19:33 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[961d4046-aed3-4e43-a14e-0b6cae598605]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22] added
Jul 24 16:19:33 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc54cf8-cb80-4c26-a6fd-2e49f39ecaab]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8184df8-c1d6-4e76-91b2-21d602b29b17]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iwWUvBtN {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iwWUvBtN" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec65b741-6ae1-4437-9747-917f2e9a7016]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iwWUvBtN'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d638b8c-64ea-479c-b2cc-ff00dad64e5f]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[594dc24d-71a5-428e-b1ae-973762c786a6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 16:19:33 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 16:19:33 user nova-compute[70243]:  {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:19:33 user nova-compute[70243]: WARNING os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 16:19:33 user nova-compute[70243]: 
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48c850f-693c-4778-969e-5c506633a818]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22, portal: 172.16.0.220,3260]
Jul 24 16:19:33 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22, portal: 172.16.0.220,3260] successful.
Jul 24 16:19:33 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27b5b52-2962-4270-8ddc-084e05d287ad]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2166971e-d420-4b36-a9cf-52992bc5685b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:19:33 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:19:33 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5600b88c-a6cb-4ae1-b90c-5b3144b252ef]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:19:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwWUvBtN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23633303237323365', 'path': '/dev/sdb'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633303237323365', 'path': '/dev/sdb'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXcawieE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:19:34 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:19:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:19:34 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:19:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:19:34 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e55a80f-d3a4-46d0-9c59-af7d5ab44c96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:19:34 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4073a50d-fcdc-460f-9541-79b72df0d519]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0] added
Jul 24 16:19:34 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[de22beb8-33fb-47f5-b1f9-643987387cd0]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[959c8704-228f-48e8-924c-6c416f993132]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oXcawieE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oXcawieE" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07e2f44-16df-4ca0-85cd-2c8153164e31]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oXcawieE'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[62315a76-8506-4462-827d-e9379a7415ff]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b53e62-02d6-4220-8c16-22dfef020f38]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:19:34 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:19:34 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[088fe418-944d-473b-ab89-2e7558d81771]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0, portal: 172.16.0.220,3260]
Jul 24 16:19:34 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0, portal: 172.16.0.220,3260] successful.
Jul 24 16:19:34 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f27f1b-489f-444f-ab4b-4d0ad7f7c490]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:35 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:35 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e1f6e2-843e-40cf-9241-f5abf5a857c2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:35 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:19:35 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:19:35 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:19:35 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:19:35 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:19:35 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:19:35 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:19:35 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:19:35 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:19:35 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:19:35 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:35 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:35 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4adcc6-9809-4a84-a3a4-721c138e1ca0]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:35 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXcawieE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23839343332396136', 'path': '/dev/sdc'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839343332396136', 'path': '/dev/sdc'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IqjUpuRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:19:36 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:19:36 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:19:36 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c93d34-d424-420d-ab77-e6bc9a44d303]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:19:36 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[718c537b-1818-450c-9459-83001199d6d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c] added
Jul 24 16:19:36 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e24c5db-6739-42e9-9033-b52aa2598cba]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fb6d5f-8103-4772-80af-bd6bfa64bee3]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IqjUpuRW {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IqjUpuRW" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[847abf37-8fae-4953-b947-dc25600812e3]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IqjUpuRW'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc62ecb-caab-450b-a413-4e15c1bc0c81]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0460718a-19ee-4879-bd7b-f1d4a70c0af2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:19:36 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:19:36 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:19:36 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:19:36 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f1da02-9c37-41b0-8077-dd4104defbc4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c, portal: 172.16.0.220,3260]
Jul 24 16:19:36 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c, portal: 172.16.0.220,3260] successful.
Jul 24 16:19:36 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11133fd-bada-4c9e-a4af-5f3ff776d570]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0059ce0e-5774-4697-a768-598dc295de29]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:19:36 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:19:36 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:19:36 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:19:36 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:19:36 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:19:36 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[462b55ca-74ca-41b2-b4ac-71e4612d0afd]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IqjUpuRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23936626234313563', 'path': '/dev/sdd'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936626234313563', 'path': '/dev/sdd'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886786644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886786644',id=10,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlv4t3K+Qy3iAO7FEiNwwuKyhz0EnhUcDcVbeNLKy1sZWX89xnIt2kiGwDG/4BR29Vhm+arEM5lXG7Xl4NdAZQPuodnhqbf5k2kB4g2FtlrUPKC21J6eEd+lFNH5Kx+JA==',key_name='tempest-keypair-1323717061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cefa0481ae64474dbe0b5954a6de0b40',ramdisk_id='',reservation_id='r-1qnhs5b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-151685023',owner_user_name='tempest-TaggedBootDevicesTest-151685023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c02b728391bb474eb7081a2e64d7b15e',uuid=236d3139-0c65-41af-a1a6-bc36e51fbf50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d0870b4-5264-46ca-a291-3c99a1c27546", "address": "fa:16:3e:c6:f9:65", "network": {"id": "9da02be9-9a4a-40bb-8a9b-9399b8f16521", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1533875048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0870b4-52", "ovs_interfaceid": "6d0870b4-5264-46ca-a291-3c99a1c27546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converting VIF {"id": "6d0870b4-5264-46ca-a291-3c99a1c27546", "address": "fa:16:3e:c6:f9:65", "network": {"id": "9da02be9-9a4a-40bb-8a9b-9399b8f16521", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1533875048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0870b4-52", "ovs_interfaceid": "6d0870b4-5264-46ca-a291-3c99a1c27546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:f9:65,bridge_name='br-int',has_traffic_filtering=True,id=6d0870b4-5264-46ca-a291-3c99a1c27546,network=Network(9da02be9-9a4a-40bb-8a9b-9399b8f16521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0870b4-52') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886786644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886786644',id=10,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlv4t3K+Qy3iAO7FEiNwwuKyhz0EnhUcDcVbeNLKy1sZWX89xnIt2kiGwDG/4BR29Vhm+arEM5lXG7Xl4NdAZQPuodnhqbf5k2kB4g2FtlrUPKC21J6eEd+lFNH5Kx+JA==',key_name='tempest-keypair-1323717061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cefa0481ae64474dbe0b5954a6de0b40',ramdisk_id='',reservation_id='r-1qnhs5b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-151685023',owner_user_name='tempest-TaggedBootDevicesTest-151685023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c02b728391bb474eb7081a2e64d7b15e',uuid=236d3139-0c65-41af-a1a6-bc36e51fbf50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "address": "fa:16:3e:a3:85:6c", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b943a9e-f3", "ovs_interfaceid": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converting VIF {"id": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "address": "fa:16:3e:a3:85:6c", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b943a9e-f3", "ovs_interfaceid": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:85:6c,bridge_name='br-int',has_traffic_filtering=True,id=9b943a9e-f326-4526-8e6c-0462cb3860a4,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b943a9e-f3') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886786644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886786644',id=10,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlv4t3K+Qy3iAO7FEiNwwuKyhz0EnhUcDcVbeNLKy1sZWX89xnIt2kiGwDG/4BR29Vhm+arEM5lXG7Xl4NdAZQPuodnhqbf5k2kB4g2FtlrUPKC21J6eEd+lFNH5Kx+JA==',key_name='tempest-keypair-1323717061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cefa0481ae64474dbe0b5954a6de0b40',ramdisk_id='',reservation_id='r-1qnhs5b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-151685023',owner_user_name='tempest-TaggedBootDevicesTest-151685023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c02b728391bb474eb7081a2e64d7b15e',uuid=236d3139-0c65-41af-a1a6-bc36e51fbf50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "address": "fa:16:3e:13:6a:d5", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3b9944-66", "ovs_interfaceid": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converting VIF {"id": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "address": "fa:16:3e:13:6a:d5", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3b9944-66", "ovs_interfaceid": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:6a:d5,bridge_name='br-int',has_traffic_filtering=True,id=2b3b9944-66d7-44fb-b3fe-b361e73a8509,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2b3b9944-66') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886786644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886786644',id=10,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlv4t3K+Qy3iAO7FEiNwwuKyhz0EnhUcDcVbeNLKy1sZWX89xnIt2kiGwDG/4BR29Vhm+arEM5lXG7Xl4NdAZQPuodnhqbf5k2kB4g2FtlrUPKC21J6eEd+lFNH5Kx+JA==',key_name='tempest-keypair-1323717061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cefa0481ae64474dbe0b5954a6de0b40',ramdisk_id='',reservation_id='r-1qnhs5b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-151685023',owner_user_name='tempest-TaggedBootDevicesTest-151685023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c02b728391bb474eb7081a2e64d7b15e',uuid=236d3139-0c65-41af-a1a6-bc36e51fbf50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5f10c24-54e5-4105-b3a0-92771126688c", "address": "fa:16:3e:8b:c5:06", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f10c24-54", "ovs_interfaceid": "f5f10c24-54e5-4105-b3a0-92771126688c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converting VIF {"id": "f5f10c24-54e5-4105-b3a0-92771126688c", "address": "fa:16:3e:8b:c5:06", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f10c24-54", "ovs_interfaceid": "f5f10c24-54e5-4105-b3a0-92771126688c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:c5:06,bridge_name='br-int',has_traffic_filtering=True,id=f5f10c24-54e5-4105-b3a0-92771126688c,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f10c24-54') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886786644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886786644',id=10,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlv4t3K+Qy3iAO7FEiNwwuKyhz0EnhUcDcVbeNLKy1sZWX89xnIt2kiGwDG/4BR29Vhm+arEM5lXG7Xl4NdAZQPuodnhqbf5k2kB4g2FtlrUPKC21J6eEd+lFNH5Kx+JA==',key_name='tempest-keypair-1323717061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cefa0481ae64474dbe0b5954a6de0b40',ramdisk_id='',reservation_id='r-1qnhs5b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-151685023',owner_user_name='tempest-TaggedBootDevicesTest-151685023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c02b728391bb474eb7081a2e64d7b15e',uuid=236d3139-0c65-41af-a1a6-bc36e51fbf50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "address": "fa:16:3e:06:13:18", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ac05d7-63", "ovs_interfaceid": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converting VIF {"id": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "address": "fa:16:3e:06:13:18", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ac05d7-63", "ovs_interfaceid": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:13:18,bridge_name='br-int',has_traffic_filtering=True,id=e6ac05d7-63c0-477d-89f5-d2612b39e976,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ac05d7-63') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886786644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886786644',id=10,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlv4t3K+Qy3iAO7FEiNwwuKyhz0EnhUcDcVbeNLKy1sZWX89xnIt2kiGwDG/4BR29Vhm+arEM5lXG7Xl4NdAZQPuodnhqbf5k2kB4g2FtlrUPKC21J6eEd+lFNH5Kx+JA==',key_name='tempest-keypair-1323717061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cefa0481ae64474dbe0b5954a6de0b40',ramdisk_id='',reservation_id='r-1qnhs5b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-151685023',owner_user_name='tempest-TaggedBootDevicesTest-151685023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c02b728391bb474eb7081a2e64d7b15e',uuid=236d3139-0c65-41af-a1a6-bc36e51fbf50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5980d7b6-c38c-4388-976b-039bcf31e766", "address": "fa:16:3e:a4:99:41", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5980d7b6-c3", "ovs_interfaceid": "5980d7b6-c38c-4388-976b-039bcf31e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converting VIF {"id": "5980d7b6-c38c-4388-976b-039bcf31e766", "address": "fa:16:3e:a4:99:41", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5980d7b6-c3", "ovs_interfaceid": "5980d7b6-c38c-4388-976b-039bcf31e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:99:41,bridge_name='br-int',has_traffic_filtering=True,id=5980d7b6-c38c-4388-976b-039bcf31e766,network=Network(e7f60358-c34c-4242-8190-7ba72313d9b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5980d7b6-c3') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886786644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886786644',id=10,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlv4t3K+Qy3iAO7FEiNwwuKyhz0EnhUcDcVbeNLKy1sZWX89xnIt2kiGwDG/4BR29Vhm+arEM5lXG7Xl4NdAZQPuodnhqbf5k2kB4g2FtlrUPKC21J6eEd+lFNH5Kx+JA==',key_name='tempest-keypair-1323717061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cefa0481ae64474dbe0b5954a6de0b40',ramdisk_id='',reservation_id='r-1qnhs5b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-151685023',owner_user_name='tempest-TaggedBootDevicesTest-151685023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c02b728391bb474eb7081a2e64d7b15e',uuid=236d3139-0c65-41af-a1a6-bc36e51fbf50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b19372c-785f-4c41-8e00-31689097491b", "address": "fa:16:3e:ca:61:08", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b19372c-78", "ovs_interfaceid": "4b19372c-785f-4c41-8e00-31689097491b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converting VIF {"id": "4b19372c-785f-4c41-8e00-31689097491b", "address": "fa:16:3e:ca:61:08", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b19372c-78", "ovs_interfaceid": "4b19372c-785f-4c41-8e00-31689097491b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:61:08,bridge_name='br-int',has_traffic_filtering=True,id=4b19372c-785f-4c41-8e00-31689097491b,network=Network(e7f60358-c34c-4242-8190-7ba72313d9b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b19372c-78') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.objects.instance [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lazy-loading 'pci_devices' on Instance uuid 236d3139-0c65-41af-a1a6-bc36e51fbf50 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:19:37 user nova-compute[70243]:   <uuid>236d3139-0c65-41af-a1a6-bc36e51fbf50</uuid>
Jul 24 16:19:37 user nova-compute[70243]:   <name>instance-0000000a</name>
Jul 24 16:19:37 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:19:37 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:19:37 user nova-compute[70243]:   <metadata>
Jul 24 16:19:37 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:19:37 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:19:37 user nova-compute[70243]:       <nova:name>tempest-device-tagging-server-1886786644</nova:name>
Jul 24 16:19:37 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:19:33</nova:creationTime>
Jul 24 16:19:37 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:19:37 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:19:37 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:19:37 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:19:37 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:19:37 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:19:37 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:19:37 user nova-compute[70243]:       <nova:owner>
Jul 24 16:19:37 user nova-compute[70243]:         <nova:user uuid="c02b728391bb474eb7081a2e64d7b15e">tempest-TaggedBootDevicesTest-151685023-project-member</nova:user>
Jul 24 16:19:37 user nova-compute[70243]:         <nova:project uuid="cefa0481ae64474dbe0b5954a6de0b40">tempest-TaggedBootDevicesTest-151685023</nova:project>
Jul 24 16:19:37 user nova-compute[70243]:       </nova:owner>
Jul 24 16:19:37 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:19:37 user nova-compute[70243]:       <nova:ports>
Jul 24 16:19:37 user nova-compute[70243]:         <nova:port uuid="6d0870b4-5264-46ca-a291-3c99a1c27546">
Jul 24 16:19:37 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 16:19:37 user nova-compute[70243]:         </nova:port>
Jul 24 16:19:37 user nova-compute[70243]:         <nova:port uuid="9b943a9e-f326-4526-8e6c-0462cb3860a4">
Jul 24 16:19:37 user nova-compute[70243]:           <nova:ip type="fixed" address="10.1.1.190" ipVersion="4"/>
Jul 24 16:19:37 user nova-compute[70243]:         </nova:port>
Jul 24 16:19:37 user nova-compute[70243]:         <nova:port uuid="2b3b9944-66d7-44fb-b3fe-b361e73a8509">
Jul 24 16:19:37 user nova-compute[70243]:           <nova:ip type="fixed" address="10.1.1.215" ipVersion="4"/>
Jul 24 16:19:37 user nova-compute[70243]:         </nova:port>
Jul 24 16:19:37 user nova-compute[70243]:         <nova:port uuid="f5f10c24-54e5-4105-b3a0-92771126688c">
Jul 24 16:19:37 user nova-compute[70243]:           <nova:ip type="fixed" address="10.1.1.235" ipVersion="4"/>
Jul 24 16:19:37 user nova-compute[70243]:         </nova:port>
Jul 24 16:19:37 user nova-compute[70243]:         <nova:port uuid="e6ac05d7-63c0-477d-89f5-d2612b39e976">
Jul 24 16:19:37 user nova-compute[70243]:           <nova:ip type="fixed" address="10.1.1.5" ipVersion="4"/>
Jul 24 16:19:37 user nova-compute[70243]:         </nova:port>
Jul 24 16:19:37 user nova-compute[70243]:         <nova:port uuid="5980d7b6-c38c-4388-976b-039bcf31e766">
Jul 24 16:19:37 user nova-compute[70243]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 24 16:19:37 user nova-compute[70243]:         </nova:port>
Jul 24 16:19:37 user nova-compute[70243]:         <nova:port uuid="4b19372c-785f-4c41-8e00-31689097491b">
Jul 24 16:19:37 user nova-compute[70243]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 24 16:19:37 user nova-compute[70243]:         </nova:port>
Jul 24 16:19:37 user nova-compute[70243]:       </nova:ports>
Jul 24 16:19:37 user nova-compute[70243]:     </nova:instance>
Jul 24 16:19:37 user nova-compute[70243]:   </metadata>
Jul 24 16:19:37 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:19:37 user nova-compute[70243]:     <system>
Jul 24 16:19:37 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:19:37 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:19:37 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:19:37 user nova-compute[70243]:       <entry name="serial">236d3139-0c65-41af-a1a6-bc36e51fbf50</entry>
Jul 24 16:19:37 user nova-compute[70243]:       <entry name="uuid">236d3139-0c65-41af-a1a6-bc36e51fbf50</entry>
Jul 24 16:19:37 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:19:37 user nova-compute[70243]:     </system>
Jul 24 16:19:37 user nova-compute[70243]:   </sysinfo>
Jul 24 16:19:37 user nova-compute[70243]:   <os>
Jul 24 16:19:37 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:19:37 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:19:37 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:19:37 user nova-compute[70243]:   </os>
Jul 24 16:19:37 user nova-compute[70243]:   <features>
Jul 24 16:19:37 user nova-compute[70243]:     <acpi/>
Jul 24 16:19:37 user nova-compute[70243]:     <apic/>
Jul 24 16:19:37 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:19:37 user nova-compute[70243]:   </features>
Jul 24 16:19:37 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:19:37 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:19:37 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:19:37 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:19:37 user nova-compute[70243]:   </clock>
Jul 24 16:19:37 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:19:37 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:19:37 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:19:37 user nova-compute[70243]:   </cpu>
Jul 24 16:19:37 user nova-compute[70243]:   <devices>
Jul 24 16:19:37 user nova-compute[70243]:     <disk type="file" device="cdrom">
Jul 24 16:19:37 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none"/>
Jul 24 16:19:37 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/236d3139-0c65-41af-a1a6-bc36e51fbf50/disk.config"/>
Jul 24 16:19:37 user nova-compute[70243]:       <target dev="hda" bus="ide"/>
Jul 24 16:19:37 user nova-compute[70243]:     </disk>
Jul 24 16:19:37 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:19:37 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:19:37 user nova-compute[70243]:       <source dev="/dev/sdb"/>
Jul 24 16:19:37 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:19:37 user nova-compute[70243]:       <serial>2b92ea51-d2d2-4ecd-abbc-c288df9b3d22</serial>
Jul 24 16:19:37 user nova-compute[70243]:     </disk>
Jul 24 16:19:37 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:19:37 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:19:37 user nova-compute[70243]:       <source dev="/dev/sdc"/>
Jul 24 16:19:37 user nova-compute[70243]:       <target dev="vdb" bus="virtio"/>
Jul 24 16:19:37 user nova-compute[70243]:       <serial>3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0</serial>
Jul 24 16:19:37 user nova-compute[70243]:     </disk>
Jul 24 16:19:37 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:19:37 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:19:37 user nova-compute[70243]:       <source dev="/dev/sdd"/>
Jul 24 16:19:37 user nova-compute[70243]:       <target dev="vdc" bus="virtio"/>
Jul 24 16:19:37 user nova-compute[70243]:       <serial>5d989fc2-833f-4097-bab6-738135612e1c</serial>
Jul 24 16:19:37 user nova-compute[70243]:     </disk>
Jul 24 16:19:37 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:19:37 user nova-compute[70243]:       <mac address="fa:16:3e:c6:f9:65"/>
Jul 24 16:19:37 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:19:37 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:19:37 user nova-compute[70243]:       <target dev="tap6d0870b4-52"/>
Jul 24 16:19:37 user nova-compute[70243]:     </interface>
Jul 24 16:19:37 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:19:37 user nova-compute[70243]:       <mac address="fa:16:3e:a3:85:6c"/>
Jul 24 16:19:37 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:19:37 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:19:37 user nova-compute[70243]:       <target dev="tap9b943a9e-f3"/>
Jul 24 16:19:37 user nova-compute[70243]:     </interface>
Jul 24 16:19:37 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:19:37 user nova-compute[70243]:       <mac address="fa:16:3e:13:6a:d5"/>
Jul 24 16:19:37 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:19:37 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:19:37 user nova-compute[70243]:       <target dev="tap2b3b9944-66"/>
Jul 24 16:19:37 user nova-compute[70243]:     </interface>
Jul 24 16:19:37 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:19:37 user nova-compute[70243]:       <mac address="fa:16:3e:8b:c5:06"/>
Jul 24 16:19:37 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:19:37 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:19:37 user nova-compute[70243]:       <target dev="tapf5f10c24-54"/>
Jul 24 16:19:37 user nova-compute[70243]:     </interface>
Jul 24 16:19:37 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:19:37 user nova-compute[70243]:       <mac address="fa:16:3e:06:13:18"/>
Jul 24 16:19:37 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:19:37 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:19:37 user nova-compute[70243]:       <target dev="tape6ac05d7-63"/>
Jul 24 16:19:37 user nova-compute[70243]:     </interface>
Jul 24 16:19:37 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:19:37 user nova-compute[70243]:       <mac address="fa:16:3e:a4:99:41"/>
Jul 24 16:19:37 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:19:37 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:19:37 user nova-compute[70243]:       <target dev="tap5980d7b6-c3"/>
Jul 24 16:19:37 user nova-compute[70243]:     </interface>
Jul 24 16:19:37 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:19:37 user nova-compute[70243]:       <mac address="fa:16:3e:ca:61:08"/>
Jul 24 16:19:37 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:19:37 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:19:37 user nova-compute[70243]:       <target dev="tap4b19372c-78"/>
Jul 24 16:19:37 user nova-compute[70243]:     </interface>
Jul 24 16:19:37 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:19:37 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/236d3139-0c65-41af-a1a6-bc36e51fbf50/console.log" append="off"/>
Jul 24 16:19:37 user nova-compute[70243]:     </serial>
Jul 24 16:19:37 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:19:37 user nova-compute[70243]:     <video>
Jul 24 16:19:37 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:19:37 user nova-compute[70243]:     </video>
Jul 24 16:19:37 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:19:37 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:19:37 user nova-compute[70243]:     </rng>
Jul 24 16:19:37 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:19:37 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:19:37 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:19:37 user nova-compute[70243]:     </memballoon>
Jul 24 16:19:37 user nova-compute[70243]:   </devices>
Jul 24 16:19:37 user nova-compute[70243]: </domain>
Jul 24 16:19:37 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886786644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886786644',id=10,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlv4t3K+Qy3iAO7FEiNwwuKyhz0EnhUcDcVbeNLKy1sZWX89xnIt2kiGwDG/4BR29Vhm+arEM5lXG7Xl4NdAZQPuodnhqbf5k2kB4g2FtlrUPKC21J6eEd+lFNH5Kx+JA==',key_name='tempest-keypair-1323717061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cefa0481ae64474dbe0b5954a6de0b40',ramdisk_id='',reservation_id='r-1qnhs5b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-151685023',owner_user_name='tempest-TaggedBootDevicesTest-151685023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c02b728391bb474eb7081a2e64d7b15e',uuid=236d3139-0c65-41af-a1a6-bc36e51fbf50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d0870b4-5264-46ca-a291-3c99a1c27546", "address": "fa:16:3e:c6:f9:65", "network": {"id": "9da02be9-9a4a-40bb-8a9b-9399b8f16521", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1533875048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0870b4-52", "ovs_interfaceid": "6d0870b4-5264-46ca-a291-3c99a1c27546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converting VIF {"id": "6d0870b4-5264-46ca-a291-3c99a1c27546", "address": "fa:16:3e:c6:f9:65", "network": {"id": "9da02be9-9a4a-40bb-8a9b-9399b8f16521", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1533875048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0870b4-52", "ovs_interfaceid": "6d0870b4-5264-46ca-a291-3c99a1c27546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:f9:65,bridge_name='br-int',has_traffic_filtering=True,id=6d0870b4-5264-46ca-a291-3c99a1c27546,network=Network(9da02be9-9a4a-40bb-8a9b-9399b8f16521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0870b4-52') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG os_vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:f9:65,bridge_name='br-int',has_traffic_filtering=True,id=6d0870b4-5264-46ca-a291-3c99a1c27546,network=Network(9da02be9-9a4a-40bb-8a9b-9399b8f16521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0870b4-52') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d0870b4-52, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6d0870b4-52, col_values=(('external_ids', {'iface-id': '6d0870b4-5264-46ca-a291-3c99a1c27546', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:f9:65', 'vm-uuid': '236d3139-0c65-41af-a1a6-bc36e51fbf50'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: INFO os_vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:f9:65,bridge_name='br-int',has_traffic_filtering=True,id=6d0870b4-5264-46ca-a291-3c99a1c27546,network=Network(9da02be9-9a4a-40bb-8a9b-9399b8f16521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0870b4-52')
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886786644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886786644',id=10,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlv4t3K+Qy3iAO7FEiNwwuKyhz0EnhUcDcVbeNLKy1sZWX89xnIt2kiGwDG/4BR29Vhm+arEM5lXG7Xl4NdAZQPuodnhqbf5k2kB4g2FtlrUPKC21J6eEd+lFNH5Kx+JA==',key_name='tempest-keypair-1323717061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cefa0481ae64474dbe0b5954a6de0b40',ramdisk_id='',reservation_id='r-1qnhs5b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-151685023',owner_user_name='tempest-TaggedBootDevicesTest-151685023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c02b728391bb474eb7081a2e64d7b15e',uuid=236d3139-0c65-41af-a1a6-bc36e51fbf50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "address": "fa:16:3e:a3:85:6c", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b943a9e-f3", "ovs_interfaceid": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converting VIF {"id": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "address": "fa:16:3e:a3:85:6c", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b943a9e-f3", "ovs_interfaceid": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:85:6c,bridge_name='br-int',has_traffic_filtering=True,id=9b943a9e-f326-4526-8e6c-0462cb3860a4,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b943a9e-f3') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG os_vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:85:6c,bridge_name='br-int',has_traffic_filtering=True,id=9b943a9e-f326-4526-8e6c-0462cb3860a4,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b943a9e-f3') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b943a9e-f3, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b943a9e-f3, col_values=(('external_ids', {'iface-id': '9b943a9e-f326-4526-8e6c-0462cb3860a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:85:6c', 'vm-uuid': '236d3139-0c65-41af-a1a6-bc36e51fbf50'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: INFO os_vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:85:6c,bridge_name='br-int',has_traffic_filtering=True,id=9b943a9e-f326-4526-8e6c-0462cb3860a4,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b943a9e-f3')
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886786644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886786644',id=10,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlv4t3K+Qy3iAO7FEiNwwuKyhz0EnhUcDcVbeNLKy1sZWX89xnIt2kiGwDG/4BR29Vhm+arEM5lXG7Xl4NdAZQPuodnhqbf5k2kB4g2FtlrUPKC21J6eEd+lFNH5Kx+JA==',key_name='tempest-keypair-1323717061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cefa0481ae64474dbe0b5954a6de0b40',ramdisk_id='',reservation_id='r-1qnhs5b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-151685023',owner_user_name='tempest-TaggedBootDevicesTest-151685023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c02b728391bb474eb7081a2e64d7b15e',uuid=236d3139-0c65-41af-a1a6-bc36e51fbf50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "address": "fa:16:3e:13:6a:d5", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3b9944-66", "ovs_interfaceid": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converting VIF {"id": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "address": "fa:16:3e:13:6a:d5", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3b9944-66", "ovs_interfaceid": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:6a:d5,bridge_name='br-int',has_traffic_filtering=True,id=2b3b9944-66d7-44fb-b3fe-b361e73a8509,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2b3b9944-66') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG os_vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:6a:d5,bridge_name='br-int',has_traffic_filtering=True,id=2b3b9944-66d7-44fb-b3fe-b361e73a8509,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2b3b9944-66') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b3b9944-66, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b3b9944-66, col_values=(('external_ids', {'iface-id': '2b3b9944-66d7-44fb-b3fe-b361e73a8509', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:6a:d5', 'vm-uuid': '236d3139-0c65-41af-a1a6-bc36e51fbf50'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: INFO os_vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:6a:d5,bridge_name='br-int',has_traffic_filtering=True,id=2b3b9944-66d7-44fb-b3fe-b361e73a8509,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2b3b9944-66')
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886786644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886786644',id=10,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlv4t3K+Qy3iAO7FEiNwwuKyhz0EnhUcDcVbeNLKy1sZWX89xnIt2kiGwDG/4BR29Vhm+arEM5lXG7Xl4NdAZQPuodnhqbf5k2kB4g2FtlrUPKC21J6eEd+lFNH5Kx+JA==',key_name='tempest-keypair-1323717061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cefa0481ae64474dbe0b5954a6de0b40',ramdisk_id='',reservation_id='r-1qnhs5b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-151685023',owner_user_name='tempest-TaggedBootDevicesTest-151685023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c02b728391bb474eb7081a2e64d7b15e',uuid=236d3139-0c65-41af-a1a6-bc36e51fbf50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5f10c24-54e5-4105-b3a0-92771126688c", "address": "fa:16:3e:8b:c5:06", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f10c24-54", "ovs_interfaceid": "f5f10c24-54e5-4105-b3a0-92771126688c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converting VIF {"id": "f5f10c24-54e5-4105-b3a0-92771126688c", "address": "fa:16:3e:8b:c5:06", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f10c24-54", "ovs_interfaceid": "f5f10c24-54e5-4105-b3a0-92771126688c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:c5:06,bridge_name='br-int',has_traffic_filtering=True,id=f5f10c24-54e5-4105-b3a0-92771126688c,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f10c24-54') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG os_vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:c5:06,bridge_name='br-int',has_traffic_filtering=True,id=f5f10c24-54e5-4105-b3a0-92771126688c,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f10c24-54') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5f10c24-54, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf5f10c24-54, col_values=(('external_ids', {'iface-id': 'f5f10c24-54e5-4105-b3a0-92771126688c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:c5:06', 'vm-uuid': '236d3139-0c65-41af-a1a6-bc36e51fbf50'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: INFO os_vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:c5:06,bridge_name='br-int',has_traffic_filtering=True,id=f5f10c24-54e5-4105-b3a0-92771126688c,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f10c24-54')
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886786644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886786644',id=10,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlv4t3K+Qy3iAO7FEiNwwuKyhz0EnhUcDcVbeNLKy1sZWX89xnIt2kiGwDG/4BR29Vhm+arEM5lXG7Xl4NdAZQPuodnhqbf5k2kB4g2FtlrUPKC21J6eEd+lFNH5Kx+JA==',key_name='tempest-keypair-1323717061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cefa0481ae64474dbe0b5954a6de0b40',ramdisk_id='',reservation_id='r-1qnhs5b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-151685023',owner_user_name='tempest-TaggedBootDevicesTest-151685023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c02b728391bb474eb7081a2e64d7b15e',uuid=236d3139-0c65-41af-a1a6-bc36e51fbf50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "address": "fa:16:3e:06:13:18", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ac05d7-63", "ovs_interfaceid": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converting VIF {"id": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "address": "fa:16:3e:06:13:18", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ac05d7-63", "ovs_interfaceid": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:13:18,bridge_name='br-int',has_traffic_filtering=True,id=e6ac05d7-63c0-477d-89f5-d2612b39e976,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ac05d7-63') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG os_vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:13:18,bridge_name='br-int',has_traffic_filtering=True,id=e6ac05d7-63c0-477d-89f5-d2612b39e976,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ac05d7-63') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6ac05d7-63, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape6ac05d7-63, col_values=(('external_ids', {'iface-id': 'e6ac05d7-63c0-477d-89f5-d2612b39e976', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:13:18', 'vm-uuid': '236d3139-0c65-41af-a1a6-bc36e51fbf50'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: INFO os_vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:13:18,bridge_name='br-int',has_traffic_filtering=True,id=e6ac05d7-63c0-477d-89f5-d2612b39e976,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ac05d7-63')
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886786644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886786644',id=10,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlv4t3K+Qy3iAO7FEiNwwuKyhz0EnhUcDcVbeNLKy1sZWX89xnIt2kiGwDG/4BR29Vhm+arEM5lXG7Xl4NdAZQPuodnhqbf5k2kB4g2FtlrUPKC21J6eEd+lFNH5Kx+JA==',key_name='tempest-keypair-1323717061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cefa0481ae64474dbe0b5954a6de0b40',ramdisk_id='',reservation_id='r-1qnhs5b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-151685023',owner_user_name='tempest-TaggedBootDevicesTest-151685023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c02b728391bb474eb7081a2e64d7b15e',uuid=236d3139-0c65-41af-a1a6-bc36e51fbf50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5980d7b6-c38c-4388-976b-039bcf31e766", "address": "fa:16:3e:a4:99:41", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5980d7b6-c3", "ovs_interfaceid": "5980d7b6-c38c-4388-976b-039bcf31e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converting VIF {"id": "5980d7b6-c38c-4388-976b-039bcf31e766", "address": "fa:16:3e:a4:99:41", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5980d7b6-c3", "ovs_interfaceid": "5980d7b6-c38c-4388-976b-039bcf31e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:99:41,bridge_name='br-int',has_traffic_filtering=True,id=5980d7b6-c38c-4388-976b-039bcf31e766,network=Network(e7f60358-c34c-4242-8190-7ba72313d9b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5980d7b6-c3') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG os_vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:99:41,bridge_name='br-int',has_traffic_filtering=True,id=5980d7b6-c38c-4388-976b-039bcf31e766,network=Network(e7f60358-c34c-4242-8190-7ba72313d9b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5980d7b6-c3') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5980d7b6-c3, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5980d7b6-c3, col_values=(('external_ids', {'iface-id': '5980d7b6-c38c-4388-976b-039bcf31e766', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:99:41', 'vm-uuid': '236d3139-0c65-41af-a1a6-bc36e51fbf50'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: INFO os_vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:99:41,bridge_name='br-int',has_traffic_filtering=True,id=5980d7b6-c38c-4388-976b-039bcf31e766,network=Network(e7f60358-c34c-4242-8190-7ba72313d9b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5980d7b6-c3')
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886786644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886786644',id=10,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlv4t3K+Qy3iAO7FEiNwwuKyhz0EnhUcDcVbeNLKy1sZWX89xnIt2kiGwDG/4BR29Vhm+arEM5lXG7Xl4NdAZQPuodnhqbf5k2kB4g2FtlrUPKC21J6eEd+lFNH5Kx+JA==',key_name='tempest-keypair-1323717061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cefa0481ae64474dbe0b5954a6de0b40',ramdisk_id='',reservation_id='r-1qnhs5b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-151685023',owner_user_name='tempest-TaggedBootDevicesTest-151685023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c02b728391bb474eb7081a2e64d7b15e',uuid=236d3139-0c65-41af-a1a6-bc36e51fbf50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b19372c-785f-4c41-8e00-31689097491b", "address": "fa:16:3e:ca:61:08", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b19372c-78", "ovs_interfaceid": "4b19372c-785f-4c41-8e00-31689097491b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converting VIF {"id": "4b19372c-785f-4c41-8e00-31689097491b", "address": "fa:16:3e:ca:61:08", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b19372c-78", "ovs_interfaceid": "4b19372c-785f-4c41-8e00-31689097491b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:61:08,bridge_name='br-int',has_traffic_filtering=True,id=4b19372c-785f-4c41-8e00-31689097491b,network=Network(e7f60358-c34c-4242-8190-7ba72313d9b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b19372c-78') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG os_vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:61:08,bridge_name='br-int',has_traffic_filtering=True,id=4b19372c-785f-4c41-8e00-31689097491b,network=Network(e7f60358-c34c-4242-8190-7ba72313d9b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b19372c-78') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b19372c-78, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4b19372c-78, col_values=(('external_ids', {'iface-id': '4b19372c-785f-4c41-8e00-31689097491b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:61:08', 'vm-uuid': '236d3139-0c65-41af-a1a6-bc36e51fbf50'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:37 user nova-compute[70243]: INFO os_vif [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:61:08,bridge_name='br-int',has_traffic_filtering=True,id=4b19372c-785f-4c41-8e00-31689097491b,network=Network(e7f60358-c34c-4242-8190-7ba72313d9b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b19372c-78')
Jul 24 16:19:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] No BDM found with device name hda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:19:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:19:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] No VIF found with MAC fa:16:3e:c6:f9:65, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:19:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] No VIF found with MAC fa:16:3e:06:13:18, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:19:38 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Using config drive
Jul 24 16:19:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:38 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Creating config drive at /opt/stack/data/nova/instances/236d3139-0c65-41af-a1a6-bc36e51fbf50/disk.config
Jul 24 16:19:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/236d3139-0c65-41af-a1a6-bc36e51fbf50/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9yw0dh20 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e637a0d4-d38e-46e0-8fde-3b45c2410439/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/236d3139-0c65-41af-a1a6-bc36e51fbf50/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9yw0dh20" returned: 0 in 0.075s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e637a0d4-d38e-46e0-8fde-3b45c2410439/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e637a0d4-d38e-46e0-8fde-3b45c2410439/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e637a0d4-d38e-46e0-8fde-3b45c2410439/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215584.6141403, 236d3139-0c65-41af-a1a6-bc36e51fbf50 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:19:44 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] VM Resumed (Lifecycle Event)
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-b32c844f-747a-43b9-b8e4-b640687b63e4 req-ebf8d294-e0d0-4826-b012-d710a03a91d1 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-plugged-6d0870b4-5264-46ca-a291-3c99a1c27546 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b32c844f-747a-43b9-b8e4-b640687b63e4 req-ebf8d294-e0d0-4826-b012-d710a03a91d1 service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b32c844f-747a-43b9-b8e4-b640687b63e4 req-ebf8d294-e0d0-4826-b012-d710a03a91d1 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b32c844f-747a-43b9-b8e4-b640687b63e4 req-ebf8d294-e0d0-4826-b012-d710a03a91d1 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-b32c844f-747a-43b9-b8e4-b640687b63e4 req-ebf8d294-e0d0-4826-b012-d710a03a91d1 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-plugged-6d0870b4-5264-46ca-a291-3c99a1c27546 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:19:44 user nova-compute[70243]: WARNING nova.compute.manager [req-b32c844f-747a-43b9-b8e4-b640687b63e4 req-ebf8d294-e0d0-4826-b012-d710a03a91d1 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received unexpected event network-vif-plugged-6d0870b4-5264-46ca-a291-3c99a1c27546 for instance with vm_state building and task_state spawning.
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-5b31a5c0-f159-407b-b088-2f7c5ca77d21 req-b2315737-ca7c-42c4-b552-b2df79f32057 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-plugged-e6ac05d7-63c0-477d-89f5-d2612b39e976 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5b31a5c0-f159-407b-b088-2f7c5ca77d21 req-b2315737-ca7c-42c4-b552-b2df79f32057 service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5b31a5c0-f159-407b-b088-2f7c5ca77d21 req-b2315737-ca7c-42c4-b552-b2df79f32057 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5b31a5c0-f159-407b-b088-2f7c5ca77d21 req-b2315737-ca7c-42c4-b552-b2df79f32057 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-5b31a5c0-f159-407b-b088-2f7c5ca77d21 req-b2315737-ca7c-42c4-b552-b2df79f32057 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-plugged-e6ac05d7-63c0-477d-89f5-d2612b39e976 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:19:44 user nova-compute[70243]: WARNING nova.compute.manager [req-5b31a5c0-f159-407b-b088-2f7c5ca77d21 req-b2315737-ca7c-42c4-b552-b2df79f32057 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received unexpected event network-vif-plugged-e6ac05d7-63c0-477d-89f5-d2612b39e976 for instance with vm_state building and task_state spawning.
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-plugged-6d0870b4-5264-46ca-a291-3c99a1c27546 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-plugged-6d0870b4-5264-46ca-a291-3c99a1c27546 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:19:44 user nova-compute[70243]: WARNING nova.compute.manager [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received unexpected event network-vif-plugged-6d0870b4-5264-46ca-a291-3c99a1c27546 for instance with vm_state building and task_state spawning.
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-plugged-9b943a9e-f326-4526-8e6c-0462cb3860a4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-plugged-9b943a9e-f326-4526-8e6c-0462cb3860a4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:19:44 user nova-compute[70243]: WARNING nova.compute.manager [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received unexpected event network-vif-plugged-9b943a9e-f326-4526-8e6c-0462cb3860a4 for instance with vm_state building and task_state spawning.
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-plugged-9b943a9e-f326-4526-8e6c-0462cb3860a4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-plugged-9b943a9e-f326-4526-8e6c-0462cb3860a4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:19:44 user nova-compute[70243]: WARNING nova.compute.manager [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received unexpected event network-vif-plugged-9b943a9e-f326-4526-8e6c-0462cb3860a4 for instance with vm_state building and task_state spawning.
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-plugged-2b3b9944-66d7-44fb-b3fe-b361e73a8509 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-plugged-2b3b9944-66d7-44fb-b3fe-b361e73a8509 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:19:44 user nova-compute[70243]: WARNING nova.compute.manager [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received unexpected event network-vif-plugged-2b3b9944-66d7-44fb-b3fe-b361e73a8509 for instance with vm_state building and task_state spawning.
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-plugged-2b3b9944-66d7-44fb-b3fe-b361e73a8509 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-plugged-2b3b9944-66d7-44fb-b3fe-b361e73a8509 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:19:44 user nova-compute[70243]: WARNING nova.compute.manager [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received unexpected event network-vif-plugged-2b3b9944-66d7-44fb-b3fe-b361e73a8509 for instance with vm_state building and task_state spawning.
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-plugged-f5f10c24-54e5-4105-b3a0-92771126688c {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-plugged-f5f10c24-54e5-4105-b3a0-92771126688c {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:19:44 user nova-compute[70243]: WARNING nova.compute.manager [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received unexpected event network-vif-plugged-f5f10c24-54e5-4105-b3a0-92771126688c for instance with vm_state building and task_state spawning.
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-plugged-f5f10c24-54e5-4105-b3a0-92771126688c {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-plugged-f5f10c24-54e5-4105-b3a0-92771126688c {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:19:44 user nova-compute[70243]: WARNING nova.compute.manager [req-dbf35b61-8569-4019-98ca-772a4296f0e2 req-90fa3d41-1957-41d6-94df-03a62d5a5c07 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received unexpected event network-vif-plugged-f5f10c24-54e5-4105-b3a0-92771126688c for instance with vm_state building and task_state spawning.
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-plugged-e6ac05d7-63c0-477d-89f5-d2612b39e976 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-plugged-e6ac05d7-63c0-477d-89f5-d2612b39e976 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:19:44 user nova-compute[70243]: WARNING nova.compute.manager [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received unexpected event network-vif-plugged-e6ac05d7-63c0-477d-89f5-d2612b39e976 for instance with vm_state building and task_state spawning.
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-plugged-5980d7b6-c38c-4388-976b-039bcf31e766 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-plugged-5980d7b6-c38c-4388-976b-039bcf31e766 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:19:44 user nova-compute[70243]: WARNING nova.compute.manager [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received unexpected event network-vif-plugged-5980d7b6-c38c-4388-976b-039bcf31e766 for instance with vm_state building and task_state spawning.
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-plugged-5980d7b6-c38c-4388-976b-039bcf31e766 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-plugged-5980d7b6-c38c-4388-976b-039bcf31e766 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:19:44 user nova-compute[70243]: WARNING nova.compute.manager [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received unexpected event network-vif-plugged-5980d7b6-c38c-4388-976b-039bcf31e766 for instance with vm_state building and task_state spawning.
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-plugged-4b19372c-785f-4c41-8e00-31689097491b {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-plugged-4b19372c-785f-4c41-8e00-31689097491b {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:19:44 user nova-compute[70243]: WARNING nova.compute.manager [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received unexpected event network-vif-plugged-4b19372c-785f-4c41-8e00-31689097491b for instance with vm_state building and task_state spawning.
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-plugged-4b19372c-785f-4c41-8e00-31689097491b {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-plugged-4b19372c-785f-4c41-8e00-31689097491b {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:19:44 user nova-compute[70243]: WARNING nova.compute.manager [req-fd220bf6-ca3c-4cd0-ba02-3fb6c6ff7099 req-515a7331-3131-4f3f-831a-d901bd280bac service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received unexpected event network-vif-plugged-4b19372c-785f-4c41-8e00-31689097491b for instance with vm_state building and task_state spawning.
Jul 24 16:19:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Acquiring lock "e637a0d4-d38e-46e0-8fde-3b45c2410439" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "e637a0d4-d38e-46e0-8fde-3b45c2410439" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:45 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Instance spawned successfully.
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:19:45 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:19:45 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=6967MB free_disk=24.57840347290039GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.objects.instance [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lazy-loading 'flavor' on Instance uuid e637a0d4-d38e-46e0-8fde-3b45c2410439 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:19:45 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215584.6157892, 236d3139-0c65-41af-a1a6-bc36e51fbf50 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:19:45 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] VM Started (Lifecycle Event)
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "e637a0d4-d38e-46e0-8fde-3b45c2410439" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:19:45 user nova-compute[70243]: INFO nova.compute.manager [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Took 11.78 seconds to spawn the instance on the hypervisor.
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.compute.manager [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:19:45 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance e637a0d4-d38e-46e0-8fde-3b45c2410439 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance de22ea98-b041-4f3f-8986-435c43267a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance de484cb2-7f20-4bf1-927b-c066735bfeca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance a13c243a-2b98-4ef1-b17c-e2e15ba005fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance ad611655-ba4d-4a66-b78e-a82c058f4414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5f70528b-33db-4257-96fe-e5fad869a224 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8cd7a53c-c100-4e43-a9d6-0d4517239e15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance c2ee17ba-3482-4caf-992e-30b3953d1e91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5e6a5fff-570c-4ee2-b883-415ec828ef97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 236d3139-0c65-41af-a1a6-bc36e51fbf50 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:19:45 user nova-compute[70243]: INFO nova.compute.manager [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Took 38.02 seconds to build instance.
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-315a3177-7032-41a0-89f5-34b639586c52 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.145s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Acquiring lock "e637a0d4-d38e-46e0-8fde-3b45c2410439" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "e637a0d4-d38e-46e0-8fde-3b45c2410439" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:45 user nova-compute[70243]: INFO nova.compute.manager [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Attaching volume b0497d54-cdc7-47dd-9317-169f8138777b to /dev/vdb
Jul 24 16:19:45 user nova-compute[70243]: DEBUG os_brick.utils [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a036a97b-8bbd-4bc9-acaa-13b01987d8c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a718fc-9720-496e-95b5-a4984eb133f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[74793ac0-61f6-493b-adb3-063df757a862]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4f17c6-f65e-420b-827f-b57a2cad1f83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.compute.manager [req-85b8a87d-c7da-441a-a9fc-198abd582090 req-31c423c0-92ec-4a2b-8056-24a5c19d8e69 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Received event network-changed-e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.compute.manager [req-85b8a87d-c7da-441a-a9fc-198abd582090 req-31c423c0-92ec-4a2b-8056-24a5c19d8e69 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Refreshing instance network info cache due to event network-changed-e709e269-eff5-4ac2-8c2a-29048448a422. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-85b8a87d-c7da-441a-a9fc-198abd582090 req-31c423c0-92ec-4a2b-8056-24a5c19d8e69 service nova] Acquiring lock "refresh_cache-de22ea98-b041-4f3f-8986-435c43267a2e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-85b8a87d-c7da-441a-a9fc-198abd582090 req-31c423c0-92ec-4a2b-8056-24a5c19d8e69 service nova] Acquired lock "refresh_cache-de22ea98-b041-4f3f-8986-435c43267a2e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.network.neutron [req-85b8a87d-c7da-441a-a9fc-198abd582090 req-31c423c0-92ec-4a2b-8056-24a5c19d8e69 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Refreshing network info cache for port e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:19:45 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[007fcec6-82f3-4b26-8f9d-082914c73c20]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG os_brick.utils [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Updating existing volume attachment record: e8199b47-a59b-4069-b685-c40dc6c9f462 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:19:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.683s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:46 user nova-compute[70243]: DEBUG nova.network.neutron [req-85b8a87d-c7da-441a-a9fc-198abd582090 req-31c423c0-92ec-4a2b-8056-24a5c19d8e69 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Updated VIF entry in instance network info cache for port e709e269-eff5-4ac2-8c2a-29048448a422. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:19:46 user nova-compute[70243]: DEBUG nova.network.neutron [req-85b8a87d-c7da-441a-a9fc-198abd582090 req-31c423c0-92ec-4a2b-8056-24a5c19d8e69 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Updating instance_info_cache with network_info: [{"id": "e709e269-eff5-4ac2-8c2a-29048448a422", "address": "fa:16:3e:0a:84:99", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape709e269-ef", "ovs_interfaceid": "e709e269-eff5-4ac2-8c2a-29048448a422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:19:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-85b8a87d-c7da-441a-a9fc-198abd582090 req-31c423c0-92ec-4a2b-8056-24a5c19d8e69 service nova] Releasing lock "refresh_cache-de22ea98-b041-4f3f-8986-435c43267a2e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:19:46 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:19:46 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:19:46 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:19:46 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:19:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-de22ea98-b041-4f3f-8986-435c43267a2e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:19:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-de22ea98-b041-4f3f-8986-435c43267a2e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:19:46 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:19:47 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Updating instance_info_cache with network_info: [{"id": "e709e269-eff5-4ac2-8c2a-29048448a422", "address": "fa:16:3e:0a:84:99", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape709e269-ef", "ovs_interfaceid": "e709e269-eff5-4ac2-8c2a-29048448a422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:19:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-de22ea98-b041-4f3f-8986-435c43267a2e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:19:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:19:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:19:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:19:47 user nova-compute[70243]: DEBUG nova.compute.manager [req-4f6b92f3-0de8-4213-8106-3e884a766c62 req-7d322954-9050-404a-9dc0-83e0498a4b5a service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received event network-changed-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:47 user nova-compute[70243]: DEBUG nova.compute.manager [req-4f6b92f3-0de8-4213-8106-3e884a766c62 req-7d322954-9050-404a-9dc0-83e0498a4b5a service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Refreshing instance network info cache due to event network-changed-2943f763-290c-46a8-90cf-f0e6b59a2be4. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:19:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4f6b92f3-0de8-4213-8106-3e884a766c62 req-7d322954-9050-404a-9dc0-83e0498a4b5a service nova] Acquiring lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:19:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4f6b92f3-0de8-4213-8106-3e884a766c62 req-7d322954-9050-404a-9dc0-83e0498a4b5a service nova] Acquired lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:19:47 user nova-compute[70243]: DEBUG nova.network.neutron [req-4f6b92f3-0de8-4213-8106-3e884a766c62 req-7d322954-9050-404a-9dc0-83e0498a4b5a service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Refreshing network info cache for port 2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:19:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:19:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:19:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:19:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:19:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:19:47 user nova-compute[70243]: DEBUG nova.compute.manager [req-391d71e9-0752-443e-9b55-1d0a0494bb5f req-58fc8900-94f4-49a3-ae48-543d6bea1ed3 service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Received event network-changed-e3519574-a5e5-48f3-9e0c-852d0e9e3505 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:47 user nova-compute[70243]: DEBUG nova.compute.manager [req-391d71e9-0752-443e-9b55-1d0a0494bb5f req-58fc8900-94f4-49a3-ae48-543d6bea1ed3 service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Refreshing instance network info cache due to event network-changed-e3519574-a5e5-48f3-9e0c-852d0e9e3505. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:19:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-391d71e9-0752-443e-9b55-1d0a0494bb5f req-58fc8900-94f4-49a3-ae48-543d6bea1ed3 service nova] Acquiring lock "refresh_cache-de484cb2-7f20-4bf1-927b-c066735bfeca" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:19:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-391d71e9-0752-443e-9b55-1d0a0494bb5f req-58fc8900-94f4-49a3-ae48-543d6bea1ed3 service nova] Acquired lock "refresh_cache-de484cb2-7f20-4bf1-927b-c066735bfeca" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:19:47 user nova-compute[70243]: DEBUG nova.network.neutron [req-391d71e9-0752-443e-9b55-1d0a0494bb5f req-58fc8900-94f4-49a3-ae48-543d6bea1ed3 service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Refreshing network info cache for port e3519574-a5e5-48f3-9e0c-852d0e9e3505 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:19:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:49 user nova-compute[70243]: DEBUG nova.network.neutron [req-4f6b92f3-0de8-4213-8106-3e884a766c62 req-7d322954-9050-404a-9dc0-83e0498a4b5a service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Updated VIF entry in instance network info cache for port 2943f763-290c-46a8-90cf-f0e6b59a2be4. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:19:49 user nova-compute[70243]: DEBUG nova.network.neutron [req-4f6b92f3-0de8-4213-8106-3e884a766c62 req-7d322954-9050-404a-9dc0-83e0498a4b5a service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Updating instance_info_cache with network_info: [{"id": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "address": "fa:16:3e:92:8d:42", "network": {"id": "69c0285e-5c28-41c5-893d-9d92e9626cb2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808448879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c70a6d9bf46466da48267f2fc2e02d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2943f763-29", "ovs_interfaceid": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:19:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4f6b92f3-0de8-4213-8106-3e884a766c62 req-7d322954-9050-404a-9dc0-83e0498a4b5a service nova] Releasing lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:19:49 user nova-compute[70243]: DEBUG nova.network.neutron [req-391d71e9-0752-443e-9b55-1d0a0494bb5f req-58fc8900-94f4-49a3-ae48-543d6bea1ed3 service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Updated VIF entry in instance network info cache for port e3519574-a5e5-48f3-9e0c-852d0e9e3505. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:19:49 user nova-compute[70243]: DEBUG nova.network.neutron [req-391d71e9-0752-443e-9b55-1d0a0494bb5f req-58fc8900-94f4-49a3-ae48-543d6bea1ed3 service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Updating instance_info_cache with network_info: [{"id": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "address": "fa:16:3e:8b:ac:95", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3519574-a5", "ovs_interfaceid": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:19:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-391d71e9-0752-443e-9b55-1d0a0494bb5f req-58fc8900-94f4-49a3-ae48-543d6bea1ed3 service nova] Releasing lock "refresh_cache-de484cb2-7f20-4bf1-927b-c066735bfeca" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:19:49 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:19:49 user nova-compute[70243]: INFO nova.compute.manager [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] instance snapshotting
Jul 24 16:19:49 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Beginning live snapshot process
Jul 24 16:19:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json -f qcow2 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:49 user nova-compute[70243]: DEBUG nova.compute.manager [req-51c02a98-43f2-4503-87a5-0f415a776742 req-00444b30-3aa8-46e2-9979-add401f79e85 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received event network-changed-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:49 user nova-compute[70243]: DEBUG nova.compute.manager [req-51c02a98-43f2-4503-87a5-0f415a776742 req-00444b30-3aa8-46e2-9979-add401f79e85 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Refreshing instance network info cache due to event network-changed-ef8e7d11-464b-421b-bfc9-0d5a17f610d4. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:19:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-51c02a98-43f2-4503-87a5-0f415a776742 req-00444b30-3aa8-46e2-9979-add401f79e85 service nova] Acquiring lock "refresh_cache-ad611655-ba4d-4a66-b78e-a82c058f4414" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:19:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-51c02a98-43f2-4503-87a5-0f415a776742 req-00444b30-3aa8-46e2-9979-add401f79e85 service nova] Acquired lock "refresh_cache-ad611655-ba4d-4a66-b78e-a82c058f4414" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:19:49 user nova-compute[70243]: DEBUG nova.network.neutron [req-51c02a98-43f2-4503-87a5-0f415a776742 req-00444b30-3aa8-46e2-9979-add401f79e85 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Refreshing network info cache for port ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:19:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json -f qcow2 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json -f qcow2" returned: 0 in 0.227s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.170s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpffdxdy07/5a86afd3eb234b51972e7835d1d32e33.delta 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpffdxdy07/5a86afd3eb234b51972e7835d1d32e33.delta 1073741824" returned: 0 in 0.075s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:50 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 24 16:19:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Checking UEFI support for host arch (x86_64) {{(pid=70243) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Jul 24 16:19:50 user nova-compute[70243]: INFO nova.virt.libvirt.host [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] UEFI support detected
Jul 24 16:19:50 user nova-compute[70243]: DEBUG nova.network.neutron [req-51c02a98-43f2-4503-87a5-0f415a776742 req-00444b30-3aa8-46e2-9979-add401f79e85 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Updated VIF entry in instance network info cache for port ef8e7d11-464b-421b-bfc9-0d5a17f610d4. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:19:50 user nova-compute[70243]: DEBUG nova.network.neutron [req-51c02a98-43f2-4503-87a5-0f415a776742 req-00444b30-3aa8-46e2-9979-add401f79e85 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Updating instance_info_cache with network_info: [{"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:19:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-51c02a98-43f2-4503-87a5-0f415a776742 req-00444b30-3aa8-46e2-9979-add401f79e85 service nova] Releasing lock "refresh_cache-ad611655-ba4d-4a66-b78e-a82c058f4414" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:19:51 user nova-compute[70243]: DEBUG nova.compute.manager [req-2a4759ee-a624-44a4-8b90-1b93600cf9be req-7d1e996e-18fe-422e-9d07-f0a96c89a987 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received event network-changed-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:19:51 user nova-compute[70243]: DEBUG nova.compute.manager [req-2a4759ee-a624-44a4-8b90-1b93600cf9be req-7d1e996e-18fe-422e-9d07-f0a96c89a987 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Refreshing instance network info cache due to event network-changed-66249aa8-373c-45b2-940f-74f7e6228bce. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:19:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2a4759ee-a624-44a4-8b90-1b93600cf9be req-7d1e996e-18fe-422e-9d07-f0a96c89a987 service nova] Acquiring lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:19:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2a4759ee-a624-44a4-8b90-1b93600cf9be req-7d1e996e-18fe-422e-9d07-f0a96c89a987 service nova] Acquired lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:19:51 user nova-compute[70243]: DEBUG nova.network.neutron [req-2a4759ee-a624-44a4-8b90-1b93600cf9be req-7d1e996e-18fe-422e-9d07-f0a96c89a987 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Refreshing network info cache for port 66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:19:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:19:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:19:51 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 24 16:19:52 user nova-compute[70243]: DEBUG nova.privsep.utils [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70243) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 16:19:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpffdxdy07/5a86afd3eb234b51972e7835d1d32e33.delta /opt/stack/data/nova/instances/snapshots/tmpffdxdy07/5a86afd3eb234b51972e7835d1d32e33 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:52 user nova-compute[70243]: DEBUG nova.network.neutron [req-2a4759ee-a624-44a4-8b90-1b93600cf9be req-7d1e996e-18fe-422e-9d07-f0a96c89a987 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Updated VIF entry in instance network info cache for port 66249aa8-373c-45b2-940f-74f7e6228bce. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:19:52 user nova-compute[70243]: DEBUG nova.network.neutron [req-2a4759ee-a624-44a4-8b90-1b93600cf9be req-7d1e996e-18fe-422e-9d07-f0a96c89a987 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Updating instance_info_cache with network_info: [{"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:19:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2a4759ee-a624-44a4-8b90-1b93600cf9be req-7d1e996e-18fe-422e-9d07-f0a96c89a987 service nova] Releasing lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:19:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpffdxdy07/5a86afd3eb234b51972e7835d1d32e33.delta /opt/stack/data/nova/instances/snapshots/tmpffdxdy07/5a86afd3eb234b51972e7835d1d32e33" returned: 0 in 0.891s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:52 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Snapshot extracted, beginning image upload
Jul 24 16:19:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "ad611655-ba4d-4a66-b78e-a82c058f4414" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG nova.objects.instance [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'flavor' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.137s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "ad611655-ba4d-4a66-b78e-a82c058f4414" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:55 user nova-compute[70243]: INFO nova.compute.manager [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Attaching volume d2139cf8-69f4-4150-a7c5-221311a1ac1c to /dev/vdb
Jul 24 16:19:55 user nova-compute[70243]: DEBUG os_brick.utils [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1b2fbd-e8fa-4eb5-a8bd-ccdb5fdb0fac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cde26e9-da74-476f-9a40-de9b5683234d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e07e80-df80-4c13-b063-0661d1e544b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3214fd-e002-47ed-a45a-8fde4276ce5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:19:55 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:19:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a6cc0e-d71d-407c-ae78-9a8981abdc4e]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG os_brick.utils [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:19:55 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Updating existing volume attachment record: 3982e3ca-8bf1-41b8-9064-00db6e116651 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:19:56 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Snapshot image upload complete
Jul 24 16:19:56 user nova-compute[70243]: INFO nova.compute.manager [None req-d6069496-c275-4d47-ba2b-faf07cf0a703 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Took 6.64 seconds to snapshot the instance on the hypervisor.
Jul 24 16:19:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:57 user nova-compute[70243]: DEBUG nova.compute.manager [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:19:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:19:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:19:57 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:19:57 user nova-compute[70243]: INFO nova.compute.claims [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Claim successful on node user
Jul 24 16:19:57 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:19:57 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:19:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:19:57 user nova-compute[70243]: DEBUG nova.compute.manager [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:19:57 user nova-compute[70243]: DEBUG nova.compute.manager [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:19:57 user nova-compute[70243]: DEBUG nova.network.neutron [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:19:57 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:19:57 user nova-compute[70243]: DEBUG nova.compute.manager [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:19:58 user nova-compute[70243]: INFO nova.virt.block_device [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Booting with volume 75d2beea-53f6-4026-a9fa-a819238dbf73 at /dev/vda
Jul 24 16:19:58 user nova-compute[70243]: DEBUG nova.policy [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93b6ed534c2c44d08a71f3050e212644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec24d98248104f5f898cf6f79207435b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CRAwgEUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:19:58 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:19:58 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:19:58 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a546486-1dc7-4a7b-b6b6-a5e2687893ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:19:58 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c37cac-3a82-4628-b4c5-b63e0b136e11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b] added
Jul 24 16:19:58 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.utils [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd5e4ac-3e76-4e14-8a74-9dad69b9fdd3]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e868d14-05a2-4999-8748-cb74d720bedb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af128e4-e8d8-4d20-94d3-50f9eb177fd5]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CRAwgEUQ {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda680a1-8ac2-420c-860f-72b5b51146c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CRAwgEUQ" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[348f6a39-2085-425c-95bc-30302a9b6df8]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CRAwgEUQ'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce1f28b-8572-4f8d-8d0e-7b211139fb0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba2d442-955e-42e5-a06f-02b1ac1645bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90c34ff-b181-46d1-a6a6-b99be799bd1e]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:19:58 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b980c6c-7a94-4554-9160-940fe4d31323]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.utils [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Updating existing volume attachment record: fbea47d7-0095-460d-9746-e000bdd90c3a {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[144c5190-b86a-40c4-9a51-66874a4a6996]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:19:58 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:19:58 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:19:58 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:19:58 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:19:58 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:19:58 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b -p 172.16.0.220:3260 --login" returned: 0 in 0.161s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[048f2efa-28ae-49c2-959b-883a0e0b140d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b, portal: 172.16.0.220,3260]
Jul 24 16:19:58 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b, portal: 172.16.0.220,3260] successful.
Jul 24 16:19:58 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50784ae-b504-4c86-820e-12d9a1ee22d7]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[66be5cbf-8d31-4ef7-b595-aac050406bdc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:19:58 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:19:58 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:19:58 user nova-compute[70243]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b (non-flash)
Jul 24 16:19:58 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:19:58 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:19:58 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:19:58 user nova-compute[70243]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b (non-flash)
Jul 24 16:19:58 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.466s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1a68df-693f-478e-937e-4264e5812d62]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CRAwgEUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:19:58 user nova-compute[70243]: DEBUG nova.network.neutron [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Successfully created port: 51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:19:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:19:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.507s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:19:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] <== connect_volume: return (1508ms) {'type': 'block', 'scsi_wwn': '23530376539666165', 'path': '/dev/sde'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:19:59 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530376539666165', 'path': '/dev/sde'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:19:59 user nova-compute[70243]: DEBUG nova.objects.instance [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lazy-loading 'flavor' on Instance uuid e637a0d4-d38e-46e0-8fde-3b45c2410439 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:19:59 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:19:59 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:19:59 user nova-compute[70243]:   <source dev="/dev/sde"/>
Jul 24 16:19:59 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:19:59 user nova-compute[70243]:   <serial>b0497d54-cdc7-47dd-9317-169f8138777b</serial>
Jul 24 16:19:59 user nova-compute[70243]: </disk>
Jul 24 16:19:59 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:19:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Successfully updated port: 51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "refresh_cache-fd314e21-b1a5-425d-a5e0-c1b3303b72d4" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquired lock "refresh_cache-fd314e21-b1a5-425d-a5e0-c1b3303b72d4" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG nova.compute.manager [req-3236909a-91e9-47f7-b9bf-656788c025b1 req-1a0d69cc-dec3-4318-a372-b1200b3f684f service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Received event network-changed-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG nova.compute.manager [req-3236909a-91e9-47f7-b9bf-656788c025b1 req-1a0d69cc-dec3-4318-a372-b1200b3f684f service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Refreshing instance network info cache due to event network-changed-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3236909a-91e9-47f7-b9bf-656788c025b1 req-1a0d69cc-dec3-4318-a372-b1200b3f684f service nova] Acquiring lock "refresh_cache-fd314e21-b1a5-425d-a5e0-c1b3303b72d4" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] No VIF found with MAC fa:16:3e:6b:ce:ba, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8c01952c-504a-42d1-9495-e71fdc22b064 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "e637a0d4-d38e-46e0-8fde-3b45c2410439" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.997s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Updating instance_info_cache with network_info: [{"id": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "address": "fa:16:3e:92:b1:e8", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc58b9-95", "ovs_interfaceid": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Releasing lock "refresh_cache-fd314e21-b1a5-425d-a5e0-c1b3303b72d4" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Instance network_info: |[{"id": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "address": "fa:16:3e:92:b1:e8", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc58b9-95", "ovs_interfaceid": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3236909a-91e9-47f7-b9bf-656788c025b1 req-1a0d69cc-dec3-4318-a372-b1200b3f684f service nova] Acquired lock "refresh_cache-fd314e21-b1a5-425d-a5e0-c1b3303b72d4" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG nova.network.neutron [req-3236909a-91e9-47f7-b9bf-656788c025b1 req-1a0d69cc-dec3-4318-a372-b1200b3f684f service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Refreshing network info cache for port 51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Acquiring lock "e637a0d4-d38e-46e0-8fde-3b45c2410439" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "e637a0d4-d38e-46e0-8fde-3b45c2410439" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Acquiring lock "e637a0d4-d38e-46e0-8fde-3b45c2410439-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "e637a0d4-d38e-46e0-8fde-3b45c2410439-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "e637a0d4-d38e-46e0-8fde-3b45c2410439-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:00 user nova-compute[70243]: INFO nova.compute.manager [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Terminating instance
Jul 24 16:20:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG nova.network.neutron [req-3236909a-91e9-47f7-b9bf-656788c025b1 req-1a0d69cc-dec3-4318-a372-b1200b3f684f service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Updated VIF entry in instance network info cache for port 51cc58b9-958f-41dd-bf1d-596ca7c6d5ce. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG nova.network.neutron [req-3236909a-91e9-47f7-b9bf-656788c025b1 req-1a0d69cc-dec3-4318-a372-b1200b3f684f service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Updating instance_info_cache with network_info: [{"id": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "address": "fa:16:3e:92:b1:e8", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc58b9-95", "ovs_interfaceid": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3236909a-91e9-47f7-b9bf-656788c025b1 req-1a0d69cc-dec3-4318-a372-b1200b3f684f service nova] Releasing lock "refresh_cache-fd314e21-b1a5-425d-a5e0-c1b3303b72d4" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:20:01 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Instance destroyed successfully.
Jul 24 16:20:01 user nova-compute[70243]: DEBUG nova.objects.instance [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lazy-loading 'resources' on Instance uuid e637a0d4-d38e-46e0-8fde-3b45c2410439 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1597360493',display_name='tempest-DeleteServersTestJSON-server-1597360493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1597360493',id=1,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:18:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bcc401d03db549a7b4082dc30655d9d2',ramdisk_id='',reservation_id='r-j6ewmg20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1630589831',owner_user_name='tempest-DeleteServersTestJSON-1630589831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:18:03Z,user_data=None,user_id='8f0773bcaad34af2ba2bab77b1eaef97',uuid=e637a0d4-d38e-46e0-8fde-3b45c2410439,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49a60955-c322-46d8-910d-31d4302f9f27", "address": "fa:16:3e:6b:ce:ba", "network": {"id": "57522509-2606-4962-aa15-fad15bf1dc6e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-863116301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcc401d03db549a7b4082dc30655d9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a60955-c3", "ovs_interfaceid": "49a60955-c322-46d8-910d-31d4302f9f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Converting VIF {"id": "49a60955-c322-46d8-910d-31d4302f9f27", "address": "fa:16:3e:6b:ce:ba", "network": {"id": "57522509-2606-4962-aa15-fad15bf1dc6e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-863116301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcc401d03db549a7b4082dc30655d9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49a60955-c3", "ovs_interfaceid": "49a60955-c322-46d8-910d-31d4302f9f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:ce:ba,bridge_name='br-int',has_traffic_filtering=True,id=49a60955-c322-46d8-910d-31d4302f9f27,network=Network(57522509-2606-4962-aa15-fad15bf1dc6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a60955-c3') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG os_vif [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:ce:ba,bridge_name='br-int',has_traffic_filtering=True,id=49a60955-c322-46d8-910d-31d4302f9f27,network=Network(57522509-2606-4962-aa15-fad15bf1dc6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a60955-c3') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49a60955-c3, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:20:01 user nova-compute[70243]: INFO os_vif [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:ce:ba,bridge_name='br-int',has_traffic_filtering=True,id=49a60955-c322-46d8-910d-31d4302f9f27,network=Network(57522509-2606-4962-aa15-fad15bf1dc6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49a60955-c3')
Jul 24 16:20:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CRAwgEUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:20:01 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:20:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fbc712-67ea-4d5b-b934-4545ec95a0cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:20:01 user nova-compute[70243]: No targets found.
Jul 24 16:20:01 user nova-compute[70243]: iSNS:
Jul 24 16:20:01 user nova-compute[70243]: No targets found.
Jul 24 16:20:01 user nova-compute[70243]: STATIC:
Jul 24 16:20:01 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c
Jul 24 16:20:01 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:01 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:01 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0
Jul 24 16:20:01 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:01 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:01 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b
Jul 24 16:20:01 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:01 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:01 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22
Jul 24 16:20:01 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:01 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:01 user nova-compute[70243]: FIRMWARE:
Jul 24 16:20:01 user nova-compute[70243]: No targets found.
Jul 24 16:20:01 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:20:01 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:20:01 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[11491788-49d0-4ee2-9392-51421969de91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f69775-ba6c-4fa3-83b4-494538e70364]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:01 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:01 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:01 user nova-compute[70243]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b (non-flash)
Jul 24 16:20:01 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:01 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:01 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:01 user nova-compute[70243]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b (non-flash)
Jul 24 16:20:01 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc56a710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b'): ({'sde'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Removing single pathed devices sde {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[577889ea-ad53-4d09-9c6e-25f25a397211]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5984253d-6289-47fc-9e51-3f763840ebd8]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Flushing IO for device /dev/sde {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[64315e33-783b-4a47-a4a6-e180f82bce18]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4fd770-589b-41ab-b51b-7eaaa4954e20]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] SCSI volumes sde have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[233580ef-2d87-4eb3-ac38-85a9b6bec59b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c547f4-e04f-4eaa-97b3-0e922b60f9a6]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b, portal: 172.16.0.220,3260]
Jul 24 16:20:01 user nova-compute[70243]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b, portal: 172.16.0.220,3260] successful.
Jul 24 16:20:01 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0497d54-cdc7-47dd-9317-169f8138777b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:02 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d3e6cd-870b-48f9-b5ba-651403b7a0dd]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:20:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] <== disconnect_volume: return (327ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:20:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:20:02 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Deleting instance files /opt/stack/data/nova/instances/e637a0d4-d38e-46e0-8fde-3b45c2410439_del
Jul 24 16:20:02 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Deletion of /opt/stack/data/nova/instances/e637a0d4-d38e-46e0-8fde-3b45c2410439_del complete
Jul 24 16:20:02 user nova-compute[70243]: INFO nova.compute.manager [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Took 1.29 seconds to destroy the instance on the hypervisor.
Jul 24 16:20:02 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:20:02 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:20:02 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:20:02 user nova-compute[70243]: DEBUG nova.compute.manager [req-5cb57c39-1c8f-4aed-9a9b-429c892853c3 req-a93f6dfa-f52d-43a8-885a-30b8084d0af6 service nova] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Received event network-vif-unplugged-49a60955-c322-46d8-910d-31d4302f9f27 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:20:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5cb57c39-1c8f-4aed-9a9b-429c892853c3 req-a93f6dfa-f52d-43a8-885a-30b8084d0af6 service nova] Acquiring lock "e637a0d4-d38e-46e0-8fde-3b45c2410439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5cb57c39-1c8f-4aed-9a9b-429c892853c3 req-a93f6dfa-f52d-43a8-885a-30b8084d0af6 service nova] Lock "e637a0d4-d38e-46e0-8fde-3b45c2410439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5cb57c39-1c8f-4aed-9a9b-429c892853c3 req-a93f6dfa-f52d-43a8-885a-30b8084d0af6 service nova] Lock "e637a0d4-d38e-46e0-8fde-3b45c2410439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:02 user nova-compute[70243]: DEBUG nova.compute.manager [req-5cb57c39-1c8f-4aed-9a9b-429c892853c3 req-a93f6dfa-f52d-43a8-885a-30b8084d0af6 service nova] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] No waiting events found dispatching network-vif-unplugged-49a60955-c322-46d8-910d-31d4302f9f27 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:20:02 user nova-compute[70243]: DEBUG nova.compute.manager [req-5cb57c39-1c8f-4aed-9a9b-429c892853c3 req-a93f6dfa-f52d-43a8-885a-30b8084d0af6 service nova] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Received event network-vif-unplugged-49a60955-c322-46d8-910d-31d4302f9f27 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:20:02 user nova-compute[70243]: DEBUG nova.compute.manager [req-5cb57c39-1c8f-4aed-9a9b-429c892853c3 req-a93f6dfa-f52d-43a8-885a-30b8084d0af6 service nova] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Received event network-vif-plugged-49a60955-c322-46d8-910d-31d4302f9f27 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:20:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5cb57c39-1c8f-4aed-9a9b-429c892853c3 req-a93f6dfa-f52d-43a8-885a-30b8084d0af6 service nova] Acquiring lock "e637a0d4-d38e-46e0-8fde-3b45c2410439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5cb57c39-1c8f-4aed-9a9b-429c892853c3 req-a93f6dfa-f52d-43a8-885a-30b8084d0af6 service nova] Lock "e637a0d4-d38e-46e0-8fde-3b45c2410439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5cb57c39-1c8f-4aed-9a9b-429c892853c3 req-a93f6dfa-f52d-43a8-885a-30b8084d0af6 service nova] Lock "e637a0d4-d38e-46e0-8fde-3b45c2410439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:02 user nova-compute[70243]: DEBUG nova.compute.manager [req-5cb57c39-1c8f-4aed-9a9b-429c892853c3 req-a93f6dfa-f52d-43a8-885a-30b8084d0af6 service nova] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] No waiting events found dispatching network-vif-plugged-49a60955-c322-46d8-910d-31d4302f9f27 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:20:02 user nova-compute[70243]: WARNING nova.compute.manager [req-5cb57c39-1c8f-4aed-9a9b-429c892853c3 req-a93f6dfa-f52d-43a8-885a-30b8084d0af6 service nova] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Received unexpected event network-vif-plugged-49a60955-c322-46d8-910d-31d4302f9f27 for instance with vm_state active and task_state deleting.
Jul 24 16:20:02 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:20:02 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Took 0.70 seconds to deallocate network for instance.
Jul 24 16:20:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG nova.compute.manager [req-0e0d129f-439a-406b-b8c4-711fca277d18 req-4ad23903-7502-459e-a1ac-c948e5ead775 service nova] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Received event network-vif-deleted-49a60955-c322-46d8-910d-31d4302f9f27 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'raMPwoih', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:20:04 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:20:04 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:20:04 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7145122-90a9-4f35-841b-48ad30881b8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:20:04 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b1474d-c835-4627-a848-7055a6292c83]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c] added
Jul 24 16:20:04 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[04eb3df8-78f2-42fe-b182-a0a9347b2acf]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2833b38-fd49-45e4-bd6e-afb770e3154b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v raMPwoih {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v raMPwoih" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d72af3b-624b-405d-8d05-4c5640aaccc6]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'raMPwoih'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6483c9c3-f80a-450f-93ef-9d3b8e8bd785]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd712b3-f054-4c05-9f9c-7763e3ac7d7b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:04 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:04 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:04 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:04 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:04 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:04 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d134afc-61f7-4e10-98dc-01fcbfc23d0c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c, portal: 172.16.0.220,3260]
Jul 24 16:20:04 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c, portal: 172.16.0.220,3260] successful.
Jul 24 16:20:04 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[349a77c0-58a8-4819-aa81-1ab51d99f294]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[532df241-14c7-4703-98d5-f4e5910058a8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:04 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:04 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:04 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:04 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:04 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:04 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:04 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:04 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b61905-52ce-4d2e-8e69-c6e02ee174bc]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:20:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'raMPwoih', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:20:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-86fc69a2-582f-4125-b787-193006fde72c req-f729c947-1b5f-431e-9898-2d08cadac1dc service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Received event network-changed-94a5d835-5e78-4c88-aae0-d00bd2adc163 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:20:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-86fc69a2-582f-4125-b787-193006fde72c req-f729c947-1b5f-431e-9898-2d08cadac1dc service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Refreshing instance network info cache due to event network-changed-94a5d835-5e78-4c88-aae0-d00bd2adc163. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:20:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-86fc69a2-582f-4125-b787-193006fde72c req-f729c947-1b5f-431e-9898-2d08cadac1dc service nova] Acquiring lock "refresh_cache-8cd7a53c-c100-4e43-a9d6-0d4517239e15" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:20:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-86fc69a2-582f-4125-b787-193006fde72c req-f729c947-1b5f-431e-9898-2d08cadac1dc service nova] Acquired lock "refresh_cache-8cd7a53c-c100-4e43-a9d6-0d4517239e15" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:20:05 user nova-compute[70243]: DEBUG nova.network.neutron [req-86fc69a2-582f-4125-b787-193006fde72c req-f729c947-1b5f-431e-9898-2d08cadac1dc service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Refreshing network info cache for port 94a5d835-5e78-4c88-aae0-d00bd2adc163 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:20:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:20:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26532636234623563', 'path': '/dev/sde'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:20:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532636234623563', 'path': '/dev/sde'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:20:05 user nova-compute[70243]: DEBUG nova.objects.instance [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'flavor' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:20:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:20:05 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:20:05 user nova-compute[70243]:   <source dev="/dev/sde"/>
Jul 24 16:20:05 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:20:05 user nova-compute[70243]:   <serial>d2139cf8-69f4-4150-a7c5-221311a1ac1c</serial>
Jul 24 16:20:05 user nova-compute[70243]: </disk>
Jul 24 16:20:05 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:20:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-94ca5f51-cbe7-45aa-8481-ec0f1177d0dc req-75505ffe-3eab-4417-8897-6a849e1b5783 service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Received event network-changed-da8433ea-b1c3-497e-b77c-fe0e87674dac {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:20:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-94ca5f51-cbe7-45aa-8481-ec0f1177d0dc req-75505ffe-3eab-4417-8897-6a849e1b5783 service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Refreshing instance network info cache due to event network-changed-da8433ea-b1c3-497e-b77c-fe0e87674dac. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:20:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-94ca5f51-cbe7-45aa-8481-ec0f1177d0dc req-75505ffe-3eab-4417-8897-6a849e1b5783 service nova] Acquiring lock "refresh_cache-c2ee17ba-3482-4caf-992e-30b3953d1e91" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:20:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-94ca5f51-cbe7-45aa-8481-ec0f1177d0dc req-75505ffe-3eab-4417-8897-6a849e1b5783 service nova] Acquired lock "refresh_cache-c2ee17ba-3482-4caf-992e-30b3953d1e91" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:20:05 user nova-compute[70243]: DEBUG nova.network.neutron [req-94ca5f51-cbe7-45aa-8481-ec0f1177d0dc req-75505ffe-3eab-4417-8897-6a849e1b5783 service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Refreshing network info cache for port da8433ea-b1c3-497e-b77c-fe0e87674dac {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:20:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:20:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:20:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] No VIF found with MAC fa:16:3e:0e:d8:8a, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:20:06 user nova-compute[70243]: DEBUG nova.network.neutron [req-86fc69a2-582f-4125-b787-193006fde72c req-f729c947-1b5f-431e-9898-2d08cadac1dc service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Updated VIF entry in instance network info cache for port 94a5d835-5e78-4c88-aae0-d00bd2adc163. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:20:06 user nova-compute[70243]: DEBUG nova.network.neutron [req-86fc69a2-582f-4125-b787-193006fde72c req-f729c947-1b5f-431e-9898-2d08cadac1dc service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Updating instance_info_cache with network_info: [{"id": "94a5d835-5e78-4c88-aae0-d00bd2adc163", "address": "fa:16:3e:16:5d:65", "network": {"id": "bd848428-14ae-4e21-a751-e2fd2550be5b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-174143408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c896c3ac00cb4843b0b82f360cf4d578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a5d835-5e", "ovs_interfaceid": "94a5d835-5e78-4c88-aae0-d00bd2adc163", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:20:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-86fc69a2-582f-4125-b787-193006fde72c req-f729c947-1b5f-431e-9898-2d08cadac1dc service nova] Releasing lock "refresh_cache-8cd7a53c-c100-4e43-a9d6-0d4517239e15" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:20:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f8271a5f-eeb3-44c2-8054-8d8b678317aa tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.901s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:06 user nova-compute[70243]: DEBUG nova.network.neutron [req-94ca5f51-cbe7-45aa-8481-ec0f1177d0dc req-75505ffe-3eab-4417-8897-6a849e1b5783 service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Updated VIF entry in instance network info cache for port da8433ea-b1c3-497e-b77c-fe0e87674dac. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:20:06 user nova-compute[70243]: DEBUG nova.network.neutron [req-94ca5f51-cbe7-45aa-8481-ec0f1177d0dc req-75505ffe-3eab-4417-8897-6a849e1b5783 service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Updating instance_info_cache with network_info: [{"id": "da8433ea-b1c3-497e-b77c-fe0e87674dac", "address": "fa:16:3e:43:e2:d2", "network": {"id": "798ddded-1cb9-4c01-9590-27f071d81a3c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1340440057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6973a869545f43e1bd096a5f6eaf921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda8433ea-b1", "ovs_interfaceid": "da8433ea-b1c3-497e-b77c-fe0e87674dac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:20:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-94ca5f51-cbe7-45aa-8481-ec0f1177d0dc req-75505ffe-3eab-4417-8897-6a849e1b5783 service nova] Releasing lock "refresh_cache-c2ee17ba-3482-4caf-992e-30b3953d1e91" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:20:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ff263a9a-293a-460f-8d05-89425f173b5a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "ad611655-ba4d-4a66-b78e-a82c058f4414" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ff263a9a-293a-460f-8d05-89425f173b5a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ff263a9a-293a-460f-8d05-89425f173b5a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ff263a9a-293a-460f-8d05-89425f173b5a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=70243) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3341}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.objects.instance [None req-ff263a9a-293a-460f-8d05-89425f173b5a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'flavor' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.compute.manager [req-3918926a-c743-4d4e-be79-7b5b3faedf61 req-c76130aa-c09f-438a-92e9-0368d629c501 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received event network-vif-unplugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3918926a-c743-4d4e-be79-7b5b3faedf61 req-c76130aa-c09f-438a-92e9-0368d629c501 service nova] Acquiring lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3918926a-c743-4d4e-be79-7b5b3faedf61 req-c76130aa-c09f-438a-92e9-0368d629c501 service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3918926a-c743-4d4e-be79-7b5b3faedf61 req-c76130aa-c09f-438a-92e9-0368d629c501 service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.compute.manager [req-3918926a-c743-4d4e-be79-7b5b3faedf61 req-c76130aa-c09f-438a-92e9-0368d629c501 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] No waiting events found dispatching network-vif-unplugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:20:07 user nova-compute[70243]: WARNING nova.compute.manager [req-3918926a-c743-4d4e-be79-7b5b3faedf61 req-c76130aa-c09f-438a-92e9-0368d629c501 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received unexpected event network-vif-unplugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 for instance with vm_state active and task_state powering-off.
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:20:07 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Creating image(s)
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Did not create local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Ensure instance console log exists: /opt/stack/data/nova/instances/fd314e21-b1a5-425d-a5e0-c1b3303b72d4/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Start _get_guest_xml network_info=[{"id": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "address": "fa:16:3e:92:b1:e8", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc58b9-95", "ovs_interfaceid": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'futGLMdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fd314e21-b1a5-425d-a5e0-c1b3303b72d4', 'attached_at': '', 'detached_at': '', 'volume_id': '75d2beea-53f6-4026-a9fa-a819238dbf73', 'serial': '75d2beea-53f6-4026-a9fa-a819238dbf73'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'fbea47d7-0095-460d-9746-e000bdd90c3a', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:20:07 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:20:07 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'futGLMdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:20:07 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:20:07 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:20:07 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[691490e7-572f-41a9-9fbc-88948009f561]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:20:07 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acc61af-e755-46ec-a3e4-1ab4c6e10d12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73] added
Jul 24 16:20:07 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a17c28-f3f8-4048-8831-bef1f079d8e4]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8600f292-7d45-4791-bac8-f9f29c05a274]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v futGLMdw {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v futGLMdw" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b142fc-1fee-4dee-a68e-160a50c9d0a6]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'futGLMdw'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:07 user nova-compute[70243]: INFO nova.compute.manager [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Took 4.93 seconds to detach 1 volumes for instance.
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65c2905-8669-422d-b7af-6a4a7f1ce3cf]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ac894d-866f-47ee-bb38-d8bc840f1963]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:07 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:07 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:07 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:07 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:07 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:07 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:07 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:07 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8571d8-b3a7-4cdc-977d-e1a8a81b66cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73, portal: 172.16.0.220,3260]
Jul 24 16:20:07 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73, portal: 172.16.0.220,3260] successful.
Jul 24 16:20:07 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[de505363-f37c-4ebb-b244-442b816a20d2]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:07 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Instance destroyed successfully.
Jul 24 16:20:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ff263a9a-293a-460f-8d05-89425f173b5a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a27d9af-dcad-4df5-ad4f-be07651e89d9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:07 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:07 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:07 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:07 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:07 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:07 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:07 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:07 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:07 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:07 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42b7496-c98d-40a9-b719-1bc3b6562be5]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'futGLMdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:20:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ff263a9a-293a-460f-8d05-89425f173b5a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.970s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:08 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:20:08 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:20:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.565s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:08 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Deleted allocations for instance e637a0d4-d38e-46e0-8fde-3b45c2410439
Jul 24 16:20:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ec29c0f1-f8c9-4b12-883f-b0b9b109afa1 tempest-DeleteServersTestJSON-1630589831 tempest-DeleteServersTestJSON-1630589831-project-member] Lock "e637a0d4-d38e-46e0-8fde-3b45c2410439" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.712s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '26666623236633332', 'path': '/dev/sdf'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666623236633332', 'path': '/dev/sdf'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:19:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1050817232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1050817232',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJugPMjzC3sjisDM8EAfC1nB8cVCVLT9x+8UIOeaWrQRyN8J62vtUyTY9fsadBD/m66uRYjMwVz+mSleYDM8PIyy3oS1j2G/C6AKWNTLgTzZDawO9o6JDWYdg27VAeNPCw==',key_name='tempest-keypair-987230631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec24d98248104f5f898cf6f79207435b',ramdisk_id='',reservation_id='r-xz0z2ofe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1173962228',owner_user_name='tempest-ServerActionsV293TestJSON-1173962228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:19:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93b6ed534c2c44d08a71f3050e212644',uuid=fd314e21-b1a5-425d-a5e0-c1b3303b72d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "address": "fa:16:3e:92:b1:e8", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc58b9-95", "ovs_interfaceid": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Converting VIF {"id": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "address": "fa:16:3e:92:b1:e8", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc58b9-95", "ovs_interfaceid": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:b1:e8,bridge_name='br-int',has_traffic_filtering=True,id=51cc58b9-958f-41dd-bf1d-596ca7c6d5ce,network=Network(3ed67d60-f22b-4d39-9563-c680c176858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cc58b9-95') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG nova.objects.instance [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lazy-loading 'pci_devices' on Instance uuid fd314e21-b1a5-425d-a5e0-c1b3303b72d4 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:20:09 user nova-compute[70243]:   <uuid>fd314e21-b1a5-425d-a5e0-c1b3303b72d4</uuid>
Jul 24 16:20:09 user nova-compute[70243]:   <name>instance-0000000b</name>
Jul 24 16:20:09 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:20:09 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:20:09 user nova-compute[70243]:   <metadata>
Jul 24 16:20:09 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:20:09 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:20:09 user nova-compute[70243]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1050817232</nova:name>
Jul 24 16:20:09 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:20:07</nova:creationTime>
Jul 24 16:20:09 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:20:09 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:20:09 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:20:09 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:20:09 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:20:09 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:20:09 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:20:09 user nova-compute[70243]:       <nova:owner>
Jul 24 16:20:09 user nova-compute[70243]:         <nova:user uuid="93b6ed534c2c44d08a71f3050e212644">tempest-ServerActionsV293TestJSON-1173962228-project-member</nova:user>
Jul 24 16:20:09 user nova-compute[70243]:         <nova:project uuid="ec24d98248104f5f898cf6f79207435b">tempest-ServerActionsV293TestJSON-1173962228</nova:project>
Jul 24 16:20:09 user nova-compute[70243]:       </nova:owner>
Jul 24 16:20:09 user nova-compute[70243]:       <nova:ports>
Jul 24 16:20:09 user nova-compute[70243]:         <nova:port uuid="51cc58b9-958f-41dd-bf1d-596ca7c6d5ce">
Jul 24 16:20:09 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 24 16:20:09 user nova-compute[70243]:         </nova:port>
Jul 24 16:20:09 user nova-compute[70243]:       </nova:ports>
Jul 24 16:20:09 user nova-compute[70243]:     </nova:instance>
Jul 24 16:20:09 user nova-compute[70243]:   </metadata>
Jul 24 16:20:09 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:20:09 user nova-compute[70243]:     <system>
Jul 24 16:20:09 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:20:09 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:20:09 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:20:09 user nova-compute[70243]:       <entry name="serial">fd314e21-b1a5-425d-a5e0-c1b3303b72d4</entry>
Jul 24 16:20:09 user nova-compute[70243]:       <entry name="uuid">fd314e21-b1a5-425d-a5e0-c1b3303b72d4</entry>
Jul 24 16:20:09 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:20:09 user nova-compute[70243]:     </system>
Jul 24 16:20:09 user nova-compute[70243]:   </sysinfo>
Jul 24 16:20:09 user nova-compute[70243]:   <os>
Jul 24 16:20:09 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:20:09 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:20:09 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:20:09 user nova-compute[70243]:   </os>
Jul 24 16:20:09 user nova-compute[70243]:   <features>
Jul 24 16:20:09 user nova-compute[70243]:     <acpi/>
Jul 24 16:20:09 user nova-compute[70243]:     <apic/>
Jul 24 16:20:09 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:20:09 user nova-compute[70243]:   </features>
Jul 24 16:20:09 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:20:09 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:20:09 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:20:09 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:20:09 user nova-compute[70243]:   </clock>
Jul 24 16:20:09 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:20:09 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:20:09 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:20:09 user nova-compute[70243]:   </cpu>
Jul 24 16:20:09 user nova-compute[70243]:   <devices>
Jul 24 16:20:09 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:20:09 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:20:09 user nova-compute[70243]:       <source dev="/dev/sdf"/>
Jul 24 16:20:09 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:20:09 user nova-compute[70243]:       <serial>75d2beea-53f6-4026-a9fa-a819238dbf73</serial>
Jul 24 16:20:09 user nova-compute[70243]:     </disk>
Jul 24 16:20:09 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:20:09 user nova-compute[70243]:       <mac address="fa:16:3e:92:b1:e8"/>
Jul 24 16:20:09 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:20:09 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:20:09 user nova-compute[70243]:       <target dev="tap51cc58b9-95"/>
Jul 24 16:20:09 user nova-compute[70243]:     </interface>
Jul 24 16:20:09 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:20:09 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/fd314e21-b1a5-425d-a5e0-c1b3303b72d4/console.log" append="off"/>
Jul 24 16:20:09 user nova-compute[70243]:     </serial>
Jul 24 16:20:09 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:20:09 user nova-compute[70243]:     <video>
Jul 24 16:20:09 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:20:09 user nova-compute[70243]:     </video>
Jul 24 16:20:09 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:20:09 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:20:09 user nova-compute[70243]:     </rng>
Jul 24 16:20:09 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:20:09 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:20:09 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:20:09 user nova-compute[70243]:     </memballoon>
Jul 24 16:20:09 user nova-compute[70243]:   </devices>
Jul 24 16:20:09 user nova-compute[70243]: </domain>
Jul 24 16:20:09 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:19:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1050817232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1050817232',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJugPMjzC3sjisDM8EAfC1nB8cVCVLT9x+8UIOeaWrQRyN8J62vtUyTY9fsadBD/m66uRYjMwVz+mSleYDM8PIyy3oS1j2G/C6AKWNTLgTzZDawO9o6JDWYdg27VAeNPCw==',key_name='tempest-keypair-987230631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec24d98248104f5f898cf6f79207435b',ramdisk_id='',reservation_id='r-xz0z2ofe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1173962228',owner_user_name='tempest-ServerActionsV293TestJSON-1173962228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:19:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93b6ed534c2c44d08a71f3050e212644',uuid=fd314e21-b1a5-425d-a5e0-c1b3303b72d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "address": "fa:16:3e:92:b1:e8", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc58b9-95", "ovs_interfaceid": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Converting VIF {"id": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "address": "fa:16:3e:92:b1:e8", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc58b9-95", "ovs_interfaceid": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:b1:e8,bridge_name='br-int',has_traffic_filtering=True,id=51cc58b9-958f-41dd-bf1d-596ca7c6d5ce,network=Network(3ed67d60-f22b-4d39-9563-c680c176858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cc58b9-95') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG os_vif [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:b1:e8,bridge_name='br-int',has_traffic_filtering=True,id=51cc58b9-958f-41dd-bf1d-596ca7c6d5ce,network=Network(3ed67d60-f22b-4d39-9563-c680c176858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cc58b9-95') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51cc58b9-95, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap51cc58b9-95, col_values=(('external_ids', {'iface-id': '51cc58b9-958f-41dd-bf1d-596ca7c6d5ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:b1:e8', 'vm-uuid': 'fd314e21-b1a5-425d-a5e0-c1b3303b72d4'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:09 user nova-compute[70243]: INFO os_vif [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:b1:e8,bridge_name='br-int',has_traffic_filtering=True,id=51cc58b9-958f-41dd-bf1d-596ca7c6d5ce,network=Network(3ed67d60-f22b-4d39-9563-c680c176858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cc58b9-95')
Jul 24 16:20:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] No VIF found with MAC fa:16:3e:92:b1:e8, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-ddc70308-b58c-4a25-bbe4-578b5bd7f447 req-7d8d9954-2f16-4e9e-8701-a6fe626daeb5 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received event network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ddc70308-b58c-4a25-bbe4-578b5bd7f447 req-7d8d9954-2f16-4e9e-8701-a6fe626daeb5 service nova] Acquiring lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ddc70308-b58c-4a25-bbe4-578b5bd7f447 req-7d8d9954-2f16-4e9e-8701-a6fe626daeb5 service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ddc70308-b58c-4a25-bbe4-578b5bd7f447 req-7d8d9954-2f16-4e9e-8701-a6fe626daeb5 service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-ddc70308-b58c-4a25-bbe4-578b5bd7f447 req-7d8d9954-2f16-4e9e-8701-a6fe626daeb5 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] No waiting events found dispatching network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:20:09 user nova-compute[70243]: WARNING nova.compute.manager [req-ddc70308-b58c-4a25-bbe4-578b5bd7f447 req-7d8d9954-2f16-4e9e-8701-a6fe626daeb5 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received unexpected event network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 for instance with vm_state stopped and task_state None.
Jul 24 16:20:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Acquiring lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG nova.objects.instance [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lazy-loading 'flavor' on Instance uuid 8cd7a53c-c100-4e43-a9d6-0d4517239e15 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "c2ee17ba-3482-4caf-992e-30b3953d1e91" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "c2ee17ba-3482-4caf-992e-30b3953d1e91" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG nova.objects.instance [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lazy-loading 'flavor' on Instance uuid c2ee17ba-3482-4caf-992e-30b3953d1e91 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "c2ee17ba-3482-4caf-992e-30b3953d1e91" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Acquiring lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:09 user nova-compute[70243]: INFO nova.compute.manager [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Attaching volume d237ef70-3b84-4db8-900c-f12490ed86f8 to /dev/sdc
Jul 24 16:20:10 user nova-compute[70243]: DEBUG os_brick.utils [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf8217a-3cdd-4b10-afe2-8b9df15f805b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "c2ee17ba-3482-4caf-992e-30b3953d1e91" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "c2ee17ba-3482-4caf-992e-30b3953d1e91" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:10 user nova-compute[70243]: INFO nova.compute.manager [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Attaching volume f9e06677-8d02-4304-8409-cdbc5443520e to /dev/vdb
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b50bbc-4a25-47c0-a503-e31435189aa1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e210dc26-b4bf-40ca-bf92-abadd645512b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9198f83e-7961-4d59-b54b-744fb37c6f92]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG os_brick.utils [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:20:10 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[259a7e51-1faa-4e88-9114-95f6fb0923ee]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG os_brick.utils [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Updating existing volume attachment record: 4411bbba-aeb7-4298-967c-f216e586b8be {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2080af5-863d-4a71-a044-40da6b4b7e4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e395880d-d29e-450f-b22b-bbfe09d29730]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e8135e-256c-4217-a166-9765d17a5b4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68a8b75-bfe2-485a-8326-cdf131c93b0f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:20:10 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:20:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b31d26-e1ca-42e3-ba3c-f1f152a57e48]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG os_brick.utils [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Updating existing volume attachment record: 2b365e59-a616-4c85-944c-a0143990733a {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:11 user nova-compute[70243]: DEBUG nova.compute.manager [req-58dd753d-3409-49ba-ba72-b7c1ece6ea35 req-e1d25de2-ea32-4999-8f34-378b4b77e411 service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Received event network-vif-plugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:20:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-58dd753d-3409-49ba-ba72-b7c1ece6ea35 req-e1d25de2-ea32-4999-8f34-378b4b77e411 service nova] Acquiring lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-58dd753d-3409-49ba-ba72-b7c1ece6ea35 req-e1d25de2-ea32-4999-8f34-378b4b77e411 service nova] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-58dd753d-3409-49ba-ba72-b7c1ece6ea35 req-e1d25de2-ea32-4999-8f34-378b4b77e411 service nova] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:11 user nova-compute[70243]: DEBUG nova.compute.manager [req-58dd753d-3409-49ba-ba72-b7c1ece6ea35 req-e1d25de2-ea32-4999-8f34-378b4b77e411 service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] No waiting events found dispatching network-vif-plugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:20:11 user nova-compute[70243]: WARNING nova.compute.manager [req-58dd753d-3409-49ba-ba72-b7c1ece6ea35 req-e1d25de2-ea32-4999-8f34-378b4b77e411 service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Received unexpected event network-vif-plugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce for instance with vm_state building and task_state spawning.
Jul 24 16:20:12 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215612.8023224, fd314e21-b1a5-425d-a5e0-c1b3303b72d4 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:20:12 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] VM Resumed (Lifecycle Event)
Jul 24 16:20:12 user nova-compute[70243]: DEBUG nova.compute.manager [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:20:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:20:12 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Instance spawned successfully.
Jul 24 16:20:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:20:12 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:20:12 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:20:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:20:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:20:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:20:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:20:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:20:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:20:12 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:20:12 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215612.8044224, fd314e21-b1a5-425d-a5e0-c1b3303b72d4 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:20:12 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] VM Started (Lifecycle Event)
Jul 24 16:20:12 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:20:12 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:20:12 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:20:12 user nova-compute[70243]: INFO nova.compute.manager [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Took 5.42 seconds to spawn the instance on the hypervisor.
Jul 24 16:20:12 user nova-compute[70243]: DEBUG nova.compute.manager [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:20:13 user nova-compute[70243]: INFO nova.compute.manager [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Took 16.05 seconds to build instance.
Jul 24 16:20:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26362b3f-62e8-40fa-9ab8-4747549e6bf8 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.174s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:13 user nova-compute[70243]: DEBUG nova.compute.manager [req-d9621025-8f13-4de6-8182-1a1f356a13b9 req-fd9f97f8-fb65-4ddf-b87c-270396399a51 service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Received event network-vif-plugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:20:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d9621025-8f13-4de6-8182-1a1f356a13b9 req-fd9f97f8-fb65-4ddf-b87c-270396399a51 service nova] Acquiring lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d9621025-8f13-4de6-8182-1a1f356a13b9 req-fd9f97f8-fb65-4ddf-b87c-270396399a51 service nova] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d9621025-8f13-4de6-8182-1a1f356a13b9 req-fd9f97f8-fb65-4ddf-b87c-270396399a51 service nova] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:13 user nova-compute[70243]: DEBUG nova.compute.manager [req-d9621025-8f13-4de6-8182-1a1f356a13b9 req-fd9f97f8-fb65-4ddf-b87c-270396399a51 service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] No waiting events found dispatching network-vif-plugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:20:13 user nova-compute[70243]: WARNING nova.compute.manager [req-d9621025-8f13-4de6-8182-1a1f356a13b9 req-fd9f97f8-fb65-4ddf-b87c-270396399a51 service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Received unexpected event network-vif-plugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce for instance with vm_state active and task_state None.
Jul 24 16:20:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG nova.compute.manager [req-12f4855e-c8fb-4461-b3c2-54a3f2bd667d req-aef54402-7657-495f-963e-f43da494f560 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Received event network-changed-0bfc720a-e7ed-4eb1-b945-6565c661adef {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG nova.compute.manager [req-12f4855e-c8fb-4461-b3c2-54a3f2bd667d req-aef54402-7657-495f-963e-f43da494f560 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Refreshing instance network info cache due to event network-changed-0bfc720a-e7ed-4eb1-b945-6565c661adef. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-12f4855e-c8fb-4461-b3c2-54a3f2bd667d req-aef54402-7657-495f-963e-f43da494f560 service nova] Acquiring lock "refresh_cache-5e6a5fff-570c-4ee2-b883-415ec828ef97" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-12f4855e-c8fb-4461-b3c2-54a3f2bd667d req-aef54402-7657-495f-963e-f43da494f560 service nova] Acquired lock "refresh_cache-5e6a5fff-570c-4ee2-b883-415ec828ef97" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG nova.network.neutron [req-12f4855e-c8fb-4461-b3c2-54a3f2bd667d req-aef54402-7657-495f-963e-f43da494f560 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Refreshing network info cache for port 0bfc720a-e7ed-4eb1-b945-6565c661adef {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Acquiring lock "5e6a5fff-570c-4ee2-b883-415ec828ef97" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG nova.objects.instance [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lazy-loading 'flavor' on Instance uuid 5e6a5fff-570c-4ee2-b883-415ec828ef97 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Acquiring lock "5e6a5fff-570c-4ee2-b883-415ec828ef97" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:16 user nova-compute[70243]: INFO nova.compute.manager [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Attaching volume 55df5015-2667-4614-b99e-cb00ff91a4bf to /dev/vdb
Jul 24 16:20:16 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690215601.6018364, e637a0d4-d38e-46e0-8fde-3b45c2410439 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:20:16 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] VM Stopped (Lifecycle Event)
Jul 24 16:20:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-17b8ebd4-69ee-4387-91e4-8fcf71ccff97 None None] [instance: e637a0d4-d38e-46e0-8fde-3b45c2410439] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG nova.network.neutron [req-12f4855e-c8fb-4461-b3c2-54a3f2bd667d req-aef54402-7657-495f-963e-f43da494f560 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Updated VIF entry in instance network info cache for port 0bfc720a-e7ed-4eb1-b945-6565c661adef. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG nova.network.neutron [req-12f4855e-c8fb-4461-b3c2-54a3f2bd667d req-aef54402-7657-495f-963e-f43da494f560 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Updating instance_info_cache with network_info: [{"id": "0bfc720a-e7ed-4eb1-b945-6565c661adef", "address": "fa:16:3e:bb:31:a5", "network": {"id": "97e0a268-3307-41b7-a748-0a9f3dfc8629", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1229538256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18cd7d48387343179ba49b66c119c405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfc720a-e7", "ovs_interfaceid": "0bfc720a-e7ed-4eb1-b945-6565c661adef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-12f4855e-c8fb-4461-b3c2-54a3f2bd667d req-aef54402-7657-495f-963e-f43da494f560 service nova] Releasing lock "refresh_cache-5e6a5fff-570c-4ee2-b883-415ec828ef97" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG os_brick.utils [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53ddcd1-247e-459c-897c-410667454a29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5ffa45-d347-4ff5-b83c-c7c610dd8940]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed0a49a-a400-4b65-b581-cfdac58d6017]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b124302-e3b6-499d-aee5-745a2f36b463]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:20:16 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:20:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2430514-9371-497b-9b7e-29463738c150]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG os_brick.utils [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:20:16 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Updating existing volume attachment record: 2960cfed-b301-484a-80f5-83415020dba7 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:20:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:20:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOFaqMIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:20:17 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:20:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:20:18 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:20:18 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c1788b-a024-4694-97f3-279eddcd557f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:20:18 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[812a3557-f74f-496d-8bea-b4d948c54adb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8] added
Jul 24 16:20:18 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[920e3cc7-6232-4cf0-8c9a-a5d29155d7ab]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a524244-2091-4a3c-888f-e6a3eee2a2d0]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kOFaqMIZ {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kOFaqMIZ" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7dd41c-f4e1-4aa7-9c46-7a307c9a36f0]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kOFaqMIZ'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.043s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b8058e-0536-49dd-b2e6-19e9b013a27a]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b72a130-6f63-4518-83d9-0875ad27b752]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:18 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:18 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:18 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:18 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:18 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:18 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:18 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:18 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:18 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:18 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[deca308c-04ff-4795-9dc9-f59dfca226fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8, portal: 172.16.0.220,3260]
Jul 24 16:20:18 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8, portal: 172.16.0.220,3260] successful.
Jul 24 16:20:18 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[22928ba7-056f-4fb5-a039-fe38aa8e8106]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f974813-98af-45c6-afca-8e1d9a7b1cec]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:18 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:18 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:18 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:18 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:18 user nova-compute[70243]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 (non-flash)
Jul 24 16:20:18 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:18 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:18 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:18 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:18 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:18 user nova-compute[70243]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 (non-flash)
Jul 24 16:20:18 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jkGTnOua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:20:18 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4103a8-d89c-4e0a-bf6a-d4451a9d5818]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:20:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOFaqMIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '26537383261656265', 'path': '/dev/sdg'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537383261656265', 'path': '/dev/sdg'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.023s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:20:19 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:20:19 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG nova.objects.instance [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lazy-loading 'flavor' on Instance uuid 8cd7a53c-c100-4e43-a9d6-0d4517239e15 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcbaabb-e7d5-41bb-a06f-bed9a94db5c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:20:19 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:20:19 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:20:19 user nova-compute[70243]:   <source dev="/dev/sdg"/>
Jul 24 16:20:19 user nova-compute[70243]:   <target dev="sdc" bus="scsi"/>
Jul 24 16:20:19 user nova-compute[70243]:   <serial>d237ef70-3b84-4db8-900c-f12490ed86f8</serial>
Jul 24 16:20:19 user nova-compute[70243]:   <address type="drive" controller="0" unit="2"/>
Jul 24 16:20:19 user nova-compute[70243]: </disk>
Jul 24 16:20:19 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c50333-cde0-4fbd-8bc5-df4ae58ccff3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e] added
Jul 24 16:20:19 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4744a9-4fef-44f8-b2f1-87edfec5e1bf]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1013ed-d55b-4d72-9dea-f72aafc4083f]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jkGTnOua {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jkGTnOua" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[913ab207-4253-4c5d-be64-5bb6a7142eb1]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jkGTnOua'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ccd79f-c463-4db8-90f5-a70c47f7c2cc]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f37f2b-8b49-46f1-8dbc-7aac43e99781]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:19 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:19 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:19 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:19 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:19 user nova-compute[70243]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 (non-flash)
Jul 24 16:20:19 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:19 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:19 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:19 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:19 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:19 user nova-compute[70243]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 (non-flash)
Jul 24 16:20:19 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[617fa40d-be7a-4bf9-b23e-3dd5c8fe9f06]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e, portal: 172.16.0.220,3260]
Jul 24 16:20:19 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e, portal: 172.16.0.220,3260] successful.
Jul 24 16:20:19 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e87076-9ebb-4c30-8af4-189aa7ae592b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71e99b4-afde-493c-b2c3-1c3cd44a18ba]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:19 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:19 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:19 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:19 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:19 user nova-compute[70243]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 (non-flash)
Jul 24 16:20:19 user nova-compute[70243]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e (non-flash)
Jul 24 16:20:19 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:19 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:19 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:19 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:19 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:19 user nova-compute[70243]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 (non-flash)
Jul 24 16:20:19 user nova-compute[70243]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e (non-flash)
Jul 24 16:20:19 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[90732420-a3f0-4122-bb0a-d9ec2646d4bc]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jkGTnOua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] No BDM found with device name sda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] No BDM found with device name sdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] No BDM found with device name sdc, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:20:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] No VIF found with MAC fa:16:3e:16:5d:65, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:20:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-52f61396-8644-4846-807b-bcbf3fa5976b tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.120s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Acquiring lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:20 user nova-compute[70243]: INFO nova.compute.manager [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Detaching volume d237ef70-3b84-4db8-900c-f12490ed86f8
Jul 24 16:20:20 user nova-compute[70243]: INFO nova.virt.block_device [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Attempting to driver detach volume d237ef70-3b84-4db8-900c-f12490ed86f8 from mountpoint /dev/sdc
Jul 24 16:20:20 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:20:20 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] <== connect_volume: return (2385ms) {'type': 'block', 'scsi_wwn': '26539336632383235', 'path': '/dev/sdh'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:20:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539336632383235', 'path': '/dev/sdh'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:20:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Attempting to detach device sdc from instance 8cd7a53c-c100-4e43-a9d6-0d4517239e15 from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:20:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:20:20 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:20:20 user nova-compute[70243]:   <source dev="/dev/sdg"/>
Jul 24 16:20:20 user nova-compute[70243]:   <target dev="sdc" bus="scsi"/>
Jul 24 16:20:20 user nova-compute[70243]:   <serial>d237ef70-3b84-4db8-900c-f12490ed86f8</serial>
Jul 24 16:20:20 user nova-compute[70243]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 24 16:20:20 user nova-compute[70243]: </disk>
Jul 24 16:20:20 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:20:20 user nova-compute[70243]: DEBUG nova.objects.instance [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lazy-loading 'flavor' on Instance uuid c2ee17ba-3482-4caf-992e-30b3953d1e91 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:20:20 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Successfully detached device sdc from instance 8cd7a53c-c100-4e43-a9d6-0d4517239e15 from the persistent domain config.
Jul 24 16:20:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 8cd7a53c-c100-4e43-a9d6-0d4517239e15 from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:20:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:20:20 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:20:20 user nova-compute[70243]:   <source dev="/dev/sdg"/>
Jul 24 16:20:20 user nova-compute[70243]:   <target dev="sdc" bus="scsi"/>
Jul 24 16:20:20 user nova-compute[70243]:   <serial>d237ef70-3b84-4db8-900c-f12490ed86f8</serial>
Jul 24 16:20:20 user nova-compute[70243]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 24 16:20:20 user nova-compute[70243]: </disk>
Jul 24 16:20:20 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:20:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:20:20 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:20:20 user nova-compute[70243]:   <source dev="/dev/sdh"/>
Jul 24 16:20:20 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:20:20 user nova-compute[70243]:   <serial>f9e06677-8d02-4304-8409-cdbc5443520e</serial>
Jul 24 16:20:20 user nova-compute[70243]: </disk>
Jul 24 16:20:20 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] No VIF found with MAC fa:16:3e:43:e2:d2, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e86fe26d-e7a9-40f8-8b48-0d2233056f01 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "c2ee17ba-3482-4caf-992e-30b3953d1e91" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.273s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690215621.4781222, 8cd7a53c-c100-4e43-a9d6-0d4517239e15 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 8cd7a53c-c100-4e43-a9d6-0d4517239e15 {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:20:21 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Successfully detached device sdc from instance 8cd7a53c-c100-4e43-a9d6-0d4517239e15 from the live domain config.
Jul 24 16:20:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOFaqMIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:20:21 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:20:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fd2593-8aae-45f6-8010-b586b7b5cf04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:20:21 user nova-compute[70243]: No targets found.
Jul 24 16:20:21 user nova-compute[70243]: iSNS:
Jul 24 16:20:21 user nova-compute[70243]: No targets found.
Jul 24 16:20:21 user nova-compute[70243]: STATIC:
Jul 24 16:20:21 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c
Jul 24 16:20:21 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:21 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:21 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0
Jul 24 16:20:21 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:21 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:21 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73
Jul 24 16:20:21 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:21 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:21 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8
Jul 24 16:20:21 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:21 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:21 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22
Jul 24 16:20:21 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:21 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:21 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c
Jul 24 16:20:21 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:21 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:21 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e
Jul 24 16:20:21 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:21 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:21 user nova-compute[70243]: FIRMWARE:
Jul 24 16:20:21 user nova-compute[70243]: No targets found.
Jul 24 16:20:21 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:20:21 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:20:21 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[777a4e3b-acbe-41f6-adb8-f928713c0b44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cffde9c-fd93-4f61-8c8f-9c4a74a66070]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:21 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:21 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:21 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:21 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:21 user nova-compute[70243]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 (non-flash)
Jul 24 16:20:21 user nova-compute[70243]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e (non-flash)
Jul 24 16:20:21 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:21 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:21 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:21 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:21 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:21 user nova-compute[70243]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 (non-flash)
Jul 24 16:20:21 user nova-compute[70243]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e (non-flash)
Jul 24 16:20:21 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc57dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8'): ({'sdg'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Removing single pathed devices sdg {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d909c1fe-c2f9-42c0-80ce-cb2c4e82f9b0]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1ffa7c-3833-4ddc-9640-6f598835ad0a]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Flushing IO for device /dev/sdg {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad844f0-2175-4c6b-b446-7569dd649ef2]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6244f1de-3c5f-439b-9543-0c50138318db]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] SCSI volumes sdg have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf7a886-ef22-421e-bfac-3fb47401b0a5]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e801283f-b2f9-434b-867a-497d48dd26c9]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8, portal: 172.16.0.220,3260]
Jul 24 16:20:21 user nova-compute[70243]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8, portal: 172.16.0.220,3260] successful.
Jul 24 16:20:21 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d237ef70-3b84-4db8-900c-f12490ed86f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a29c53-1341-4678-b13f-16fce183ea18]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] <== disconnect_volume: return (345ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:20:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:20:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "c2ee17ba-3482-4caf-992e-30b3953d1e91" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "c2ee17ba-3482-4caf-992e-30b3953d1e91" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:22 user nova-compute[70243]: INFO nova.compute.manager [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Detaching volume f9e06677-8d02-4304-8409-cdbc5443520e
Jul 24 16:20:22 user nova-compute[70243]: INFO nova.virt.block_device [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Attempting to driver detach volume f9e06677-8d02-4304-8409-cdbc5443520e from mountpoint /dev/vdb
Jul 24 16:20:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Attempting to detach device vdb from instance c2ee17ba-3482-4caf-992e-30b3953d1e91 from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:20:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:20:22 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:20:22 user nova-compute[70243]:   <source dev="/dev/sdh"/>
Jul 24 16:20:22 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:20:22 user nova-compute[70243]:   <serial>f9e06677-8d02-4304-8409-cdbc5443520e</serial>
Jul 24 16:20:22 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:20:22 user nova-compute[70243]: </disk>
Jul 24 16:20:22 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:20:22 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Successfully detached device vdb from instance c2ee17ba-3482-4caf-992e-30b3953d1e91 from the persistent domain config.
Jul 24 16:20:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c2ee17ba-3482-4caf-992e-30b3953d1e91 from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:20:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:20:22 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:20:22 user nova-compute[70243]:   <source dev="/dev/sdh"/>
Jul 24 16:20:22 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:20:22 user nova-compute[70243]:   <serial>f9e06677-8d02-4304-8409-cdbc5443520e</serial>
Jul 24 16:20:22 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:20:22 user nova-compute[70243]: </disk>
Jul 24 16:20:22 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:20:22 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lazy-loading 'flavor' on Instance uuid 8cd7a53c-c100-4e43-a9d6-0d4517239e15 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:20:22 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690215607.8720927, ad611655-ba4d-4a66-b78e-a82c058f4414 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:20:22 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] VM Stopped (Lifecycle Event)
Jul 24 16:20:22 user nova-compute[70243]: DEBUG nova.compute.manager [None req-31852e88-ead9-4b42-9a49-ffa06183b4e5 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:20:22 user nova-compute[70243]: DEBUG nova.compute.manager [None req-31852e88-ead9-4b42-9a49-ffa06183b4e5 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:20:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4701e6e-af58-4208-b80e-171d15122ff4 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.235s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690215623.079504, c2ee17ba-3482-4caf-992e-30b3953d1e91 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c2ee17ba-3482-4caf-992e-30b3953d1e91 {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:20:23 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Successfully detached device vdb from instance c2ee17ba-3482-4caf-992e-30b3953d1e91 from the live domain config.
Jul 24 16:20:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jkGTnOua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:20:23 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:20:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[49577f47-33b4-4048-a8c3-c124bf5a1ded]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:20:23 user nova-compute[70243]: No targets found.
Jul 24 16:20:23 user nova-compute[70243]: iSNS:
Jul 24 16:20:23 user nova-compute[70243]: No targets found.
Jul 24 16:20:23 user nova-compute[70243]: STATIC:
Jul 24 16:20:23 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c
Jul 24 16:20:23 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:23 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:23 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0
Jul 24 16:20:23 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:23 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:23 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73
Jul 24 16:20:23 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:23 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:23 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22
Jul 24 16:20:23 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:23 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:23 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c
Jul 24 16:20:23 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:23 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:23 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e
Jul 24 16:20:23 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:23 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:23 user nova-compute[70243]: FIRMWARE:
Jul 24 16:20:23 user nova-compute[70243]: No targets found.
Jul 24 16:20:23 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:20:23 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:20:23 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b0acbb-d9b5-4e12-b46e-ff3290fd531d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[440834dc-ed4d-4c4d-8c9a-08b86cd0a934]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:23 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:23 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:23 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:23 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:23 user nova-compute[70243]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e (non-flash)
Jul 24 16:20:23 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:23 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:23 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:23 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:23 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:23 user nova-compute[70243]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e (non-flash)
Jul 24 16:20:23 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91fe140af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e'): ({'sdh'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Removing single pathed devices sdh {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[983d3320-f021-44f4-a4ea-c11a77c58258]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4677d522-67f2-49bb-a104-33aea9fbbd4c]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Flushing IO for device /dev/sdh {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5e26a7-0f94-4ad8-804e-f88fd5b8f90e]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.039s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64d2f66-e940-469d-a568-93ae949126d0]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] SCSI volumes sdh have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c4618a-84b2-48eb-a64f-fe766a3be6dc]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e -p 172.16.0.220:3260 --logout" returned: 0 in 0.113s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa2315e-43bb-4528-98c5-f1536c487a0e]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e, portal: 172.16.0.220,3260]
Jul 24 16:20:23 user nova-compute[70243]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e, portal: 172.16.0.220,3260] successful.
Jul 24 16:20:23 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e06677-8d02-4304-8409-cdbc5443520e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab23abb-47ce-4184-8843-55ce010b287d]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.517s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] <== disconnect_volume: return (518ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:20:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Acquiring lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Acquiring lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:24 user nova-compute[70243]: INFO nova.compute.manager [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Terminating instance
Jul 24 16:20:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG nova.objects.instance [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lazy-loading 'flavor' on Instance uuid c2ee17ba-3482-4caf-992e-30b3953d1e91 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-802d9798-5031-411c-ad17-9a25fb549929 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "c2ee17ba-3482-4caf-992e-30b3953d1e91" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.288s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipZrcBMw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:20:24 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:20:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:20:24 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:20:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:20:24 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[893cf8b2-49d5-48b3-953b-a8e100117c6a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:20:24 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e71303-7b0a-4258-a5b2-2f45916dfc5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf] added
Jul 24 16:20:24 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-ecd26540-ce9f-4bd2-bd94-977f0f44d09e req-a086dd27-c424-4679-a234-e8a0eedeee65 service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Received event network-vif-unplugged-94a5d835-5e78-4c88-aae0-d00bd2adc163 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ecd26540-ce9f-4bd2-bd94-977f0f44d09e req-a086dd27-c424-4679-a234-e8a0eedeee65 service nova] Acquiring lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ecd26540-ce9f-4bd2-bd94-977f0f44d09e req-a086dd27-c424-4679-a234-e8a0eedeee65 service nova] Lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ecd26540-ce9f-4bd2-bd94-977f0f44d09e req-a086dd27-c424-4679-a234-e8a0eedeee65 service nova] Lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-ecd26540-ce9f-4bd2-bd94-977f0f44d09e req-a086dd27-c424-4679-a234-e8a0eedeee65 service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] No waiting events found dispatching network-vif-unplugged-94a5d835-5e78-4c88-aae0-d00bd2adc163 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-ecd26540-ce9f-4bd2-bd94-977f0f44d09e req-a086dd27-c424-4679-a234-e8a0eedeee65 service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Received event network-vif-unplugged-94a5d835-5e78-4c88-aae0-d00bd2adc163 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[89896141-205f-412a-bbd8-9e0aa25d4f5e]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8006e2d-404a-4930-80ee-0e4c992a00aa]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ipZrcBMw {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ipZrcBMw" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f9826d-234a-4236-a943-35eb47a268ae]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ipZrcBMw'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c32d7d6-7c8b-4449-bb1e-5a89f8568bd4]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49bde80-94e2-48f6-948b-c3efebe3c89d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:24 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:24 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:24 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:24 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:24 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:24 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:24 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:24 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:24 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:24 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:20:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e314e155-26d5-4915-a940-69aab0c3664b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf, portal: 172.16.0.220,3260]
Jul 24 16:20:25 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf, portal: 172.16.0.220,3260] successful.
Jul 24 16:20:25 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d8c108-47a0-4773-8260-e5301395ef83]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dc3441-bd2c-46ad-a03a-c74c338795da]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf (non-flash)
Jul 24 16:20:25 user nova-compute[70243]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:25 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:25 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:25 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:25 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:25 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf (non-flash)
Jul 24 16:20:25 user nova-compute[70243]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:25 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:25 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:25 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:25 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:25 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] HCTL ('38', '-', '-', 0) found on session 10 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[15706448-8d64-4a15-b4a0-772ffeb11f64]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipZrcBMw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:20:25 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Instance destroyed successfully.
Jul 24 16:20:25 user nova-compute[70243]: DEBUG nova.objects.instance [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lazy-loading 'resources' on Instance uuid 8cd7a53c-c100-4e43-a9d6-0d4517239e15 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-929650101',display_name='tempest-AttachSCSIVolumeTestJSON-server-929650101',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-929650101',id=7,image_ref='42ec1bfc-8994-4142-a246-dc98cb002d83',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxuVCAoUfk9SBeJqJzDJUIEVPbaxgmNLfYvsMJ7hilqx8i5Nrymk6UtpgK8slhfnIdYFqZhPuOvROyPOZSc/9o4sBuESU3pEE0oIkGezS2KT8ziy4z0iCPCy/du304tpg==',key_name='tempest-keypair-995268334',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:18:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c896c3ac00cb4843b0b82f360cf4d578',ramdisk_id='',reservation_id='r-zrok6b8h',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42ec1bfc-8994-4142-a246-dc98cb002d83',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1678269418',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1678269418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:18:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e8e691b69b04b338729b8edfee01d03',uuid=8cd7a53c-c100-4e43-a9d6-0d4517239e15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94a5d835-5e78-4c88-aae0-d00bd2adc163", "address": "fa:16:3e:16:5d:65", "network": {"id": "bd848428-14ae-4e21-a751-e2fd2550be5b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-174143408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c896c3ac00cb4843b0b82f360cf4d578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a5d835-5e", "ovs_interfaceid": "94a5d835-5e78-4c88-aae0-d00bd2adc163", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Converting VIF {"id": "94a5d835-5e78-4c88-aae0-d00bd2adc163", "address": "fa:16:3e:16:5d:65", "network": {"id": "bd848428-14ae-4e21-a751-e2fd2550be5b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-174143408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c896c3ac00cb4843b0b82f360cf4d578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a5d835-5e", "ovs_interfaceid": "94a5d835-5e78-4c88-aae0-d00bd2adc163", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:5d:65,bridge_name='br-int',has_traffic_filtering=True,id=94a5d835-5e78-4c88-aae0-d00bd2adc163,network=Network(bd848428-14ae-4e21-a751-e2fd2550be5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a5d835-5e') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG os_vif [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:5d:65,bridge_name='br-int',has_traffic_filtering=True,id=94a5d835-5e78-4c88-aae0-d00bd2adc163,network=Network(bd848428-14ae-4e21-a751-e2fd2550be5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a5d835-5e') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94a5d835-5e, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:25 user nova-compute[70243]: INFO os_vif [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:5d:65,bridge_name='br-int',has_traffic_filtering=True,id=94a5d835-5e78-4c88-aae0-d00bd2adc163,network=Network(bd848428-14ae-4e21-a751-e2fd2550be5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a5d835-5e')
Jul 24 16:20:25 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Deleting instance files /opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15_del
Jul 24 16:20:25 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Deletion of /opt/stack/data/nova/instances/8cd7a53c-c100-4e43-a9d6-0d4517239e15_del complete
Jul 24 16:20:25 user nova-compute[70243]: INFO nova.compute.manager [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 24 16:20:25 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:20:25 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:20:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:20:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '26531663934613165', 'path': '/dev/sdg'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:20:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531663934613165', 'path': '/dev/sdg'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:20:26 user nova-compute[70243]: DEBUG nova.objects.instance [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lazy-loading 'flavor' on Instance uuid 5e6a5fff-570c-4ee2-b883-415ec828ef97 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:20:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:20:26 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:20:26 user nova-compute[70243]:   <source dev="/dev/sdg"/>
Jul 24 16:20:26 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:20:26 user nova-compute[70243]:   <serial>55df5015-2667-4614-b99e-cb00ff91a4bf</serial>
Jul 24 16:20:26 user nova-compute[70243]: </disk>
Jul 24 16:20:26 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:20:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:20:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:20:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] No VIF found with MAC fa:16:3e:bb:31:a5, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:20:26 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:20:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2af9b698-e237-4962-9a22-6a874b67ba7c tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.238s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:26 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Took 1.47 seconds to deallocate network for instance.
Jul 24 16:20:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-0c041bb3-2b55-4355-80f6-0c0c73903c63 req-75bdb8f0-9d60-41ba-a2fd-9e3f405c4546 service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Received event network-vif-plugged-94a5d835-5e78-4c88-aae0-d00bd2adc163 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:20:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0c041bb3-2b55-4355-80f6-0c0c73903c63 req-75bdb8f0-9d60-41ba-a2fd-9e3f405c4546 service nova] Acquiring lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0c041bb3-2b55-4355-80f6-0c0c73903c63 req-75bdb8f0-9d60-41ba-a2fd-9e3f405c4546 service nova] Lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0c041bb3-2b55-4355-80f6-0c0c73903c63 req-75bdb8f0-9d60-41ba-a2fd-9e3f405c4546 service nova] Lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-0c041bb3-2b55-4355-80f6-0c0c73903c63 req-75bdb8f0-9d60-41ba-a2fd-9e3f405c4546 service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] No waiting events found dispatching network-vif-plugged-94a5d835-5e78-4c88-aae0-d00bd2adc163 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:20:26 user nova-compute[70243]: WARNING nova.compute.manager [req-0c041bb3-2b55-4355-80f6-0c0c73903c63 req-75bdb8f0-9d60-41ba-a2fd-9e3f405c4546 service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Received unexpected event network-vif-plugged-94a5d835-5e78-4c88-aae0-d00bd2adc163 for instance with vm_state deleted and task_state None.
Jul 24 16:20:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-0c041bb3-2b55-4355-80f6-0c0c73903c63 req-75bdb8f0-9d60-41ba-a2fd-9e3f405c4546 service nova] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Received event network-vif-deleted-94a5d835-5e78-4c88-aae0-d00bd2adc163 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:27 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Deleted allocations for instance 8cd7a53c-c100-4e43-a9d6-0d4517239e15
Jul 24 16:20:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3f0be32f-27e9-4548-82ca-8d4dedd0e747 tempest-AttachSCSIVolumeTestJSON-1678269418 tempest-AttachSCSIVolumeTestJSON-1678269418-project-member] Lock "8cd7a53c-c100-4e43-a9d6-0d4517239e15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.965s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Acquiring lock "5e6a5fff-570c-4ee2-b883-415ec828ef97" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG os_brick.utils [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[10192a00-0b00-4e47-b1af-4bef214517d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[712a7b3c-aa3f-4c29-a453-0302ee90bc14]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e071549b-508f-41a4-8eb2-a9ca2b5779e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2311ef09-ff61-47ce-9312-b5aedb55e6fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:20:27 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:20:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d432bf77-b737-4182-85de-8cbbc5a5af5e]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:20:27 user nova-compute[70243]: DEBUG os_brick.utils [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:20:27 user nova-compute[70243]: INFO nova.compute.manager [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Swapping volume 55df5015-2667-4614-b99e-cb00ff91a4bf for 02a77926-0a95-4375-92ac-f94a22cd12d3
Jul 24 16:20:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG nova.compute.manager [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMENSrxo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5e6a5fff-570c-4ee2-b883-415ec828ef97', 'attached_at': '', 'detached_at': '', 'volume_id': '02a77926-0a95-4375-92ac-f94a22cd12d3', 'serial': '02a77926-0a95-4375-92ac-f94a22cd12d3'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipZrcBMw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '5e6a5fff-570c-4ee2-b883-415ec828ef97', 'attached_at': '', 'detached_at': '', 'volume_id': '55df5015-2667-4614-b99e-cb00ff91a4bf', 'serial'} {{(pid=70243) _swap_volume /opt/stack/nova/nova/compute/manager.py:7686}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMENSrxo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:20:34 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:20:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:20:34 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:20:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:20:34 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72528c2-552e-4ecb-accc-ca220e1ac8e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:20:34 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bce292-4fa3-420f-b145-ad23823e79ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3] added
Jul 24 16:20:34 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52906fa-dea6-4dd8-a4b7-bc79e5e92464]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb947d03-3726-468d-9e95-d515a822ee5f]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TMENSrxo {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TMENSrxo" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e483ed-4ce2-4b49-b74e-8ebc36a4800e]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TMENSrxo'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d779ec-5dd3-4af7-9391-efb1c1b0863f]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f1d448-06dd-463d-a9aa-f06311bf0887]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf (non-flash)
Jul 24 16:20:34 user nova-compute[70243]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:34 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:34 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:34 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:34 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:34 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf (non-flash)
Jul 24 16:20:34 user nova-compute[70243]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:34 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:34 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:34 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:34 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:34 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b49090-0e31-4a5a-9a98-9528630597f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3, portal: 172.16.0.220,3260]
Jul 24 16:20:34 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3, portal: 172.16.0.220,3260] successful.
Jul 24 16:20:34 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc64d79e-9f50-4861-92a3-98d1efc17b63]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a3595f-0aa5-421d-b000-6a5584390af7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf (non-flash)
Jul 24 16:20:34 user nova-compute[70243]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 (non-flash)
Jul 24 16:20:34 user nova-compute[70243]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:34 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:34 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:34 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:34 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:34 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf (non-flash)
Jul 24 16:20:34 user nova-compute[70243]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 (non-flash)
Jul 24 16:20:34 user nova-compute[70243]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:34 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:34 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:34 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:34 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:34 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] HCTL ('39', '-', '-', 0) found on session 11 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[febd8ff6-d522-4996-8e04-c8b71c219d9e]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:34 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Searching for a device in session 11 and hctl ['39', '*', '*', 0] yield: None {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:20:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:35 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Searching for a device in session 11 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:20:35 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMENSrxo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:20:35 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:20:35 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23763366539646639', 'path': '/dev/sdh'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:20:35 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763366539646639', 'path': '/dev/sdh'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:20:35 user nova-compute[70243]: DEBUG nova.objects.instance [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Lazy-loading 'flavor' on Instance uuid 5e6a5fff-570c-4ee2-b883-415ec828ef97 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:20:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:20:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] COPY block job progress, current cursor: 136314880 final cursor: 1073741824 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:20:37 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:20:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:37 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:20:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] COPY block job progress, current cursor: 282066944 final cursor: 1073741824 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:20:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:20:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] COPY block job progress, current cursor: 395313152 final cursor: 1073741824 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:20:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:20:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] COPY block job progress, current cursor: 551550976 final cursor: 1073741824 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:20:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] COPY block job progress, current cursor: 707788800 final cursor: 1073741824 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:20:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:20:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] COPY block job progress, current cursor: 812646400 final cursor: 1073741824 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:20:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:20:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:20:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] COPY block job progress, current cursor: 980418560 final cursor: 1073741824 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690215625.1959596, 8cd7a53c-c100-4e43-a9d6-0d4517239e15 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:20:40 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] VM Stopped (Lifecycle Event)
Jul 24 16:20:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:20:40 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:20:40 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:20:40 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=7372MB free_disk=24.561874389648438GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-638fe056-80a9-4739-86c6-bb3ef7fa5812 None None] [instance: 8cd7a53c-c100-4e43-a9d6-0d4517239e15] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipZrcBMw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:20:40 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:20:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance de22ea98-b041-4f3f-8986-435c43267a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance de484cb2-7f20-4bf1-927b-c066735bfeca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance a13c243a-2b98-4ef1-b17c-e2e15ba005fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance ad611655-ba4d-4a66-b78e-a82c058f4414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5f70528b-33db-4257-96fe-e5fad869a224 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance c2ee17ba-3482-4caf-992e-30b3953d1e91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5e6a5fff-570c-4ee2-b883-415ec828ef97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 236d3139-0c65-41af-a1a6-bc36e51fbf50 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance fd314e21-b1a5-425d-a5e0-c1b3303b72d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[64baf39d-fda2-4640-b3d2-53ca26b41c2d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:20:40 user nova-compute[70243]: No targets found.
Jul 24 16:20:40 user nova-compute[70243]: iSNS:
Jul 24 16:20:40 user nova-compute[70243]: No targets found.
Jul 24 16:20:40 user nova-compute[70243]: STATIC:
Jul 24 16:20:40 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c
Jul 24 16:20:40 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:40 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:40 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0
Jul 24 16:20:40 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:40 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:40 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73
Jul 24 16:20:40 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:40 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:40 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22
Jul 24 16:20:40 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:40 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:40 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c
Jul 24 16:20:40 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:40 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:40 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3
Jul 24 16:20:40 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:40 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:40 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf
Jul 24 16:20:40 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:40 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:40 user nova-compute[70243]: FIRMWARE:
Jul 24 16:20:40 user nova-compute[70243]: No targets found.
Jul 24 16:20:40 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:20:40 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:20:40 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a49c5ff-7689-4fe7-ab17-0cb30de2bcdd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.063s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[78447b37-69c1-4568-9304-5cc45e3ea439]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf (non-flash)
Jul 24 16:20:40 user nova-compute[70243]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 (non-flash)
Jul 24 16:20:40 user nova-compute[70243]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:40 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:40 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:40 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:40 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:40 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf (non-flash)
Jul 24 16:20:40 user nova-compute[70243]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 (non-flash)
Jul 24 16:20:40 user nova-compute[70243]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:40 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:40 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:40 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:40 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:40 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91ec1ab1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf'): ({'sdg'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Removing single pathed devices sdg {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[739958fe-becd-4e11-b0b1-1497f12067fc]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68476ba-366b-4c7f-8edf-cde78858e1cc]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Flushing IO for device /dev/sdg {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f08420-82fa-4b21-aaa4-214e73892b64]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7b7270-1973-4f7a-ba37-a388ed382a18]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] SCSI volumes sdg have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:20:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:41 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[400366c9-3b10-4027-8603-e3dafc457480]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:41 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:41 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:20:41 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:20:41 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:20:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.470s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:41 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e80755-1bce-4b36-b45b-840c4bbb936f]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:41 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf, portal: 172.16.0.220,3260]
Jul 24 16:20:41 user nova-compute[70243]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf, portal: 172.16.0.220,3260] successful.
Jul 24 16:20:41 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:41 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7f4450-7841-4497-b753-5a3e145e3fca]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:41 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:41 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:20:41 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] <== disconnect_volume: return (395ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:20:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:20:41 user nova-compute[70243]: DEBUG nova.compute.manager [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMENSrxo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '5e6a5fff-570c-4ee2-b883-415ec828ef97', 'attached_at': '', 'detached_at': '', 'volume_id': '02a77926-0a95-4375-92ac-f94a22cd12d3', 'serial'} {{(pid=70243) _swap_volume /opt/stack/nova/nova/compute/manager.py:7695}}
Jul 24 16:20:41 user nova-compute[70243]: DEBUG nova.compute.manager [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] swap_volume: removing Cinder connection for volume 55df5015-2667-4614-b99e-cb00ff91a4bf {{(pid=70243) _swap_volume /opt/stack/nova/nova/compute/manager.py:7740}}
Jul 24 16:20:41 user nova-compute[70243]: DEBUG nova.compute.manager [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] swap_volume: Updating volume 55df5015-2667-4614-b99e-cb00ff91a4bf BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "TMENSrxo", "auth_password": "PSAjwtgED3V2kq", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "02a77926-0a95-4375-92ac-f94a22cd12d3"}, "status": "reserved", "instance": "5e6a5fff-570c-4ee2-b883-415ec828ef97", "attached_at": "", "detached_at": "", "volume_id": "02a77926-0a95-4375-92ac-f94a22cd12d3", "serial": "02a77926-0a95-4375-92ac-f94a22cd12d3"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '02a77926-0a95-4375-92ac-f94a22cd12d3', 'no_device': None, 'attachment_id': '509235dd-4fa2-40c0-92dd-0dd58951e045'} {{(pid=70243) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7888}}
Jul 24 16:20:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8030cf4f-373b-4e21-bf98-50a9347cf1ac tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.468s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-de484cb2-7f20-4bf1-927b-c066735bfeca" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-de484cb2-7f20-4bf1-927b-c066735bfeca" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Acquiring lock "5e6a5fff-570c-4ee2-b883-415ec828ef97" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG os_brick.utils [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[294667f3-a3d7-4090-8502-8e12f805d694]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[84604b45-7fb1-496b-8516-cd856d69bc23]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e651a9-7a8a-4571-9c73-f80145df9f48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[30075962-7372-4c51-992f-08e239701c88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:20:42 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f2f003-6442-46e3-a073-c62d5288721b]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG os_brick.utils [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Updating instance_info_cache with network_info: [{"id": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "address": "fa:16:3e:8b:ac:95", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3519574-a5", "ovs_interfaceid": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-de484cb2-7f20-4bf1-927b-c066735bfeca" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:20:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:20:42 user nova-compute[70243]: INFO nova.compute.manager [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Swapping volume 02a77926-0a95-4375-92ac-f94a22cd12d3 for 55df5015-2667-4614-b99e-cb00ff91a4bf
Jul 24 16:20:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipZrcBMw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5e6a5fff-570c-4ee2-b883-415ec828ef97', 'attached_at': '', 'detached_at': '', 'volume_id': '55df5015-2667-4614-b99e-cb00ff91a4bf', 'serial': '55df5015-2667-4614-b99e-cb00ff91a4bf'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMENSrxo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '02a77926-0a95-4375-92ac-f94a22cd12d3'}, 'status': 'reserved', 'instance': '5e6a5fff-570c-4ee2-b883-415ec828ef97', 'attached_at': '', 'detached_at': '', 'volume_id': '02a77926-0a95-4375-92ac-f94a22cd12d3', 'serial'} {{(pid=70243) _swap_volume /opt/stack/nova/nova/compute/manager.py:7686}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipZrcBMw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:20:49 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:20:49 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:20:49 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[689d9a98-f048-4800-b314-08e7fd6bae55]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:20:49 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acf3c6a-54ed-4653-82c8-edd71d67f3e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf] added
Jul 24 16:20:49 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4906ce-ce49-4013-8266-0c9addc3c4b2]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b49f26-f5f8-4676-86e4-5a6c6613de8c]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ipZrcBMw {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ipZrcBMw" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e288e0ce-22bb-44f5-a572-9d3fe2149919]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ipZrcBMw'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cd5f62-8f26-4fa0-8733-50dcabcd6efe]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13dc7d1-5d47-42b1-a1fe-cf84ae0473a0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 (non-flash)
Jul 24 16:20:49 user nova-compute[70243]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:49 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:49 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:49 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:49 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:49 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 (non-flash)
Jul 24 16:20:49 user nova-compute[70243]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:49 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:49 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:49 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:49 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:49 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7d4e5d-4546-45bc-aefd-15ab18130c2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf, portal: 172.16.0.220,3260]
Jul 24 16:20:49 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf, portal: 172.16.0.220,3260] successful.
Jul 24 16:20:49 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0f9bb2-c8b0-4e00-8f6b-69d633ed3701]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b91ab6-5053-4967-9cf6-fda83192bd4b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 (non-flash)
Jul 24 16:20:49 user nova-compute[70243]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf (non-flash)
Jul 24 16:20:49 user nova-compute[70243]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:49 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:49 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:49 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:49 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:49 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 (non-flash)
Jul 24 16:20:49 user nova-compute[70243]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf (non-flash)
Jul 24 16:20:49 user nova-compute[70243]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:49 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:49 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:49 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:49 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:49 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] HCTL ('38', '-', '-', 0) found on session 12 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4046bd8c-74e6-4f66-be68-3cfc0be594ec]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Searching for a device in session 12 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:20:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipZrcBMw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:20:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:20:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26531663934613165', 'path': '/dev/sdg'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:20:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531663934613165', 'path': '/dev/sdg'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:20:50 user nova-compute[70243]: DEBUG nova.objects.instance [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Lazy-loading 'flavor' on Instance uuid 5e6a5fff-570c-4ee2-b883-415ec828ef97 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:20:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:20:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] COPY block job progress, current cursor: 18874368 final cursor: 1073741824 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:20:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] COPY block job progress, current cursor: 187695104 final cursor: 1073741824 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:20:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] COPY block job progress, current cursor: 360710144 final cursor: 1073741824 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:20:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] COPY block job progress, current cursor: 526385152 final cursor: 1073741824 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:20:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] COPY block job progress, current cursor: 694157312 final cursor: 1073741824 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:20:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] COPY block job progress, current cursor: 860880896 final cursor: 1073741824 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] COPY block job progress, current cursor: 935329792 final cursor: 1073741824 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMENSrxo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '02a77926-0a95-4375-92ac-f94a22cd12d3'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:20:55 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:20:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[14befa42-65ab-47c9-91b0-58051c421aa6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:20:55 user nova-compute[70243]: No targets found.
Jul 24 16:20:55 user nova-compute[70243]: iSNS:
Jul 24 16:20:55 user nova-compute[70243]: No targets found.
Jul 24 16:20:55 user nova-compute[70243]: STATIC:
Jul 24 16:20:55 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c
Jul 24 16:20:55 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:55 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:55 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0
Jul 24 16:20:55 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:55 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:55 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73
Jul 24 16:20:55 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:55 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:55 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22
Jul 24 16:20:55 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:55 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:55 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c
Jul 24 16:20:55 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:55 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:55 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3
Jul 24 16:20:55 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:55 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:55 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf
Jul 24 16:20:55 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:55 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:55 user nova-compute[70243]: FIRMWARE:
Jul 24 16:20:55 user nova-compute[70243]: No targets found.
Jul 24 16:20:55 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:20:55 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:20:55 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8fee05-43cd-44ce-8927-8fc0a24a9648]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[48df9a25-6279-4e1a-9480-ee83a0079ea2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 (non-flash)
Jul 24 16:20:55 user nova-compute[70243]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf (non-flash)
Jul 24 16:20:55 user nova-compute[70243]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:55 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:55 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:55 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:55 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:55 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 (non-flash)
Jul 24 16:20:55 user nova-compute[70243]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf (non-flash)
Jul 24 16:20:55 user nova-compute[70243]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:55 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:55 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:55 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:55 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:55 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc7b5b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3'): ({'sdh'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Removing single pathed devices sdh {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3436dc-e008-489f-9e72-a488a1fd770b]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfff3f7-038c-42a4-8231-8cb14e8b7715]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Flushing IO for device /dev/sdh {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d559a96b-ebd8-46c3-8897-6f04dfec16a9]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2622465e-e3b0-4054-9222-ba5e7f78f514]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] SCSI volumes sdh have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99f8c4c-6d44-4993-9f95-3fa9197c1bf9]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:56 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2693b4a7-7509-405c-b4f5-43957b456177]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3, portal: 172.16.0.220,3260]
Jul 24 16:20:56 user nova-compute[70243]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3, portal: 172.16.0.220,3260] successful.
Jul 24 16:20:56 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a77926-0a95-4375-92ac-f94a22cd12d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:56 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[964bee5e-f34c-4f9d-af8c-07b83bea3969]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:20:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] <== disconnect_volume: return (341ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:20:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:20:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipZrcBMw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '5e6a5fff-570c-4ee2-b883-415ec828ef97', 'attached_at': '', 'detached_at': '', 'volume_id': '55df5015-2667-4614-b99e-cb00ff91a4bf', 'serial'} {{(pid=70243) _swap_volume /opt/stack/nova/nova/compute/manager.py:7695}}
Jul 24 16:20:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] swap_volume: removing Cinder connection for volume 02a77926-0a95-4375-92ac-f94a22cd12d3 {{(pid=70243) _swap_volume /opt/stack/nova/nova/compute/manager.py:7740}}
Jul 24 16:20:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] swap_volume: Updating volume 02a77926-0a95-4375-92ac-f94a22cd12d3 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "ipZrcBMw", "auth_password": "l0861m4P2nrbYh", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "55df5015-2667-4614-b99e-cb00ff91a4bf"}, "status": "reserved", "instance": "5e6a5fff-570c-4ee2-b883-415ec828ef97", "attached_at": "", "detached_at": "", "volume_id": "55df5015-2667-4614-b99e-cb00ff91a4bf", "serial": "55df5015-2667-4614-b99e-cb00ff91a4bf"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '55df5015-2667-4614-b99e-cb00ff91a4bf', 'no_device': None, 'attachment_id': '3b9a8b03-6fbb-4d2b-9e6e-a1e082e4c656'} {{(pid=70243) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7888}}
Jul 24 16:20:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ed0aa622-63cc-4298-ad86-d7ae0a021758 tempest-TestVolumeSwap-1406008454 tempest-TestVolumeSwap-1406008454-project-admin] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.377s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Acquiring lock "5e6a5fff-570c-4ee2-b883-415ec828ef97" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:20:58 user nova-compute[70243]: INFO nova.compute.manager [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Detaching volume 55df5015-2667-4614-b99e-cb00ff91a4bf
Jul 24 16:20:58 user nova-compute[70243]: INFO nova.virt.block_device [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Attempting to driver detach volume 55df5015-2667-4614-b99e-cb00ff91a4bf from mountpoint /dev/vdb
Jul 24 16:20:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Attempting to detach device vdb from instance 5e6a5fff-570c-4ee2-b883-415ec828ef97 from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:20:58 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:20:58 user nova-compute[70243]:   <source dev="/dev/sdg"/>
Jul 24 16:20:58 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:20:58 user nova-compute[70243]:   <serial>55df5015-2667-4614-b99e-cb00ff91a4bf</serial>
Jul 24 16:20:58 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:20:58 user nova-compute[70243]: </disk>
Jul 24 16:20:58 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:20:58 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Successfully detached device vdb from instance 5e6a5fff-570c-4ee2-b883-415ec828ef97 from the persistent domain config.
Jul 24 16:20:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e6a5fff-570c-4ee2-b883-415ec828ef97 from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:20:58 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:20:58 user nova-compute[70243]:   <source dev="/dev/sdg"/>
Jul 24 16:20:58 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:20:58 user nova-compute[70243]:   <serial>55df5015-2667-4614-b99e-cb00ff91a4bf</serial>
Jul 24 16:20:58 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:20:58 user nova-compute[70243]: </disk>
Jul 24 16:20:58 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-57d41794-28c5-42ee-a3d9-00cbe8088bb1 req-53be6b7b-8252-4367-a936-09c6632f514c service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-changed-6d0870b4-5264-46ca-a291-3c99a1c27546 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-57d41794-28c5-42ee-a3d9-00cbe8088bb1 req-53be6b7b-8252-4367-a936-09c6632f514c service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Refreshing instance network info cache due to event network-changed-6d0870b4-5264-46ca-a291-3c99a1c27546. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-57d41794-28c5-42ee-a3d9-00cbe8088bb1 req-53be6b7b-8252-4367-a936-09c6632f514c service nova] Acquiring lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-57d41794-28c5-42ee-a3d9-00cbe8088bb1 req-53be6b7b-8252-4367-a936-09c6632f514c service nova] Acquired lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG nova.network.neutron [req-57d41794-28c5-42ee-a3d9-00cbe8088bb1 req-53be6b7b-8252-4367-a936-09c6632f514c service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Refreshing network info cache for port 6d0870b4-5264-46ca-a291-3c99a1c27546 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690215658.6536863, 5e6a5fff-570c-4ee2-b883-415ec828ef97 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e6a5fff-570c-4ee2-b883-415ec828ef97 {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:20:58 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Successfully detached device vdb from instance 5e6a5fff-570c-4ee2-b883-415ec828ef97 from the live domain config.
Jul 24 16:20:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipZrcBMw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '55df5015-2667-4614-b99e-cb00ff91a4bf'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:20:58 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:20:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fb3aee-d05f-403d-abdf-972821213257]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:20:58 user nova-compute[70243]: No targets found.
Jul 24 16:20:58 user nova-compute[70243]: iSNS:
Jul 24 16:20:58 user nova-compute[70243]: No targets found.
Jul 24 16:20:58 user nova-compute[70243]: STATIC:
Jul 24 16:20:58 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c
Jul 24 16:20:58 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:58 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:58 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0
Jul 24 16:20:58 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:58 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:58 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73
Jul 24 16:20:58 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:58 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:58 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22
Jul 24 16:20:58 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:58 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:58 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c
Jul 24 16:20:58 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:58 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:58 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf
Jul 24 16:20:58 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:20:58 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:20:58 user nova-compute[70243]: FIRMWARE:
Jul 24 16:20:58 user nova-compute[70243]: No targets found.
Jul 24 16:20:58 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:20:58 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:20:58 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be6954e-5d5c-4501-b75e-86dd6eefe2a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be69db7-c05a-474f-9094-3c1b64b6d97a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf (non-flash)
Jul 24 16:20:58 user nova-compute[70243]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:58 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:58 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:58 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:58 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:58 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf (non-flash)
Jul 24 16:20:58 user nova-compute[70243]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:20:58 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:20:58 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:20:58 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:20:58 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:20:58 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc7b5870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf'): ({'sdg'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Removing single pathed devices sdg {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[57071072-4be4-4ab4-96bd-3216199e9086]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7191dd4b-1953-40be-a70f-336a0cc92507]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Flushing IO for device /dev/sdg {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d7e726-5369-421f-bf9b-749465c539d1]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.035s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[018fa62f-5e73-4d85-a086-457db9d2399e]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] SCSI volumes sdg have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ba43f1-62fa-4f03-940d-4b5f50cf0f1e]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cedb40-e203-487e-9e1b-7cb84e5a99b4]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf, portal: 172.16.0.220,3260]
Jul 24 16:20:58 user nova-compute[70243]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf, portal: 172.16.0.220,3260] successful.
Jul 24 16:20:58 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:20:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55df5015-2667-4614-b99e-cb00ff91a4bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:20:59 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e802ccfa-d6ac-4ebe-9e84-1791b082fda2]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:20:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:20:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:20:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] <== disconnect_volume: return (348ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:20:59 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:20:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:20:59 user nova-compute[70243]: DEBUG nova.network.neutron [req-57d41794-28c5-42ee-a3d9-00cbe8088bb1 req-53be6b7b-8252-4367-a936-09c6632f514c service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Updated VIF entry in instance network info cache for port 6d0870b4-5264-46ca-a291-3c99a1c27546. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:20:59 user nova-compute[70243]: DEBUG nova.network.neutron [req-57d41794-28c5-42ee-a3d9-00cbe8088bb1 req-53be6b7b-8252-4367-a936-09c6632f514c service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Updating instance_info_cache with network_info: [{"id": "6d0870b4-5264-46ca-a291-3c99a1c27546", "address": "fa:16:3e:c6:f9:65", "network": {"id": "9da02be9-9a4a-40bb-8a9b-9399b8f16521", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1533875048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0870b4-52", "ovs_interfaceid": "6d0870b4-5264-46ca-a291-3c99a1c27546", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "address": "fa:16:3e:a3:85:6c", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b943a9e-f3", "ovs_interfaceid": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "address": "fa:16:3e:13:6a:d5", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3b9944-66", "ovs_interfaceid": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f5f10c24-54e5-4105-b3a0-92771126688c", "address": "fa:16:3e:8b:c5:06", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f10c24-54", "ovs_interfaceid": "f5f10c24-54e5-4105-b3a0-92771126688c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "address": "fa:16:3e:06:13:18", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ac05d7-63", "ovs_interfaceid": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5980d7b6-c38c-4388-976b-039bcf31e766", "address": "fa:16:3e:a4:99:41", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5980d7b6-c3", "ovs_interfaceid": "5980d7b6-c38c-4388-976b-039bcf31e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b19372c-785f-4c41-8e00-31689097491b", "address": "fa:16:3e:ca:61:08", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b19372c-78", "ovs_interfaceid": "4b19372c-785f-4c41-8e00-31689097491b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:20:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-57d41794-28c5-42ee-a3d9-00cbe8088bb1 req-53be6b7b-8252-4367-a936-09c6632f514c service nova] Releasing lock "refresh_cache-236d3139-0c65-41af-a1a6-bc36e51fbf50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:20:59 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lazy-loading 'flavor' on Instance uuid 5e6a5fff-570c-4ee2-b883-415ec828ef97 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:20:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c3ae7e67-31ef-4026-a79f-77c5f8c5eb34 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.887s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:02 user nova-compute[70243]: INFO nova.compute.manager [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Terminating instance
Jul 24 16:21:02 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG nova.compute.manager [req-f3dd0508-e54c-4be4-a510-84f71eca39fb req-de79752a-b52a-4da0-8576-3adf98408708 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-unplugged-6d0870b4-5264-46ca-a291-3c99a1c27546 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f3dd0508-e54c-4be4-a510-84f71eca39fb req-de79752a-b52a-4da0-8576-3adf98408708 service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f3dd0508-e54c-4be4-a510-84f71eca39fb req-de79752a-b52a-4da0-8576-3adf98408708 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f3dd0508-e54c-4be4-a510-84f71eca39fb req-de79752a-b52a-4da0-8576-3adf98408708 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG nova.compute.manager [req-f3dd0508-e54c-4be4-a510-84f71eca39fb req-de79752a-b52a-4da0-8576-3adf98408708 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-unplugged-6d0870b4-5264-46ca-a291-3c99a1c27546 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG nova.compute.manager [req-f3dd0508-e54c-4be4-a510-84f71eca39fb req-de79752a-b52a-4da0-8576-3adf98408708 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-unplugged-6d0870b4-5264-46ca-a291-3c99a1c27546 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG nova.compute.manager [req-c7acd16e-cb64-4509-95b0-be2e7ca411d8 req-dcffae5e-2c9d-4198-8be5-4cc263865b40 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-unplugged-e6ac05d7-63c0-477d-89f5-d2612b39e976 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c7acd16e-cb64-4509-95b0-be2e7ca411d8 req-dcffae5e-2c9d-4198-8be5-4cc263865b40 service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c7acd16e-cb64-4509-95b0-be2e7ca411d8 req-dcffae5e-2c9d-4198-8be5-4cc263865b40 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c7acd16e-cb64-4509-95b0-be2e7ca411d8 req-dcffae5e-2c9d-4198-8be5-4cc263865b40 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG nova.compute.manager [req-c7acd16e-cb64-4509-95b0-be2e7ca411d8 req-dcffae5e-2c9d-4198-8be5-4cc263865b40 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-unplugged-e6ac05d7-63c0-477d-89f5-d2612b39e976 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:02 user nova-compute[70243]: DEBUG nova.compute.manager [req-c7acd16e-cb64-4509-95b0-be2e7ca411d8 req-dcffae5e-2c9d-4198-8be5-4cc263865b40 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-unplugged-e6ac05d7-63c0-477d-89f5-d2612b39e976 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:21:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:03 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Instance destroyed successfully.
Jul 24 16:21:03 user nova-compute[70243]: DEBUG nova.objects.instance [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lazy-loading 'resources' on Instance uuid 236d3139-0c65-41af-a1a6-bc36e51fbf50 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886786644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886786644',id=10,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlv4t3K+Qy3iAO7FEiNwwuKyhz0EnhUcDcVbeNLKy1sZWX89xnIt2kiGwDG/4BR29Vhm+arEM5lXG7Xl4NdAZQPuodnhqbf5k2kB4g2FtlrUPKC21J6eEd+lFNH5Kx+JA==',key_name='tempest-keypair-1323717061',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:19:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cefa0481ae64474dbe0b5954a6de0b40',ramdisk_id='',reservation_id='r-1qnhs5b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-151685023',owner_user_name='tempest-TaggedBootDevicesTest-151685023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:19:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c02b728391bb474eb7081a2e64d7b15e',uuid=236d3139-0c65-41af-a1a6-bc36e51fbf50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d0870b4-5264-46ca-a291-3c99a1c27546", "address": "fa:16:3e:c6:f9:65", "network": {"id": "9da02be9-9a4a-40bb-8a9b-9399b8f16521", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1533875048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0870b4-52", "ovs_interfaceid": "6d0870b4-5264-46ca-a291-3c99a1c27546", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:21:03 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converting VIF {"id": "6d0870b4-5264-46ca-a291-3c99a1c27546", "address": "fa:16:3e:c6:f9:65", "network": {"id": "9da02be9-9a4a-40bb-8a9b-9399b8f16521", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1533875048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0870b4-52", "ovs_interfaceid": "6d0870b4-5264-46ca-a291-3c99a1c27546", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:21:03 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:f9:65,bridge_name='br-int',has_traffic_filtering=True,id=6d0870b4-5264-46ca-a291-3c99a1c27546,network=Network(9da02be9-9a4a-40bb-8a9b-9399b8f16521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0870b4-52') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:21:03 user nova-compute[70243]: DEBUG os_vif [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:f9:65,bridge_name='br-int',has_traffic_filtering=True,id=6d0870b4-5264-46ca-a291-3c99a1c27546,network=Network(9da02be9-9a4a-40bb-8a9b-9399b8f16521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0870b4-52') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:21:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d0870b4-52, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:21:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:04 user nova-compute[70243]: INFO os_vif [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:f9:65,bridge_name='br-int',has_traffic_filtering=True,id=6d0870b4-5264-46ca-a291-3c99a1c27546,network=Network(9da02be9-9a4a-40bb-8a9b-9399b8f16521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0870b4-52')
Jul 24 16:21:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886786644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886786644',id=10,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlv4t3K+Qy3iAO7FEiNwwuKyhz0EnhUcDcVbeNLKy1sZWX89xnIt2kiGwDG/4BR29Vhm+arEM5lXG7Xl4NdAZQPuodnhqbf5k2kB4g2FtlrUPKC21J6eEd+lFNH5Kx+JA==',key_name='tempest-keypair-1323717061',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:19:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cefa0481ae64474dbe0b5954a6de0b40',ramdisk_id='',reservation_id='r-1qnhs5b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-151685023',owner_user_name='tempest-TaggedBootDevicesTest-151685023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:19:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c02b728391bb474eb7081a2e64d7b15e',uuid=236d3139-0c65-41af-a1a6-bc36e51fbf50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "address": "fa:16:3e:a3:85:6c", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b943a9e-f3", "ovs_interfaceid": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converting VIF {"id": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "address": "fa:16:3e:a3:85:6c", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b943a9e-f3", "ovs_interfaceid": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:85:6c,bridge_name='br-int',has_traffic_filtering=True,id=9b943a9e-f326-4526-8e6c-0462cb3860a4,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b943a9e-f3') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_vif [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:85:6c,bridge_name='br-int',has_traffic_filtering=True,id=9b943a9e-f326-4526-8e6c-0462cb3860a4,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b943a9e-f3') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b943a9e-f3, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:04 user nova-compute[70243]: INFO os_vif [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:85:6c,bridge_name='br-int',has_traffic_filtering=True,id=9b943a9e-f326-4526-8e6c-0462cb3860a4,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b943a9e-f3')
Jul 24 16:21:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886786644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886786644',id=10,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlv4t3K+Qy3iAO7FEiNwwuKyhz0EnhUcDcVbeNLKy1sZWX89xnIt2kiGwDG/4BR29Vhm+arEM5lXG7Xl4NdAZQPuodnhqbf5k2kB4g2FtlrUPKC21J6eEd+lFNH5Kx+JA==',key_name='tempest-keypair-1323717061',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:19:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cefa0481ae64474dbe0b5954a6de0b40',ramdisk_id='',reservation_id='r-1qnhs5b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-151685023',owner_user_name='tempest-TaggedBootDevicesTest-151685023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:19:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c02b728391bb474eb7081a2e64d7b15e',uuid=236d3139-0c65-41af-a1a6-bc36e51fbf50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "address": "fa:16:3e:13:6a:d5", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3b9944-66", "ovs_interfaceid": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converting VIF {"id": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "address": "fa:16:3e:13:6a:d5", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3b9944-66", "ovs_interfaceid": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:6a:d5,bridge_name='br-int',has_traffic_filtering=True,id=2b3b9944-66d7-44fb-b3fe-b361e73a8509,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2b3b9944-66') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_vif [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:6a:d5,bridge_name='br-int',has_traffic_filtering=True,id=2b3b9944-66d7-44fb-b3fe-b361e73a8509,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2b3b9944-66') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b3b9944-66, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:04 user nova-compute[70243]: INFO os_vif [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:6a:d5,bridge_name='br-int',has_traffic_filtering=True,id=2b3b9944-66d7-44fb-b3fe-b361e73a8509,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2b3b9944-66')
Jul 24 16:21:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886786644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886786644',id=10,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlv4t3K+Qy3iAO7FEiNwwuKyhz0EnhUcDcVbeNLKy1sZWX89xnIt2kiGwDG/4BR29Vhm+arEM5lXG7Xl4NdAZQPuodnhqbf5k2kB4g2FtlrUPKC21J6eEd+lFNH5Kx+JA==',key_name='tempest-keypair-1323717061',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:19:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cefa0481ae64474dbe0b5954a6de0b40',ramdisk_id='',reservation_id='r-1qnhs5b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-151685023',owner_user_name='tempest-TaggedBootDevicesTest-151685023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:19:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c02b728391bb474eb7081a2e64d7b15e',uuid=236d3139-0c65-41af-a1a6-bc36e51fbf50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5f10c24-54e5-4105-b3a0-92771126688c", "address": "fa:16:3e:8b:c5:06", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f10c24-54", "ovs_interfaceid": "f5f10c24-54e5-4105-b3a0-92771126688c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converting VIF {"id": "f5f10c24-54e5-4105-b3a0-92771126688c", "address": "fa:16:3e:8b:c5:06", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f10c24-54", "ovs_interfaceid": "f5f10c24-54e5-4105-b3a0-92771126688c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:c5:06,bridge_name='br-int',has_traffic_filtering=True,id=f5f10c24-54e5-4105-b3a0-92771126688c,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f10c24-54') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_vif [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:c5:06,bridge_name='br-int',has_traffic_filtering=True,id=f5f10c24-54e5-4105-b3a0-92771126688c,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f10c24-54') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5f10c24-54, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:04 user nova-compute[70243]: INFO os_vif [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:c5:06,bridge_name='br-int',has_traffic_filtering=True,id=f5f10c24-54e5-4105-b3a0-92771126688c,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f10c24-54')
Jul 24 16:21:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886786644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886786644',id=10,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlv4t3K+Qy3iAO7FEiNwwuKyhz0EnhUcDcVbeNLKy1sZWX89xnIt2kiGwDG/4BR29Vhm+arEM5lXG7Xl4NdAZQPuodnhqbf5k2kB4g2FtlrUPKC21J6eEd+lFNH5Kx+JA==',key_name='tempest-keypair-1323717061',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:19:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cefa0481ae64474dbe0b5954a6de0b40',ramdisk_id='',reservation_id='r-1qnhs5b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-151685023',owner_user_name='tempest-TaggedBootDevicesTest-151685023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:19:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c02b728391bb474eb7081a2e64d7b15e',uuid=236d3139-0c65-41af-a1a6-bc36e51fbf50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "address": "fa:16:3e:06:13:18", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ac05d7-63", "ovs_interfaceid": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converting VIF {"id": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "address": "fa:16:3e:06:13:18", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ac05d7-63", "ovs_interfaceid": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:13:18,bridge_name='br-int',has_traffic_filtering=True,id=e6ac05d7-63c0-477d-89f5-d2612b39e976,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ac05d7-63') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_vif [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:13:18,bridge_name='br-int',has_traffic_filtering=True,id=e6ac05d7-63c0-477d-89f5-d2612b39e976,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ac05d7-63') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6ac05d7-63, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:04 user nova-compute[70243]: INFO os_vif [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:13:18,bridge_name='br-int',has_traffic_filtering=True,id=e6ac05d7-63c0-477d-89f5-d2612b39e976,network=Network(a1d0c300-0205-40b4-9568-127a92967ec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ac05d7-63')
Jul 24 16:21:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886786644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886786644',id=10,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlv4t3K+Qy3iAO7FEiNwwuKyhz0EnhUcDcVbeNLKy1sZWX89xnIt2kiGwDG/4BR29Vhm+arEM5lXG7Xl4NdAZQPuodnhqbf5k2kB4g2FtlrUPKC21J6eEd+lFNH5Kx+JA==',key_name='tempest-keypair-1323717061',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:19:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cefa0481ae64474dbe0b5954a6de0b40',ramdisk_id='',reservation_id='r-1qnhs5b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-151685023',owner_user_name='tempest-TaggedBootDevicesTest-151685023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:19:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c02b728391bb474eb7081a2e64d7b15e',uuid=236d3139-0c65-41af-a1a6-bc36e51fbf50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5980d7b6-c38c-4388-976b-039bcf31e766", "address": "fa:16:3e:a4:99:41", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5980d7b6-c3", "ovs_interfaceid": "5980d7b6-c38c-4388-976b-039bcf31e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converting VIF {"id": "5980d7b6-c38c-4388-976b-039bcf31e766", "address": "fa:16:3e:a4:99:41", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5980d7b6-c3", "ovs_interfaceid": "5980d7b6-c38c-4388-976b-039bcf31e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:99:41,bridge_name='br-int',has_traffic_filtering=True,id=5980d7b6-c38c-4388-976b-039bcf31e766,network=Network(e7f60358-c34c-4242-8190-7ba72313d9b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5980d7b6-c3') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_vif [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:99:41,bridge_name='br-int',has_traffic_filtering=True,id=5980d7b6-c38c-4388-976b-039bcf31e766,network=Network(e7f60358-c34c-4242-8190-7ba72313d9b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5980d7b6-c3') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5980d7b6-c3, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:04 user nova-compute[70243]: INFO os_vif [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:99:41,bridge_name='br-int',has_traffic_filtering=True,id=5980d7b6-c38c-4388-976b-039bcf31e766,network=Network(e7f60358-c34c-4242-8190-7ba72313d9b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5980d7b6-c3')
Jul 24 16:21:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1886786644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1886786644',id=10,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlv4t3K+Qy3iAO7FEiNwwuKyhz0EnhUcDcVbeNLKy1sZWX89xnIt2kiGwDG/4BR29Vhm+arEM5lXG7Xl4NdAZQPuodnhqbf5k2kB4g2FtlrUPKC21J6eEd+lFNH5Kx+JA==',key_name='tempest-keypair-1323717061',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:19:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cefa0481ae64474dbe0b5954a6de0b40',ramdisk_id='',reservation_id='r-1qnhs5b9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-151685023',owner_user_name='tempest-TaggedBootDevicesTest-151685023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:19:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c02b728391bb474eb7081a2e64d7b15e',uuid=236d3139-0c65-41af-a1a6-bc36e51fbf50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b19372c-785f-4c41-8e00-31689097491b", "address": "fa:16:3e:ca:61:08", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b19372c-78", "ovs_interfaceid": "4b19372c-785f-4c41-8e00-31689097491b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converting VIF {"id": "4b19372c-785f-4c41-8e00-31689097491b", "address": "fa:16:3e:ca:61:08", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b19372c-78", "ovs_interfaceid": "4b19372c-785f-4c41-8e00-31689097491b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:61:08,bridge_name='br-int',has_traffic_filtering=True,id=4b19372c-785f-4c41-8e00-31689097491b,network=Network(e7f60358-c34c-4242-8190-7ba72313d9b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b19372c-78') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_vif [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:61:08,bridge_name='br-int',has_traffic_filtering=True,id=4b19372c-785f-4c41-8e00-31689097491b,network=Network(e7f60358-c34c-4242-8190-7ba72313d9b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b19372c-78') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b19372c-78, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:04 user nova-compute[70243]: INFO os_vif [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:61:08,bridge_name='br-int',has_traffic_filtering=True,id=4b19372c-785f-4c41-8e00-31689097491b,network=Network(e7f60358-c34c-4242-8190-7ba72313d9b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b19372c-78')
Jul 24 16:21:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwWUvBtN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:21:04 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e73a668-1bbf-48c2-aba3-fa47f339d23c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:21:04 user nova-compute[70243]: No targets found.
Jul 24 16:21:04 user nova-compute[70243]: iSNS:
Jul 24 16:21:04 user nova-compute[70243]: No targets found.
Jul 24 16:21:04 user nova-compute[70243]: STATIC:
Jul 24 16:21:04 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c
Jul 24 16:21:04 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:04 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:04 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0
Jul 24 16:21:04 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:04 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:04 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73
Jul 24 16:21:04 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:04 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:04 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22
Jul 24 16:21:04 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:04 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:04 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c
Jul 24 16:21:04 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:04 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:04 user nova-compute[70243]: FIRMWARE:
Jul 24 16:21:04 user nova-compute[70243]: No targets found.
Jul 24 16:21:04 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:21:04 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:21:04 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[481c6f72-81eb-4a8c-9fb3-2e6607e7c37f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee32a98-37a4-4c7c-afb6-b5b922301954]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:21:04 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:21:04 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:21:04 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:21:04 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:21:04 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 (non-flash)
Jul 24 16:21:04 user nova-compute[70243]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:21:04 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:21:04 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:21:04 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:21:04 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc57c820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22'): ({'sdb'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Removing single pathed devices sdb {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0643bdb-5195-492d-9693-cde3912ad0e9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5142d4e2-11de-41fc-8cea-62bd4acba87a]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Flushing IO for device /dev/sdb {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7301e748-d6a8-4b5a-98b2-8aea1a61ba98]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e515f8b-33ab-487b-a679-86dc3e4a27da]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce8cdea-17c9-44dc-97e4-900f26cb35c1]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d9a817-62dd-4778-ad95-0173f99e8684]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22, portal: 172.16.0.220,3260]
Jul 24 16:21:04 user nova-compute[70243]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22, portal: 172.16.0.220,3260] successful.
Jul 24 16:21:04 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b92ea51-d2d2-4ecd-abbc-c288df9b3d22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[97eb0e5e-20eb-43e3-94c6-7194be14d4f2]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] <== disconnect_volume: return (357ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXcawieE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:21:04 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[730d4471-45cd-4a55-8390-442646faaee4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:21:04 user nova-compute[70243]: No targets found.
Jul 24 16:21:04 user nova-compute[70243]: iSNS:
Jul 24 16:21:04 user nova-compute[70243]: No targets found.
Jul 24 16:21:04 user nova-compute[70243]: STATIC:
Jul 24 16:21:04 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c
Jul 24 16:21:04 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:04 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:04 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0
Jul 24 16:21:04 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:04 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:04 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73
Jul 24 16:21:04 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:04 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:04 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c
Jul 24 16:21:04 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:04 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:04 user nova-compute[70243]: FIRMWARE:
Jul 24 16:21:04 user nova-compute[70243]: No targets found.
Jul 24 16:21:04 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:21:04 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:21:04 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c87f108-24f4-4f74-8938-f534b45e7e8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5696cbb7-ce56-4ce5-9af2-ecfa8ca7c787]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:21:04 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:21:04 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:21:04 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:21:04 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 (non-flash)
Jul 24 16:21:04 user nova-compute[70243]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:21:04 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:21:04 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:21:04 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91f9c8f1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0'): ({'sdc'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Removing single pathed devices sdc {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[883f4084-009c-43ac-acdb-7eda96a820df]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d0910f-9dc6-46ba-b5c2-94db5ecf8223]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Flushing IO for device /dev/sdc {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de2e9e2-0f5b-43af-9167-7ba2008133cc]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c84d2a2-dfe1-44f2-b66f-76dd7e937dcb]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] SCSI volumes sdc have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a308390a-3563-4f93-bc67-66e40463624b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-plugged-6d0870b4-5264-46ca-a291-3c99a1c27546 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-plugged-6d0870b4-5264-46ca-a291-3c99a1c27546 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:05 user nova-compute[70243]: WARNING nova.compute.manager [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received unexpected event network-vif-plugged-6d0870b4-5264-46ca-a291-3c99a1c27546 for instance with vm_state active and task_state deleting.
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-unplugged-9b943a9e-f326-4526-8e6c-0462cb3860a4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-unplugged-9b943a9e-f326-4526-8e6c-0462cb3860a4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-unplugged-9b943a9e-f326-4526-8e6c-0462cb3860a4 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-plugged-9b943a9e-f326-4526-8e6c-0462cb3860a4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-plugged-9b943a9e-f326-4526-8e6c-0462cb3860a4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:05 user nova-compute[70243]: WARNING nova.compute.manager [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received unexpected event network-vif-plugged-9b943a9e-f326-4526-8e6c-0462cb3860a4 for instance with vm_state active and task_state deleting.
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-unplugged-2b3b9944-66d7-44fb-b3fe-b361e73a8509 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-unplugged-2b3b9944-66d7-44fb-b3fe-b361e73a8509 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-unplugged-2b3b9944-66d7-44fb-b3fe-b361e73a8509 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-plugged-2b3b9944-66d7-44fb-b3fe-b361e73a8509 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-plugged-2b3b9944-66d7-44fb-b3fe-b361e73a8509 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:05 user nova-compute[70243]: WARNING nova.compute.manager [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received unexpected event network-vif-plugged-2b3b9944-66d7-44fb-b3fe-b361e73a8509 for instance with vm_state active and task_state deleting.
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-unplugged-f5f10c24-54e5-4105-b3a0-92771126688c {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-unplugged-f5f10c24-54e5-4105-b3a0-92771126688c {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-d194c27a-c672-427b-b27e-052baf37f0f6 req-73837784-82b3-4371-850c-b03b1582260f service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-unplugged-f5f10c24-54e5-4105-b3a0-92771126688c for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed16f91-11f3-42b2-a2ec-4f0967050c92]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0, portal: 172.16.0.220,3260]
Jul 24 16:21:05 user nova-compute[70243]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0, portal: 172.16.0.220,3260] successful.
Jul 24 16:21:05 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b732f23-fa20-4c7d-9e0c-6c3ca83d5fd0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4484752-69eb-4122-9c18-a4d4d2743efa]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] <== disconnect_volume: return (358ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IqjUpuRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:21:05 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bcff94-8376-4286-8988-0551194c308f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:21:05 user nova-compute[70243]: No targets found.
Jul 24 16:21:05 user nova-compute[70243]: iSNS:
Jul 24 16:21:05 user nova-compute[70243]: No targets found.
Jul 24 16:21:05 user nova-compute[70243]: STATIC:
Jul 24 16:21:05 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c
Jul 24 16:21:05 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:05 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:05 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73
Jul 24 16:21:05 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:05 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:05 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c
Jul 24 16:21:05 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:05 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:05 user nova-compute[70243]: FIRMWARE:
Jul 24 16:21:05 user nova-compute[70243]: No targets found.
Jul 24 16:21:05 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:21:05 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:21:05 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe42a752-98da-42ac-87ac-51b004f6771a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc10add6-a483-46d8-ad94-43cf385f7f51]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:21:05 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:21:05 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:21:05 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c (non-flash)
Jul 24 16:21:05 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:21:05 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:21:05 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91ec147910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c'): ({'sdd'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Removing single pathed devices sdd {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0dca1f-5153-4a67-86f1-9104046f99fa]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc71788-1c69-4440-98ae-2ce6b36563b7]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Flushing IO for device /dev/sdd {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac18204-56ed-4c17-9690-a9e7bb7bae41]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1667b6-490c-4aff-9e82-b5d68b72fdd2]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] SCSI volumes sdd have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f79a0d-a7ac-434c-98b5-1ad85770cc23]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-plugged-e6ac05d7-63c0-477d-89f5-d2612b39e976 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-plugged-e6ac05d7-63c0-477d-89f5-d2612b39e976 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:05 user nova-compute[70243]: WARNING nova.compute.manager [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received unexpected event network-vif-plugged-e6ac05d7-63c0-477d-89f5-d2612b39e976 for instance with vm_state active and task_state deleting.
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-unplugged-5980d7b6-c38c-4388-976b-039bcf31e766 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-unplugged-5980d7b6-c38c-4388-976b-039bcf31e766 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-unplugged-5980d7b6-c38c-4388-976b-039bcf31e766 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-plugged-5980d7b6-c38c-4388-976b-039bcf31e766 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-plugged-5980d7b6-c38c-4388-976b-039bcf31e766 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:05 user nova-compute[70243]: WARNING nova.compute.manager [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received unexpected event network-vif-plugged-5980d7b6-c38c-4388-976b-039bcf31e766 for instance with vm_state active and task_state deleting.
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-unplugged-4b19372c-785f-4c41-8e00-31689097491b {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-unplugged-4b19372c-785f-4c41-8e00-31689097491b {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-unplugged-4b19372c-785f-4c41-8e00-31689097491b for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-plugged-4b19372c-785f-4c41-8e00-31689097491b {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-plugged-4b19372c-785f-4c41-8e00-31689097491b {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:05 user nova-compute[70243]: WARNING nova.compute.manager [req-ad422e83-40c6-42ea-bb7f-0de9e4c3088f req-f4a9c24c-e615-4ed6-9b37-2b3fb0ab420e service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received unexpected event network-vif-plugged-4b19372c-785f-4c41-8e00-31689097491b for instance with vm_state active and task_state deleting.
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece6bc3f-0a00-4964-8556-9c4811cbb27b]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c, portal: 172.16.0.220,3260]
Jul 24 16:21:05 user nova-compute[70243]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c, portal: 172.16.0.220,3260] successful.
Jul 24 16:21:05 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d989fc2-833f-4097-bab6-738135612e1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea63554b-b67c-4fb9-8d8d-fc88d86a2fe7]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] <== disconnect_volume: return (316ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:21:05 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Deleting instance files /opt/stack/data/nova/instances/236d3139-0c65-41af-a1a6-bc36e51fbf50_del
Jul 24 16:21:05 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Deletion of /opt/stack/data/nova/instances/236d3139-0c65-41af-a1a6-bc36e51fbf50_del complete
Jul 24 16:21:05 user nova-compute[70243]: INFO nova.compute.manager [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Took 3.31 seconds to destroy the instance on the hypervisor.
Jul 24 16:21:05 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:21:05 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:21:07 user nova-compute[70243]: DEBUG nova.compute.manager [req-afff731c-d573-49cb-ac50-65f04026230f req-d6b56967-7d84-486d-acdf-f7ef4867f6b8 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-plugged-f5f10c24-54e5-4105-b3a0-92771126688c {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-afff731c-d573-49cb-ac50-65f04026230f req-d6b56967-7d84-486d-acdf-f7ef4867f6b8 service nova] Acquiring lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-afff731c-d573-49cb-ac50-65f04026230f req-d6b56967-7d84-486d-acdf-f7ef4867f6b8 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-afff731c-d573-49cb-ac50-65f04026230f req-d6b56967-7d84-486d-acdf-f7ef4867f6b8 service nova] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:07 user nova-compute[70243]: DEBUG nova.compute.manager [req-afff731c-d573-49cb-ac50-65f04026230f req-d6b56967-7d84-486d-acdf-f7ef4867f6b8 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] No waiting events found dispatching network-vif-plugged-f5f10c24-54e5-4105-b3a0-92771126688c {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:07 user nova-compute[70243]: WARNING nova.compute.manager [req-afff731c-d573-49cb-ac50-65f04026230f req-d6b56967-7d84-486d-acdf-f7ef4867f6b8 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received unexpected event network-vif-plugged-f5f10c24-54e5-4105-b3a0-92771126688c for instance with vm_state active and task_state deleting.
Jul 24 16:21:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-be74b09f-fe41-4dc7-84aa-172011c3e3e4 req-78bf83ca-6f90-437e-8ea8-53347bb44687 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-deleted-f5f10c24-54e5-4105-b3a0-92771126688c {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:09 user nova-compute[70243]: INFO nova.compute.manager [req-be74b09f-fe41-4dc7-84aa-172011c3e3e4 req-78bf83ca-6f90-437e-8ea8-53347bb44687 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Neutron deleted interface f5f10c24-54e5-4105-b3a0-92771126688c; detaching it from the instance and deleting it from the info cache
Jul 24 16:21:09 user nova-compute[70243]: DEBUG nova.network.neutron [req-be74b09f-fe41-4dc7-84aa-172011c3e3e4 req-78bf83ca-6f90-437e-8ea8-53347bb44687 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Updating instance_info_cache with network_info: [{"id": "6d0870b4-5264-46ca-a291-3c99a1c27546", "address": "fa:16:3e:c6:f9:65", "network": {"id": "9da02be9-9a4a-40bb-8a9b-9399b8f16521", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1533875048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0870b4-52", "ovs_interfaceid": "6d0870b4-5264-46ca-a291-3c99a1c27546", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "address": "fa:16:3e:a3:85:6c", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b943a9e-f3", "ovs_interfaceid": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "address": "fa:16:3e:13:6a:d5", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3b9944-66", "ovs_interfaceid": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "address": "fa:16:3e:06:13:18", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ac05d7-63", "ovs_interfaceid": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5980d7b6-c38c-4388-976b-039bcf31e766", "address": "fa:16:3e:a4:99:41", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5980d7b6-c3", "ovs_interfaceid": "5980d7b6-c38c-4388-976b-039bcf31e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b19372c-785f-4c41-8e00-31689097491b", "address": "fa:16:3e:ca:61:08", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b19372c-78", "ovs_interfaceid": "4b19372c-785f-4c41-8e00-31689097491b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:21:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-be74b09f-fe41-4dc7-84aa-172011c3e3e4 req-78bf83ca-6f90-437e-8ea8-53347bb44687 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Detach interface failed, port_id=f5f10c24-54e5-4105-b3a0-92771126688c, reason: Instance 236d3139-0c65-41af-a1a6-bc36e51fbf50 could not be found. {{(pid=70243) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 16:21:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-be74b09f-fe41-4dc7-84aa-172011c3e3e4 req-78bf83ca-6f90-437e-8ea8-53347bb44687 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-deleted-6d0870b4-5264-46ca-a291-3c99a1c27546 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:09 user nova-compute[70243]: INFO nova.compute.manager [req-be74b09f-fe41-4dc7-84aa-172011c3e3e4 req-78bf83ca-6f90-437e-8ea8-53347bb44687 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Neutron deleted interface 6d0870b4-5264-46ca-a291-3c99a1c27546; detaching it from the instance and deleting it from the info cache
Jul 24 16:21:09 user nova-compute[70243]: DEBUG nova.network.neutron [req-be74b09f-fe41-4dc7-84aa-172011c3e3e4 req-78bf83ca-6f90-437e-8ea8-53347bb44687 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Updating instance_info_cache with network_info: [{"id": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "address": "fa:16:3e:a3:85:6c", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b943a9e-f3", "ovs_interfaceid": "9b943a9e-f326-4526-8e6c-0462cb3860a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "address": "fa:16:3e:13:6a:d5", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3b9944-66", "ovs_interfaceid": "2b3b9944-66d7-44fb-b3fe-b361e73a8509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "address": "fa:16:3e:06:13:18", "network": {"id": "a1d0c300-0205-40b4-9568-127a92967ec4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1432971198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ac05d7-63", "ovs_interfaceid": "e6ac05d7-63c0-477d-89f5-d2612b39e976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5980d7b6-c38c-4388-976b-039bcf31e766", "address": "fa:16:3e:a4:99:41", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5980d7b6-c3", "ovs_interfaceid": "5980d7b6-c38c-4388-976b-039bcf31e766", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b19372c-785f-4c41-8e00-31689097491b", "address": "fa:16:3e:ca:61:08", "network": {"id": "e7f60358-c34c-4242-8190-7ba72313d9b5", "bridge": "br-int", "label": "tempest-device-tagging-net2-844488458", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cefa0481ae64474dbe0b5954a6de0b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b19372c-78", "ovs_interfaceid": "4b19372c-785f-4c41-8e00-31689097491b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:21:09 user nova-compute[70243]: DEBUG nova.compute.manager [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:21:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-be74b09f-fe41-4dc7-84aa-172011c3e3e4 req-78bf83ca-6f90-437e-8ea8-53347bb44687 service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Detach interface failed, port_id=6d0870b4-5264-46ca-a291-3c99a1c27546, reason: Instance 236d3139-0c65-41af-a1a6-bc36e51fbf50 could not be found. {{(pid=70243) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 16:21:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:09 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:21:09 user nova-compute[70243]: INFO nova.compute.claims [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Claim successful on node user
Jul 24 16:21:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:09 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:21:09 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:21:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:09 user nova-compute[70243]: DEBUG nova.compute.manager [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:21:09 user nova-compute[70243]: DEBUG nova.compute.manager [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:21:09 user nova-compute[70243]: DEBUG nova.network.neutron [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:21:09 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:21:09 user nova-compute[70243]: DEBUG nova.compute.manager [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:21:10 user nova-compute[70243]: DEBUG nova.policy [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83ec3411adf049b190874e4923f49472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ea0e23a23640a5b71e3269c6f1115c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:21:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:21:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:21:10 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Creating image(s)
Jul 24 16:21:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "/opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "/opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "dd58bbfe467ea6c97ad2003501c730cf628bb7e3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "dd58bbfe467ea6c97ad2003501c730cf628bb7e3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd58bbfe467ea6c97ad2003501c730cf628bb7e3.part --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:10 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:21:10 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Took 5.15 seconds to deallocate network for instance.
Jul 24 16:21:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd58bbfe467ea6c97ad2003501c730cf628bb7e3.part --force-share --output=json" returned: 0 in 0.157s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:10 user nova-compute[70243]: DEBUG nova.virt.images [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] 8228346d-44e7-4ff6-b55b-4929f4f18bca was qcow2, converting to raw {{(pid=70243) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 16:21:10 user nova-compute[70243]: DEBUG nova.privsep.utils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70243) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 16:21:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dd58bbfe467ea6c97ad2003501c730cf628bb7e3.part /opt/stack/data/nova/instances/_base/dd58bbfe467ea6c97ad2003501c730cf628bb7e3.converted {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:10 user nova-compute[70243]: DEBUG nova.network.neutron [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Successfully created port: 809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:21:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dd58bbfe467ea6c97ad2003501c730cf628bb7e3.part /opt/stack/data/nova/instances/_base/dd58bbfe467ea6c97ad2003501c730cf628bb7e3.converted" returned: 0 in 0.188s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd58bbfe467ea6c97ad2003501c730cf628bb7e3.converted --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd58bbfe467ea6c97ad2003501c730cf628bb7e3.converted --force-share --output=json" returned: 0 in 0.156s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "dd58bbfe467ea6c97ad2003501c730cf628bb7e3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.981s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd58bbfe467ea6c97ad2003501c730cf628bb7e3 --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd58bbfe467ea6c97ad2003501c730cf628bb7e3 --force-share --output=json" returned: 0 in 0.157s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "dd58bbfe467ea6c97ad2003501c730cf628bb7e3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "dd58bbfe467ea6c97ad2003501c730cf628bb7e3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd58bbfe467ea6c97ad2003501c730cf628bb7e3 --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG nova.compute.manager [req-03acaeae-9237-4fb0-abfe-2c036546b0a0 req-3d2eff11-4e9e-42b8-9b0d-4ba5d8b0609a service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-deleted-4b19372c-785f-4c41-8e00-31689097491b {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG nova.compute.manager [req-03acaeae-9237-4fb0-abfe-2c036546b0a0 req-3d2eff11-4e9e-42b8-9b0d-4ba5d8b0609a service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-deleted-5980d7b6-c38c-4388-976b-039bcf31e766 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG nova.compute.manager [req-03acaeae-9237-4fb0-abfe-2c036546b0a0 req-3d2eff11-4e9e-42b8-9b0d-4ba5d8b0609a service nova] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Received event network-vif-deleted-e6ac05d7-63c0-477d-89f5-d2612b39e976 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd58bbfe467ea6c97ad2003501c730cf628bb7e3 --force-share --output=json" returned: 0 in 0.148s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd58bbfe467ea6c97ad2003501c730cf628bb7e3,backing_fmt=raw /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd58bbfe467ea6c97ad2003501c730cf628bb7e3,backing_fmt=raw /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk 1073741824" returned: 0 in 0.048s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "dd58bbfe467ea6c97ad2003501c730cf628bb7e3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd58bbfe467ea6c97ad2003501c730cf628bb7e3 --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd58bbfe467ea6c97ad2003501c730cf628bb7e3 --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG nova.network.neutron [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Successfully updated port: 809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "refresh_cache-b0dd6065-3916-4f0e-841e-3df5ded2e2ee" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquired lock "refresh_cache-b0dd6065-3916-4f0e-841e-3df5ded2e2ee" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG nova.network.neutron [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Cannot resize image /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG nova.objects.instance [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lazy-loading 'migration_context' on Instance uuid b0dd6065-3916-4f0e-841e-3df5ded2e2ee {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG nova.network.neutron [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Ensure instance console log exists: /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.network.neutron [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Updating instance_info_cache with network_info: [{"id": "809292ba-1131-47d4-8b1c-b7cef6888d76", "address": "fa:16:3e:83:78:ca", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809292ba-11", "ovs_interfaceid": "809292ba-1131-47d4-8b1c-b7cef6888d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Releasing lock "refresh_cache-b0dd6065-3916-4f0e-841e-3df5ded2e2ee" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.compute.manager [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Instance network_info: |[{"id": "809292ba-1131-47d4-8b1c-b7cef6888d76", "address": "fa:16:3e:83:78:ca", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809292ba-11", "ovs_interfaceid": "809292ba-1131-47d4-8b1c-b7cef6888d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Start _get_guest_xml network_info=[{"id": "809292ba-1131-47d4-8b1c-b7cef6888d76", "address": "fa:16:3e:83:78:ca", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809292ba-11", "ovs_interfaceid": "809292ba-1131-47d4-8b1c-b7cef6888d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:21:05Z,direct_url=<?>,disk_format='qcow2',id=8228346d-44e7-4ff6-b55b-4929f4f18bca,min_disk=0,min_ram=0,name='tempest-scenario-img--1008556404',owner='65ea0e23a23640a5b71e3269c6f1115c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:21:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '8228346d-44e7-4ff6-b55b-4929f4f18bca'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:21:12 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:21:12 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:21:05Z,direct_url=<?>,disk_format='qcow2',id=8228346d-44e7-4ff6-b55b-4929f4f18bca,min_disk=0,min_ram=0,name='tempest-scenario-img--1008556404',owner='65ea0e23a23640a5b71e3269c6f1115c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:21:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:21:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1754472195',display_name='tempest-TestMinimumBasicScenario-server-1754472195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1754472195',id=12,image_ref='8228346d-44e7-4ff6-b55b-4929f4f18bca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzGIWh6T2nUwb11FT+HtBESAvQ3hfo4+kEpo2+0LOmZUrfs6OWjVXST2j/4MrpprDkytp9u/w90mIXmIV1/h+Jz0Mg6RkFV18VlGrbzGlqDpU/RgMYi9/VsCvHQTx94cw==',key_name='tempest-TestMinimumBasicScenario-386090327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65ea0e23a23640a5b71e3269c6f1115c',ramdisk_id='',reservation_id='r-95m0c446',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8228346d-44e7-4ff6-b55b-4929f4f18bca',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2131001827',owner_user_name='tempest-TestMinimumBasicScenario-2131001827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:21:10Z,user_data=None,user_id='83ec3411adf049b190874e4923f49472',uuid=b0dd6065-3916-4f0e-841e-3df5ded2e2ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "809292ba-1131-47d4-8b1c-b7cef6888d76", "address": "fa:16:3e:83:78:ca", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809292ba-11", "ovs_interfaceid": "809292ba-1131-47d4-8b1c-b7cef6888d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Converting VIF {"id": "809292ba-1131-47d4-8b1c-b7cef6888d76", "address": "fa:16:3e:83:78:ca", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809292ba-11", "ovs_interfaceid": "809292ba-1131-47d4-8b1c-b7cef6888d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=809292ba-1131-47d4-8b1c-b7cef6888d76,network=Network(8320b285-1c9b-4a9a-980a-5a37682cfde2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809292ba-11') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.objects.instance [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lazy-loading 'pci_devices' on Instance uuid b0dd6065-3916-4f0e-841e-3df5ded2e2ee {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:21:12 user nova-compute[70243]:   <uuid>b0dd6065-3916-4f0e-841e-3df5ded2e2ee</uuid>
Jul 24 16:21:12 user nova-compute[70243]:   <name>instance-0000000c</name>
Jul 24 16:21:12 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:21:12 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:21:12 user nova-compute[70243]:   <metadata>
Jul 24 16:21:12 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:21:12 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:21:12 user nova-compute[70243]:       <nova:name>tempest-TestMinimumBasicScenario-server-1754472195</nova:name>
Jul 24 16:21:12 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:21:12</nova:creationTime>
Jul 24 16:21:12 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:21:12 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:21:12 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:21:12 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:21:12 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:21:12 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:21:12 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:21:12 user nova-compute[70243]:       <nova:owner>
Jul 24 16:21:12 user nova-compute[70243]:         <nova:user uuid="83ec3411adf049b190874e4923f49472">tempest-TestMinimumBasicScenario-2131001827-project-member</nova:user>
Jul 24 16:21:12 user nova-compute[70243]:         <nova:project uuid="65ea0e23a23640a5b71e3269c6f1115c">tempest-TestMinimumBasicScenario-2131001827</nova:project>
Jul 24 16:21:12 user nova-compute[70243]:       </nova:owner>
Jul 24 16:21:12 user nova-compute[70243]:       <nova:root type="image" uuid="8228346d-44e7-4ff6-b55b-4929f4f18bca"/>
Jul 24 16:21:12 user nova-compute[70243]:       <nova:ports>
Jul 24 16:21:12 user nova-compute[70243]:         <nova:port uuid="809292ba-1131-47d4-8b1c-b7cef6888d76">
Jul 24 16:21:12 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 16:21:12 user nova-compute[70243]:         </nova:port>
Jul 24 16:21:12 user nova-compute[70243]:       </nova:ports>
Jul 24 16:21:12 user nova-compute[70243]:     </nova:instance>
Jul 24 16:21:12 user nova-compute[70243]:   </metadata>
Jul 24 16:21:12 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:21:12 user nova-compute[70243]:     <system>
Jul 24 16:21:12 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:21:12 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:21:12 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:21:12 user nova-compute[70243]:       <entry name="serial">b0dd6065-3916-4f0e-841e-3df5ded2e2ee</entry>
Jul 24 16:21:12 user nova-compute[70243]:       <entry name="uuid">b0dd6065-3916-4f0e-841e-3df5ded2e2ee</entry>
Jul 24 16:21:12 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:21:12 user nova-compute[70243]:     </system>
Jul 24 16:21:12 user nova-compute[70243]:   </sysinfo>
Jul 24 16:21:12 user nova-compute[70243]:   <os>
Jul 24 16:21:12 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:21:12 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:21:12 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:21:12 user nova-compute[70243]:   </os>
Jul 24 16:21:12 user nova-compute[70243]:   <features>
Jul 24 16:21:12 user nova-compute[70243]:     <acpi/>
Jul 24 16:21:12 user nova-compute[70243]:     <apic/>
Jul 24 16:21:12 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:21:12 user nova-compute[70243]:   </features>
Jul 24 16:21:12 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:21:12 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:21:12 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:21:12 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:21:12 user nova-compute[70243]:   </clock>
Jul 24 16:21:12 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:21:12 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:21:12 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:21:12 user nova-compute[70243]:   </cpu>
Jul 24 16:21:12 user nova-compute[70243]:   <devices>
Jul 24 16:21:12 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:21:12 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:21:12 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk"/>
Jul 24 16:21:12 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:21:12 user nova-compute[70243]:     </disk>
Jul 24 16:21:12 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:21:12 user nova-compute[70243]:       <mac address="fa:16:3e:83:78:ca"/>
Jul 24 16:21:12 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:21:12 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:21:12 user nova-compute[70243]:       <target dev="tap809292ba-11"/>
Jul 24 16:21:12 user nova-compute[70243]:     </interface>
Jul 24 16:21:12 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:21:12 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/console.log" append="off"/>
Jul 24 16:21:12 user nova-compute[70243]:     </serial>
Jul 24 16:21:12 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:21:12 user nova-compute[70243]:     <video>
Jul 24 16:21:12 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:21:12 user nova-compute[70243]:     </video>
Jul 24 16:21:12 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:21:12 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:21:12 user nova-compute[70243]:     </rng>
Jul 24 16:21:12 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:21:12 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:21:12 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:21:12 user nova-compute[70243]:     </memballoon>
Jul 24 16:21:12 user nova-compute[70243]:   </devices>
Jul 24 16:21:12 user nova-compute[70243]: </domain>
Jul 24 16:21:12 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:21:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1754472195',display_name='tempest-TestMinimumBasicScenario-server-1754472195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1754472195',id=12,image_ref='8228346d-44e7-4ff6-b55b-4929f4f18bca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzGIWh6T2nUwb11FT+HtBESAvQ3hfo4+kEpo2+0LOmZUrfs6OWjVXST2j/4MrpprDkytp9u/w90mIXmIV1/h+Jz0Mg6RkFV18VlGrbzGlqDpU/RgMYi9/VsCvHQTx94cw==',key_name='tempest-TestMinimumBasicScenario-386090327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65ea0e23a23640a5b71e3269c6f1115c',ramdisk_id='',reservation_id='r-95m0c446',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8228346d-44e7-4ff6-b55b-4929f4f18bca',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2131001827',owner_user_name='tempest-TestMinimumBasicScenario-2131001827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:21:10Z,user_data=None,user_id='83ec3411adf049b190874e4923f49472',uuid=b0dd6065-3916-4f0e-841e-3df5ded2e2ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "809292ba-1131-47d4-8b1c-b7cef6888d76", "address": "fa:16:3e:83:78:ca", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809292ba-11", "ovs_interfaceid": "809292ba-1131-47d4-8b1c-b7cef6888d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Converting VIF {"id": "809292ba-1131-47d4-8b1c-b7cef6888d76", "address": "fa:16:3e:83:78:ca", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809292ba-11", "ovs_interfaceid": "809292ba-1131-47d4-8b1c-b7cef6888d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=809292ba-1131-47d4-8b1c-b7cef6888d76,network=Network(8320b285-1c9b-4a9a-980a-5a37682cfde2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809292ba-11') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG os_vif [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=809292ba-1131-47d4-8b1c-b7cef6888d76,network=Network(8320b285-1c9b-4a9a-980a-5a37682cfde2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809292ba-11') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap809292ba-11, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap809292ba-11, col_values=(('external_ids', {'iface-id': '809292ba-1131-47d4-8b1c-b7cef6888d76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:78:ca', 'vm-uuid': 'b0dd6065-3916-4f0e-841e-3df5ded2e2ee'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:12 user nova-compute[70243]: INFO os_vif [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=809292ba-1131-47d4-8b1c-b7cef6888d76,network=Network(8320b285-1c9b-4a9a-980a-5a37682cfde2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809292ba-11')
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:21:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] No VIF found with MAC fa:16:3e:83:78:ca, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:21:13 user nova-compute[70243]: INFO nova.compute.manager [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Took 2.50 seconds to detach 3 volumes for instance.
Jul 24 16:21:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:13 user nova-compute[70243]: DEBUG nova.compute.manager [req-a6d94e93-173e-484c-8138-9f6be8a0a713 req-eda6949f-d769-40d0-95f1-7e53fb221078 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received event network-changed-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:13 user nova-compute[70243]: DEBUG nova.compute.manager [req-a6d94e93-173e-484c-8138-9f6be8a0a713 req-eda6949f-d769-40d0-95f1-7e53fb221078 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Refreshing instance network info cache due to event network-changed-809292ba-1131-47d4-8b1c-b7cef6888d76. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:21:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a6d94e93-173e-484c-8138-9f6be8a0a713 req-eda6949f-d769-40d0-95f1-7e53fb221078 service nova] Acquiring lock "refresh_cache-b0dd6065-3916-4f0e-841e-3df5ded2e2ee" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:21:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a6d94e93-173e-484c-8138-9f6be8a0a713 req-eda6949f-d769-40d0-95f1-7e53fb221078 service nova] Acquired lock "refresh_cache-b0dd6065-3916-4f0e-841e-3df5ded2e2ee" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:21:13 user nova-compute[70243]: DEBUG nova.network.neutron [req-a6d94e93-173e-484c-8138-9f6be8a0a713 req-eda6949f-d769-40d0-95f1-7e53fb221078 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Refreshing network info cache for port 809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:21:13 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:21:13 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:21:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:13 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Deleted allocations for instance 236d3139-0c65-41af-a1a6-bc36e51fbf50
Jul 24 16:21:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9f848b6a-c703-4e17-bb96-2833712fdcd1 tempest-TaggedBootDevicesTest-151685023 tempest-TaggedBootDevicesTest-151685023-project-member] Lock "236d3139-0c65-41af-a1a6-bc36e51fbf50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.525s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG nova.network.neutron [req-a6d94e93-173e-484c-8138-9f6be8a0a713 req-eda6949f-d769-40d0-95f1-7e53fb221078 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Updated VIF entry in instance network info cache for port 809292ba-1131-47d4-8b1c-b7cef6888d76. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG nova.network.neutron [req-a6d94e93-173e-484c-8138-9f6be8a0a713 req-eda6949f-d769-40d0-95f1-7e53fb221078 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Updating instance_info_cache with network_info: [{"id": "809292ba-1131-47d4-8b1c-b7cef6888d76", "address": "fa:16:3e:83:78:ca", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809292ba-11", "ovs_interfaceid": "809292ba-1131-47d4-8b1c-b7cef6888d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a6d94e93-173e-484c-8138-9f6be8a0a713 req-eda6949f-d769-40d0-95f1-7e53fb221078 service nova] Releasing lock "refresh_cache-b0dd6065-3916-4f0e-841e-3df5ded2e2ee" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:21:14 user nova-compute[70243]: INFO nova.compute.claims [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Claim successful on node user
Jul 24 16:21:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG nova.network.neutron [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:21:14 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:21:14 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG nova.policy [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e6294a2931e4959be1440678b174828', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6973a869545f43e1bd096a5f6eaf921c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:21:14 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:21:14 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Creating image(s)
Jul 24 16:21:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "/opt/stack/data/nova/instances/d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "/opt/stack/data/nova/instances/d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.144s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.155s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32/disk 1073741824" returned: 0 in 0.057s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.compute.manager [req-316fe30f-8975-436a-8570-67b467ebb583 req-0a98563c-1a5a-4a7b-b81a-d91155c60abe service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received event network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-316fe30f-8975-436a-8570-67b467ebb583 req-0a98563c-1a5a-4a7b-b81a-d91155c60abe service nova] Acquiring lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-316fe30f-8975-436a-8570-67b467ebb583 req-0a98563c-1a5a-4a7b-b81a-d91155c60abe service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-316fe30f-8975-436a-8570-67b467ebb583 req-0a98563c-1a5a-4a7b-b81a-d91155c60abe service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.compute.manager [req-316fe30f-8975-436a-8570-67b467ebb583 req-0a98563c-1a5a-4a7b-b81a-d91155c60abe service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] No waiting events found dispatching network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:15 user nova-compute[70243]: WARNING nova.compute.manager [req-316fe30f-8975-436a-8570-67b467ebb583 req-0a98563c-1a5a-4a7b-b81a-d91155c60abe service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received unexpected event network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 for instance with vm_state building and task_state spawning.
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.compute.manager [req-316fe30f-8975-436a-8570-67b467ebb583 req-0a98563c-1a5a-4a7b-b81a-d91155c60abe service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received event network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-316fe30f-8975-436a-8570-67b467ebb583 req-0a98563c-1a5a-4a7b-b81a-d91155c60abe service nova] Acquiring lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-316fe30f-8975-436a-8570-67b467ebb583 req-0a98563c-1a5a-4a7b-b81a-d91155c60abe service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-316fe30f-8975-436a-8570-67b467ebb583 req-0a98563c-1a5a-4a7b-b81a-d91155c60abe service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.compute.manager [req-316fe30f-8975-436a-8570-67b467ebb583 req-0a98563c-1a5a-4a7b-b81a-d91155c60abe service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] No waiting events found dispatching network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:15 user nova-compute[70243]: WARNING nova.compute.manager [req-316fe30f-8975-436a-8570-67b467ebb583 req-0a98563c-1a5a-4a7b-b81a-d91155c60abe service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received unexpected event network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 for instance with vm_state building and task_state spawning.
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.147s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Cannot resize image /opt/stack/data/nova/instances/d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.objects.instance [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lazy-loading 'migration_context' on Instance uuid d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215675.699312, b0dd6065-3916-4f0e-841e-3df5ded2e2ee => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:21:15 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] VM Resumed (Lifecycle Event)
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Ensure instance console log exists: /opt/stack/data/nova/instances/d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:21:15 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Instance spawned successfully.
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:21:15 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215675.7022278, b0dd6065-3916-4f0e-841e-3df5ded2e2ee => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:21:15 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] VM Started (Lifecycle Event)
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:21:15 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.network.neutron [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Successfully created port: 98ae14d1-ca47-4ba3-9327-5bfecb545a5d {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:21:15 user nova-compute[70243]: INFO nova.compute.manager [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Took 5.86 seconds to spawn the instance on the hypervisor.
Jul 24 16:21:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:21:16 user nova-compute[70243]: INFO nova.compute.manager [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Took 6.82 seconds to build instance.
Jul 24 16:21:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6ff92a29-3505-4c3a-8ab6-4d200869acfd tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.983s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:16 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:16 user nova-compute[70243]: DEBUG nova.network.neutron [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Successfully updated port: 98ae14d1-ca47-4ba3-9327-5bfecb545a5d {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:21:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "refresh_cache-d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:21:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquired lock "refresh_cache-d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:21:16 user nova-compute[70243]: DEBUG nova.network.neutron [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:21:16 user nova-compute[70243]: DEBUG nova.network.neutron [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.network.neutron [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Updating instance_info_cache with network_info: [{"id": "98ae14d1-ca47-4ba3-9327-5bfecb545a5d", "address": "fa:16:3e:c1:c5:80", "network": {"id": "798ddded-1cb9-4c01-9590-27f071d81a3c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1340440057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6973a869545f43e1bd096a5f6eaf921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ae14d1-ca", "ovs_interfaceid": "98ae14d1-ca47-4ba3-9327-5bfecb545a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Releasing lock "refresh_cache-d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Instance network_info: |[{"id": "98ae14d1-ca47-4ba3-9327-5bfecb545a5d", "address": "fa:16:3e:c1:c5:80", "network": {"id": "798ddded-1cb9-4c01-9590-27f071d81a3c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1340440057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6973a869545f43e1bd096a5f6eaf921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ae14d1-ca", "ovs_interfaceid": "98ae14d1-ca47-4ba3-9327-5bfecb545a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Start _get_guest_xml network_info=[{"id": "98ae14d1-ca47-4ba3-9327-5bfecb545a5d", "address": "fa:16:3e:c1:c5:80", "network": {"id": "798ddded-1cb9-4c01-9590-27f071d81a3c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1340440057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6973a869545f43e1bd096a5f6eaf921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ae14d1-ca", "ovs_interfaceid": "98ae14d1-ca47-4ba3-9327-5bfecb545a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:21:17 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:21:17 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1530594278',display_name='tempest-VolumesAdminNegativeTest-server-1530594278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1530594278',id=13,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6973a869545f43e1bd096a5f6eaf921c',ramdisk_id='',reservation_id='r-5p3noewz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2091650987',owner_user_name='tempest-VolumesAdminNegativeTest-2091650987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:21:15Z,user_data=None,user_id='4e6294a2931e4959be1440678b174828',uuid=d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98ae14d1-ca47-4ba3-9327-5bfecb545a5d", "address": "fa:16:3e:c1:c5:80", "network": {"id": "798ddded-1cb9-4c01-9590-27f071d81a3c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1340440057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6973a869545f43e1bd096a5f6eaf921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ae14d1-ca", "ovs_interfaceid": "98ae14d1-ca47-4ba3-9327-5bfecb545a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Converting VIF {"id": "98ae14d1-ca47-4ba3-9327-5bfecb545a5d", "address": "fa:16:3e:c1:c5:80", "network": {"id": "798ddded-1cb9-4c01-9590-27f071d81a3c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1340440057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6973a869545f43e1bd096a5f6eaf921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ae14d1-ca", "ovs_interfaceid": "98ae14d1-ca47-4ba3-9327-5bfecb545a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c5:80,bridge_name='br-int',has_traffic_filtering=True,id=98ae14d1-ca47-4ba3-9327-5bfecb545a5d,network=Network(798ddded-1cb9-4c01-9590-27f071d81a3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ae14d1-ca') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.objects.instance [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lazy-loading 'pci_devices' on Instance uuid d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:21:17 user nova-compute[70243]:   <uuid>d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32</uuid>
Jul 24 16:21:17 user nova-compute[70243]:   <name>instance-0000000d</name>
Jul 24 16:21:17 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:21:17 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:21:17 user nova-compute[70243]:   <metadata>
Jul 24 16:21:17 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:21:17 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:21:17 user nova-compute[70243]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1530594278</nova:name>
Jul 24 16:21:17 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:21:17</nova:creationTime>
Jul 24 16:21:17 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:21:17 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:21:17 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:21:17 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:21:17 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:21:17 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:21:17 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:21:17 user nova-compute[70243]:       <nova:owner>
Jul 24 16:21:17 user nova-compute[70243]:         <nova:user uuid="4e6294a2931e4959be1440678b174828">tempest-VolumesAdminNegativeTest-2091650987-project-member</nova:user>
Jul 24 16:21:17 user nova-compute[70243]:         <nova:project uuid="6973a869545f43e1bd096a5f6eaf921c">tempest-VolumesAdminNegativeTest-2091650987</nova:project>
Jul 24 16:21:17 user nova-compute[70243]:       </nova:owner>
Jul 24 16:21:17 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:21:17 user nova-compute[70243]:       <nova:ports>
Jul 24 16:21:17 user nova-compute[70243]:         <nova:port uuid="98ae14d1-ca47-4ba3-9327-5bfecb545a5d">
Jul 24 16:21:17 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 16:21:17 user nova-compute[70243]:         </nova:port>
Jul 24 16:21:17 user nova-compute[70243]:       </nova:ports>
Jul 24 16:21:17 user nova-compute[70243]:     </nova:instance>
Jul 24 16:21:17 user nova-compute[70243]:   </metadata>
Jul 24 16:21:17 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:21:17 user nova-compute[70243]:     <system>
Jul 24 16:21:17 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:21:17 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:21:17 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:21:17 user nova-compute[70243]:       <entry name="serial">d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32</entry>
Jul 24 16:21:17 user nova-compute[70243]:       <entry name="uuid">d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32</entry>
Jul 24 16:21:17 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:21:17 user nova-compute[70243]:     </system>
Jul 24 16:21:17 user nova-compute[70243]:   </sysinfo>
Jul 24 16:21:17 user nova-compute[70243]:   <os>
Jul 24 16:21:17 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:21:17 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:21:17 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:21:17 user nova-compute[70243]:   </os>
Jul 24 16:21:17 user nova-compute[70243]:   <features>
Jul 24 16:21:17 user nova-compute[70243]:     <acpi/>
Jul 24 16:21:17 user nova-compute[70243]:     <apic/>
Jul 24 16:21:17 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:21:17 user nova-compute[70243]:   </features>
Jul 24 16:21:17 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:21:17 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:21:17 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:21:17 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:21:17 user nova-compute[70243]:   </clock>
Jul 24 16:21:17 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:21:17 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:21:17 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:21:17 user nova-compute[70243]:   </cpu>
Jul 24 16:21:17 user nova-compute[70243]:   <devices>
Jul 24 16:21:17 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:21:17 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:21:17 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32/disk"/>
Jul 24 16:21:17 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:21:17 user nova-compute[70243]:     </disk>
Jul 24 16:21:17 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:21:17 user nova-compute[70243]:       <mac address="fa:16:3e:c1:c5:80"/>
Jul 24 16:21:17 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:21:17 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:21:17 user nova-compute[70243]:       <target dev="tap98ae14d1-ca"/>
Jul 24 16:21:17 user nova-compute[70243]:     </interface>
Jul 24 16:21:17 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:21:17 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32/console.log" append="off"/>
Jul 24 16:21:17 user nova-compute[70243]:     </serial>
Jul 24 16:21:17 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:21:17 user nova-compute[70243]:     <video>
Jul 24 16:21:17 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:21:17 user nova-compute[70243]:     </video>
Jul 24 16:21:17 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:21:17 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:21:17 user nova-compute[70243]:     </rng>
Jul 24 16:21:17 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:21:17 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:21:17 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:21:17 user nova-compute[70243]:     </memballoon>
Jul 24 16:21:17 user nova-compute[70243]:   </devices>
Jul 24 16:21:17 user nova-compute[70243]: </domain>
Jul 24 16:21:17 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1530594278',display_name='tempest-VolumesAdminNegativeTest-server-1530594278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1530594278',id=13,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6973a869545f43e1bd096a5f6eaf921c',ramdisk_id='',reservation_id='r-5p3noewz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2091650987',owner_user_name='tempest-VolumesAdminNegativeTest-2091650987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:21:15Z,user_data=None,user_id='4e6294a2931e4959be1440678b174828',uuid=d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98ae14d1-ca47-4ba3-9327-5bfecb545a5d", "address": "fa:16:3e:c1:c5:80", "network": {"id": "798ddded-1cb9-4c01-9590-27f071d81a3c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1340440057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6973a869545f43e1bd096a5f6eaf921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ae14d1-ca", "ovs_interfaceid": "98ae14d1-ca47-4ba3-9327-5bfecb545a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Converting VIF {"id": "98ae14d1-ca47-4ba3-9327-5bfecb545a5d", "address": "fa:16:3e:c1:c5:80", "network": {"id": "798ddded-1cb9-4c01-9590-27f071d81a3c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1340440057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6973a869545f43e1bd096a5f6eaf921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ae14d1-ca", "ovs_interfaceid": "98ae14d1-ca47-4ba3-9327-5bfecb545a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c5:80,bridge_name='br-int',has_traffic_filtering=True,id=98ae14d1-ca47-4ba3-9327-5bfecb545a5d,network=Network(798ddded-1cb9-4c01-9590-27f071d81a3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ae14d1-ca') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG os_vif [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c5:80,bridge_name='br-int',has_traffic_filtering=True,id=98ae14d1-ca47-4ba3-9327-5bfecb545a5d,network=Network(798ddded-1cb9-4c01-9590-27f071d81a3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ae14d1-ca') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98ae14d1-ca, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98ae14d1-ca, col_values=(('external_ids', {'iface-id': '98ae14d1-ca47-4ba3-9327-5bfecb545a5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:c5:80', 'vm-uuid': 'd2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:17 user nova-compute[70243]: INFO os_vif [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c5:80,bridge_name='br-int',has_traffic_filtering=True,id=98ae14d1-ca47-4ba3-9327-5bfecb545a5d,network=Network(798ddded-1cb9-4c01-9590-27f071d81a3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ae14d1-ca')
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] No VIF found with MAC fa:16:3e:c1:c5:80, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.compute.manager [req-a537bb4c-7e7d-4ea9-bf4e-6c296764ce37 req-49261908-6772-4d07-a38b-e8762e39e7af service nova] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Received event network-changed-98ae14d1-ca47-4ba3-9327-5bfecb545a5d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.compute.manager [req-a537bb4c-7e7d-4ea9-bf4e-6c296764ce37 req-49261908-6772-4d07-a38b-e8762e39e7af service nova] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Refreshing instance network info cache due to event network-changed-98ae14d1-ca47-4ba3-9327-5bfecb545a5d. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a537bb4c-7e7d-4ea9-bf4e-6c296764ce37 req-49261908-6772-4d07-a38b-e8762e39e7af service nova] Acquiring lock "refresh_cache-d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a537bb4c-7e7d-4ea9-bf4e-6c296764ce37 req-49261908-6772-4d07-a38b-e8762e39e7af service nova] Acquired lock "refresh_cache-d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.network.neutron [req-a537bb4c-7e7d-4ea9-bf4e-6c296764ce37 req-49261908-6772-4d07-a38b-e8762e39e7af service nova] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Refreshing network info cache for port 98ae14d1-ca47-4ba3-9327-5bfecb545a5d {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.network.neutron [req-a537bb4c-7e7d-4ea9-bf4e-6c296764ce37 req-49261908-6772-4d07-a38b-e8762e39e7af service nova] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Updated VIF entry in instance network info cache for port 98ae14d1-ca47-4ba3-9327-5bfecb545a5d. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:21:17 user nova-compute[70243]: DEBUG nova.network.neutron [req-a537bb4c-7e7d-4ea9-bf4e-6c296764ce37 req-49261908-6772-4d07-a38b-e8762e39e7af service nova] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Updating instance_info_cache with network_info: [{"id": "98ae14d1-ca47-4ba3-9327-5bfecb545a5d", "address": "fa:16:3e:c1:c5:80", "network": {"id": "798ddded-1cb9-4c01-9590-27f071d81a3c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1340440057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6973a869545f43e1bd096a5f6eaf921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ae14d1-ca", "ovs_interfaceid": "98ae14d1-ca47-4ba3-9327-5bfecb545a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:21:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a537bb4c-7e7d-4ea9-bf4e-6c296764ce37 req-49261908-6772-4d07-a38b-e8762e39e7af service nova] Releasing lock "refresh_cache-d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:21:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:18 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690215663.8780456, 236d3139-0c65-41af-a1a6-bc36e51fbf50 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:21:18 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] VM Stopped (Lifecycle Event)
Jul 24 16:21:18 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b9464f57-e9f0-48a3-b69b-74600937048f None None] [instance: 236d3139-0c65-41af-a1a6-bc36e51fbf50] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:21:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-d08081db-3a23-4883-a149-2c5b97898351 req-3dfe9414-632b-49c6-a001-e0e27f575f71 service nova] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Received event network-vif-plugged-98ae14d1-ca47-4ba3-9327-5bfecb545a5d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d08081db-3a23-4883-a149-2c5b97898351 req-3dfe9414-632b-49c6-a001-e0e27f575f71 service nova] Acquiring lock "d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d08081db-3a23-4883-a149-2c5b97898351 req-3dfe9414-632b-49c6-a001-e0e27f575f71 service nova] Lock "d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d08081db-3a23-4883-a149-2c5b97898351 req-3dfe9414-632b-49c6-a001-e0e27f575f71 service nova] Lock "d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-d08081db-3a23-4883-a149-2c5b97898351 req-3dfe9414-632b-49c6-a001-e0e27f575f71 service nova] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] No waiting events found dispatching network-vif-plugged-98ae14d1-ca47-4ba3-9327-5bfecb545a5d {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:19 user nova-compute[70243]: WARNING nova.compute.manager [req-d08081db-3a23-4883-a149-2c5b97898351 req-3dfe9414-632b-49c6-a001-e0e27f575f71 service nova] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Received unexpected event network-vif-plugged-98ae14d1-ca47-4ba3-9327-5bfecb545a5d for instance with vm_state building and task_state spawning.
Jul 24 16:21:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-d08081db-3a23-4883-a149-2c5b97898351 req-3dfe9414-632b-49c6-a001-e0e27f575f71 service nova] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Received event network-vif-plugged-98ae14d1-ca47-4ba3-9327-5bfecb545a5d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d08081db-3a23-4883-a149-2c5b97898351 req-3dfe9414-632b-49c6-a001-e0e27f575f71 service nova] Acquiring lock "d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d08081db-3a23-4883-a149-2c5b97898351 req-3dfe9414-632b-49c6-a001-e0e27f575f71 service nova] Lock "d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d08081db-3a23-4883-a149-2c5b97898351 req-3dfe9414-632b-49c6-a001-e0e27f575f71 service nova] Lock "d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-d08081db-3a23-4883-a149-2c5b97898351 req-3dfe9414-632b-49c6-a001-e0e27f575f71 service nova] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] No waiting events found dispatching network-vif-plugged-98ae14d1-ca47-4ba3-9327-5bfecb545a5d {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:19 user nova-compute[70243]: WARNING nova.compute.manager [req-d08081db-3a23-4883-a149-2c5b97898351 req-3dfe9414-632b-49c6-a001-e0e27f575f71 service nova] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Received unexpected event network-vif-plugged-98ae14d1-ca47-4ba3-9327-5bfecb545a5d for instance with vm_state building and task_state spawning.
Jul 24 16:21:21 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215681.1839402, d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:21:21 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] VM Resumed (Lifecycle Event)
Jul 24 16:21:21 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:21:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:21:21 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Instance spawned successfully.
Jul 24 16:21:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:21:21 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:21:21 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:21:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:21:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:21:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:21:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:21:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:21:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:21:21 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:21:21 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215681.185159, d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:21:21 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] VM Started (Lifecycle Event)
Jul 24 16:21:21 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:21:21 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:21:21 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:21:21 user nova-compute[70243]: INFO nova.compute.manager [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Took 6.55 seconds to spawn the instance on the hypervisor.
Jul 24 16:21:21 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:21:21 user nova-compute[70243]: INFO nova.compute.manager [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Took 7.42 seconds to build instance.
Jul 24 16:21:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ec3ae30-2fa9-44ac-b9f5-59d1bd42b36e tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.543s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:32 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:39 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:21:39 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:21:39 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:21:39 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:21:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:39 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:21:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:39 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:21:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:39 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:21:39 user nova-compute[70243]: INFO nova.compute.claims [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Claim successful on node user
Jul 24 16:21:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:21:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "de22ea98-b041-4f3f-8986-435c43267a2e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "de22ea98-b041-4f3f-8986-435c43267a2e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG nova.objects.instance [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lazy-loading 'flavor' on Instance uuid de22ea98-b041-4f3f-8986-435c43267a2e {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.622s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "de22ea98-b041-4f3f-8986-435c43267a2e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:21:40 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "de22ea98-b041-4f3f-8986-435c43267a2e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "de22ea98-b041-4f3f-8986-435c43267a2e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:40 user nova-compute[70243]: INFO nova.compute.manager [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Attaching volume 914f1c49-d025-4757-84d7-32fa800e552b to /dev/vdb
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG os_brick.utils [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b860b4a2-c256-496a-8096-55e7045181fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:40 user nova-compute[70243]: INFO nova.virt.block_device [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Booting with volume 42c9f323-641d-40da-ad5f-876db0d03c30 at /dev/vda
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e1421c-0c9f-4336-a660-288f9cc5fc64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[df34d365-8aae-4e25-9183-561ce318388d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG nova.policy [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2a20e83d9f14ba69a4e552a1ac7b985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1580d59d0e041ec980753d98a90158a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG os_brick.utils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7352b7bc-0041-4cc6-81f9-f31e82dea11e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e89a549-267f-4ae8-8516-1c761aa53a99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:21:40 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e73818-4912-43b0-a6a9-fd46202ae23f]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG os_brick.utils [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Updating existing volume attachment record: 930cc80f-9ff0-45cd-9b6b-8315bf7f493e {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5541e81-dd6e-401b-9203-5beafd621705]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28bcf0b-d2d5-48d8-943b-388fda897295]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b2fc81-9a42-4ab4-aff7-5321e4456146]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:21:41 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:21:41 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7809aa77-cb13-4ce9-8d97-7bf51c819e63]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG os_brick.utils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] <== get_connector_properties: return (195ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Updating existing volume attachment record: 6be1fda4-f2ef-4118-8c13-9507075bcd05 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Successfully created port: dabb3818-16d0-4d10-9912-15dd72754963 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:42 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Successfully created port: a2077cf2-6cf5-47e2-b50e-22625dd1c118 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:21:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Successfully created port: 44c70c07-ac30-4af3-b1a2-5f886d4ca1c1 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:21:43 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:21:43 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:21:43 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=7533MB free_disk=24.454994201660156GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance de22ea98-b041-4f3f-8986-435c43267a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance de484cb2-7f20-4bf1-927b-c066735bfeca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance a13c243a-2b98-4ef1-b17c-e2e15ba005fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance ad611655-ba4d-4a66-b78e-a82c058f4414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5f70528b-33db-4257-96fe-e5fad869a224 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance c2ee17ba-3482-4caf-992e-30b3953d1e91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5e6a5fff-570c-4ee2-b883-415ec828ef97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance fd314e21-b1a5-425d-a5e0-c1b3303b72d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance b0dd6065-3916-4f0e-841e-3df5ded2e2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance edf964e0-bee8-42c8-b4eb-dd490d3fa2ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquiring lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG nova.objects.instance [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lazy-loading 'flavor' on Instance uuid a13c243a-2b98-4ef1-b17c-e2e15ba005fd {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquiring lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:43 user nova-compute[70243]: INFO nova.compute.manager [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Attaching volume fa6f7d2d-caff-4248-b9c7-4d785414616b to /dev/vdb
Jul 24 16:21:43 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.635s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG os_brick.utils [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31d26e9-2728-4cf6-bf65-09871b5b6073]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33c3e64-9f3b-4465-ad42-a74af8239911]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[829ae8d2-91f7-4444-a5c9-078a2ed84439]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[683456a5-c3ea-41cc-83ef-681509e37b01]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:21:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:21:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:44 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Successfully created port: ee32acf5-1ead-4f29-b7a0-77a16d10778e {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:21:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:21:44 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:21:44 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b49ed9-b514-4049-a50d-1601b94072e4]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:21:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:21:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:21:44 user nova-compute[70243]: DEBUG os_brick.utils [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:21:44 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Updating existing volume attachment record: 7ff29e64-ed0d-468e-b572-065fa2f380e0 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:21:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:44 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Successfully created port: e71b975d-1eaa-46f2-b6a7-01771b71b484 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:21:44 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:21:44 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:21:44 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:21:44 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:21:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:21:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:21:44 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:21:45 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Updating instance_info_cache with network_info: [{"id": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "address": "fa:16:3e:92:8d:42", "network": {"id": "69c0285e-5c28-41c5-893d-9d92e9626cb2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808448879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c70a6d9bf46466da48267f2fc2e02d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2943f763-29", "ovs_interfaceid": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:21:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:21:45 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:21:45 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:21:45 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:21:45 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:21:45 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:21:45 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Successfully updated port: dabb3818-16d0-4d10-9912-15dd72754963 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:21:45 user nova-compute[70243]: DEBUG nova.compute.manager [req-56b4e7b7-72f9-4075-8b4c-3cd2c3cb1e8c req-75ac1337-9611-42d7-8bef-9d17dcbdd4d3 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-changed-dabb3818-16d0-4d10-9912-15dd72754963 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:45 user nova-compute[70243]: DEBUG nova.compute.manager [req-56b4e7b7-72f9-4075-8b4c-3cd2c3cb1e8c req-75ac1337-9611-42d7-8bef-9d17dcbdd4d3 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Refreshing instance network info cache due to event network-changed-dabb3818-16d0-4d10-9912-15dd72754963. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:21:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-56b4e7b7-72f9-4075-8b4c-3cd2c3cb1e8c req-75ac1337-9611-42d7-8bef-9d17dcbdd4d3 service nova] Acquiring lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:21:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-56b4e7b7-72f9-4075-8b4c-3cd2c3cb1e8c req-75ac1337-9611-42d7-8bef-9d17dcbdd4d3 service nova] Acquired lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:21:45 user nova-compute[70243]: DEBUG nova.network.neutron [req-56b4e7b7-72f9-4075-8b4c-3cd2c3cb1e8c req-75ac1337-9611-42d7-8bef-9d17dcbdd4d3 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Refreshing network info cache for port dabb3818-16d0-4d10-9912-15dd72754963 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:21:45 user nova-compute[70243]: DEBUG nova.network.neutron [req-56b4e7b7-72f9-4075-8b4c-3cd2c3cb1e8c req-75ac1337-9611-42d7-8bef-9d17dcbdd4d3 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:21:46 user nova-compute[70243]: DEBUG nova.network.neutron [req-56b4e7b7-72f9-4075-8b4c-3cd2c3cb1e8c req-75ac1337-9611-42d7-8bef-9d17dcbdd4d3 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:21:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-56b4e7b7-72f9-4075-8b4c-3cd2c3cb1e8c req-75ac1337-9611-42d7-8bef-9d17dcbdd4d3 service nova] Releasing lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:21:47 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Successfully updated port: 15d99894-04b8-415b-a03a-ccc794f9d8dc {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:21:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:47 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Successfully updated port: c469bd25-6546-47e3-92f6-96674f256be6 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:21:47 user nova-compute[70243]: DEBUG nova.compute.manager [req-484e96ec-53a5-419b-b368-7d533602426c req-e585af08-9f7c-4789-90aa-5f12d793bef6 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-changed-15d99894-04b8-415b-a03a-ccc794f9d8dc {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:47 user nova-compute[70243]: DEBUG nova.compute.manager [req-484e96ec-53a5-419b-b368-7d533602426c req-e585af08-9f7c-4789-90aa-5f12d793bef6 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Refreshing instance network info cache due to event network-changed-15d99894-04b8-415b-a03a-ccc794f9d8dc. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:21:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-484e96ec-53a5-419b-b368-7d533602426c req-e585af08-9f7c-4789-90aa-5f12d793bef6 service nova] Acquiring lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:21:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-484e96ec-53a5-419b-b368-7d533602426c req-e585af08-9f7c-4789-90aa-5f12d793bef6 service nova] Acquired lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:21:47 user nova-compute[70243]: DEBUG nova.network.neutron [req-484e96ec-53a5-419b-b368-7d533602426c req-e585af08-9f7c-4789-90aa-5f12d793bef6 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Refreshing network info cache for port 15d99894-04b8-415b-a03a-ccc794f9d8dc {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:21:48 user nova-compute[70243]: DEBUG nova.network.neutron [req-484e96ec-53a5-419b-b368-7d533602426c req-e585af08-9f7c-4789-90aa-5f12d793bef6 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:21:48 user nova-compute[70243]: INFO nova.virt.block_device [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Booting with volume f7373fa4-1362-4914-9741-3ae96ce33f3b at /dev/vdb
Jul 24 16:21:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Acquiring lock "5e6a5fff-570c-4ee2-b883-415ec828ef97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Acquiring lock "5e6a5fff-570c-4ee2-b883-415ec828ef97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:48 user nova-compute[70243]: INFO nova.compute.manager [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Terminating instance
Jul 24 16:21:48 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:21:48 user nova-compute[70243]: DEBUG os_brick.utils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:21:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:48 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fe7f34-24a3-45e5-adfa-b778d807187b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:48 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5474cb0c-87fd-4f9f-b28a-b49edcabb4c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:48 user nova-compute[70243]: DEBUG nova.network.neutron [req-484e96ec-53a5-419b-b368-7d533602426c req-e585af08-9f7c-4789-90aa-5f12d793bef6 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:21:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:48 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec76fb0e-811e-4ecd-96ee-e47828464354]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:48 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba02efc-ce37-4b94-8547-cddaa23af771]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-484e96ec-53a5-419b-b368-7d533602426c req-e585af08-9f7c-4789-90aa-5f12d793bef6 service nova] Releasing lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:21:49 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:21:49 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb3f707-93ac-4c6b-8e0d-98af0a5ae10f]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG os_brick.utils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Updating existing volume attachment record: 0331d41e-8e17-4486-9376-9b9306a0e8e7 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG nova.compute.manager [req-dffd6e50-20ad-43d1-9260-0e0f4a1579c4 req-d0b596a0-6429-46e8-8d08-6f0ed9d823df service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Received event network-changed-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG nova.compute.manager [req-dffd6e50-20ad-43d1-9260-0e0f4a1579c4 req-d0b596a0-6429-46e8-8d08-6f0ed9d823df service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Refreshing instance network info cache due to event network-changed-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dffd6e50-20ad-43d1-9260-0e0f4a1579c4 req-d0b596a0-6429-46e8-8d08-6f0ed9d823df service nova] Acquiring lock "refresh_cache-fd314e21-b1a5-425d-a5e0-c1b3303b72d4" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dffd6e50-20ad-43d1-9260-0e0f4a1579c4 req-d0b596a0-6429-46e8-8d08-6f0ed9d823df service nova] Acquired lock "refresh_cache-fd314e21-b1a5-425d-a5e0-c1b3303b72d4" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG nova.network.neutron [req-dffd6e50-20ad-43d1-9260-0e0f4a1579c4 req-d0b596a0-6429-46e8-8d08-6f0ed9d823df service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Refreshing network info cache for port 51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:21:49 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Instance destroyed successfully.
Jul 24 16:21:49 user nova-compute[70243]: DEBUG nova.objects.instance [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lazy-loading 'resources' on Instance uuid 5e6a5fff-570c-4ee2-b883-415ec828ef97 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:18:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-625221097',display_name='tempest-TestVolumeSwap-server-625221097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-625221097',id=9,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJ/6GGyx1iFH1aLbXDBI/tVztmCtMhcxG8x49FhD2BMWE83p8XS//eIcium/yItjUwpLQcYx12Ou8E0mxGcZi0pr+B65YyGCnSbEjKNId0m93egXbiIrr/5Q+ei+x+lsg==',key_name='tempest-keypair-1521821379',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:18:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18cd7d48387343179ba49b66c119c405',ramdisk_id='',reservation_id='r-aqkuk644',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1908203650',owner_user_name='tempest-TestVolumeSwap-1908203650-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:18:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4e6f1d320714d0cafd63cbab32f11ea',uuid=5e6a5fff-570c-4ee2-b883-415ec828ef97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bfc720a-e7ed-4eb1-b945-6565c661adef", "address": "fa:16:3e:bb:31:a5", "network": {"id": "97e0a268-3307-41b7-a748-0a9f3dfc8629", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1229538256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18cd7d48387343179ba49b66c119c405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfc720a-e7", "ovs_interfaceid": "0bfc720a-e7ed-4eb1-b945-6565c661adef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Converting VIF {"id": "0bfc720a-e7ed-4eb1-b945-6565c661adef", "address": "fa:16:3e:bb:31:a5", "network": {"id": "97e0a268-3307-41b7-a748-0a9f3dfc8629", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1229538256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18cd7d48387343179ba49b66c119c405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bfc720a-e7", "ovs_interfaceid": "0bfc720a-e7ed-4eb1-b945-6565c661adef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:31:a5,bridge_name='br-int',has_traffic_filtering=True,id=0bfc720a-e7ed-4eb1-b945-6565c661adef,network=Network(97e0a268-3307-41b7-a748-0a9f3dfc8629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfc720a-e7') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG os_vif [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:31:a5,bridge_name='br-int',has_traffic_filtering=True,id=0bfc720a-e7ed-4eb1-b945-6565c661adef,network=Network(97e0a268-3307-41b7-a748-0a9f3dfc8629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfc720a-e7') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bfc720a-e7, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Successfully updated port: a2077cf2-6cf5-47e2-b50e-22625dd1c118 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:49 user nova-compute[70243]: INFO os_vif [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:31:a5,bridge_name='br-int',has_traffic_filtering=True,id=0bfc720a-e7ed-4eb1-b945-6565c661adef,network=Network(97e0a268-3307-41b7-a748-0a9f3dfc8629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bfc720a-e7')
Jul 24 16:21:49 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Deleting instance files /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97_del
Jul 24 16:21:49 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Deletion of /opt/stack/data/nova/instances/5e6a5fff-570c-4ee2-b883-415ec828ef97_del complete
Jul 24 16:21:49 user nova-compute[70243]: INFO nova.compute.manager [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 24 16:21:49 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG nova.network.neutron [req-dffd6e50-20ad-43d1-9260-0e0f4a1579c4 req-d0b596a0-6429-46e8-8d08-6f0ed9d823df service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Updated VIF entry in instance network info cache for port 51cc58b9-958f-41dd-bf1d-596ca7c6d5ce. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG nova.network.neutron [req-dffd6e50-20ad-43d1-9260-0e0f4a1579c4 req-d0b596a0-6429-46e8-8d08-6f0ed9d823df service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Updating instance_info_cache with network_info: [{"id": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "address": "fa:16:3e:92:b1:e8", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc58b9-95", "ovs_interfaceid": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:21:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dffd6e50-20ad-43d1-9260-0e0f4a1579c4 req-d0b596a0-6429-46e8-8d08-6f0ed9d823df service nova] Releasing lock "refresh_cache-fd314e21-b1a5-425d-a5e0-c1b3303b72d4" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG nova.compute.manager [req-932f1327-6890-4f44-aa68-d309ebd900a8 req-d6bd8cd1-162d-42cc-b9ad-524bccf00fdc service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-changed-c469bd25-6546-47e3-92f6-96674f256be6 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG nova.compute.manager [req-932f1327-6890-4f44-aa68-d309ebd900a8 req-d6bd8cd1-162d-42cc-b9ad-524bccf00fdc service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Refreshing instance network info cache due to event network-changed-c469bd25-6546-47e3-92f6-96674f256be6. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-932f1327-6890-4f44-aa68-d309ebd900a8 req-d6bd8cd1-162d-42cc-b9ad-524bccf00fdc service nova] Acquiring lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-932f1327-6890-4f44-aa68-d309ebd900a8 req-d6bd8cd1-162d-42cc-b9ad-524bccf00fdc service nova] Acquired lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG nova.network.neutron [req-932f1327-6890-4f44-aa68-d309ebd900a8 req-d6bd8cd1-162d-42cc-b9ad-524bccf00fdc service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Refreshing network info cache for port c469bd25-6546-47e3-92f6-96674f256be6 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG nova.network.neutron [req-932f1327-6890-4f44-aa68-d309ebd900a8 req-d6bd8cd1-162d-42cc-b9ad-524bccf00fdc service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG nova.network.neutron [req-932f1327-6890-4f44-aa68-d309ebd900a8 req-d6bd8cd1-162d-42cc-b9ad-524bccf00fdc service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-932f1327-6890-4f44-aa68-d309ebd900a8 req-d6bd8cd1-162d-42cc-b9ad-524bccf00fdc service nova] Releasing lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG nova.compute.manager [req-932f1327-6890-4f44-aa68-d309ebd900a8 req-d6bd8cd1-162d-42cc-b9ad-524bccf00fdc service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-changed-a2077cf2-6cf5-47e2-b50e-22625dd1c118 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG nova.compute.manager [req-932f1327-6890-4f44-aa68-d309ebd900a8 req-d6bd8cd1-162d-42cc-b9ad-524bccf00fdc service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Refreshing instance network info cache due to event network-changed-a2077cf2-6cf5-47e2-b50e-22625dd1c118. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-932f1327-6890-4f44-aa68-d309ebd900a8 req-d6bd8cd1-162d-42cc-b9ad-524bccf00fdc service nova] Acquiring lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-932f1327-6890-4f44-aa68-d309ebd900a8 req-d6bd8cd1-162d-42cc-b9ad-524bccf00fdc service nova] Acquired lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG nova.network.neutron [req-932f1327-6890-4f44-aa68-d309ebd900a8 req-d6bd8cd1-162d-42cc-b9ad-524bccf00fdc service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Refreshing network info cache for port a2077cf2-6cf5-47e2-b50e-22625dd1c118 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIXqhlWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:21:50 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:21:50 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:21:50 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4724696b-71ce-45b7-86bb-302012b49d1b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:21:50 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG nova.network.neutron [req-932f1327-6890-4f44-aa68-d309ebd900a8 req-d6bd8cd1-162d-42cc-b9ad-524bccf00fdc service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "5f70528b-33db-4257-96fe-e5fad869a224" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "5f70528b-33db-4257-96fe-e5fad869a224" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef372064-9413-4f58-85fd-a20d4ad11323]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b] added
Jul 24 16:21:50 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG nova.objects.instance [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lazy-loading 'flavor' on Instance uuid 5f70528b-33db-4257-96fe-e5fad869a224 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fe5654-ed94-4acd-95f7-51c8ac93a2ce]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa330122-0823-42dd-983a-870e4b9d0e8d]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vIXqhlWN {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "5f70528b-33db-4257-96fe-e5fad869a224" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vIXqhlWN" returned: 0 in 0.028s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d810c2-780b-42d7-a072-e130610ea6c6]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vIXqhlWN'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[81abc1be-af0f-481d-9d3a-2b744bc4a2be]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc12f34-d169-4acf-8b2e-a8859953f5a2]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:21:50 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:21:50 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:21:50 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:21:50 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af9f16f-5fd1-4b59-8815-603d272f6988]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b, portal: 172.16.0.220,3260]
Jul 24 16:21:50 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b, portal: 172.16.0.220,3260] successful.
Jul 24 16:21:50 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[310ff0b8-f030-45aa-b286-1f8d04086d0e]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d5394b-1692-4e35-a81d-ecdaf1ddef99]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:21:50 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:21:50 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:21:50 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:21:50 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:21:50 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:21:50 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "5f70528b-33db-4257-96fe-e5fad869a224" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "5f70528b-33db-4257-96fe-e5fad869a224" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:50 user nova-compute[70243]: INFO nova.compute.manager [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Attaching volume 5d0447c3-66c4-4105-9a6f-9187ae43f96b to /dev/vdb
Jul 24 16:21:50 user nova-compute[70243]: DEBUG nova.network.neutron [req-932f1327-6890-4f44-aa68-d309ebd900a8 req-d6bd8cd1-162d-42cc-b9ad-524bccf00fdc service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Successfully updated port: 44c70c07-ac30-4af3-b1a2-5f886d4ca1c1 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[825fa78e-f2d6-4650-ae83-6590a9a919b1]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIXqhlWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:21:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-932f1327-6890-4f44-aa68-d309ebd900a8 req-d6bd8cd1-162d-42cc-b9ad-524bccf00fdc service nova] Releasing lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG os_brick.utils [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f45ba31-e528-46af-a278-d9afaa2033a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[28648058-6ff3-4188-b4d6-6bf8145101f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5c3a01-f7bb-4cb2-a9a7-12f248da2ee4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d047bb13-274e-44e5-9e48-86fe1d82f839]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG nova.compute.manager [req-7727a0f7-22d2-4f32-b59e-078f447c37bf req-336462af-e6a3-43ab-a5fb-737131f9ebd0 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Received event network-vif-unplugged-0bfc720a-e7ed-4eb1-b945-6565c661adef {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7727a0f7-22d2-4f32-b59e-078f447c37bf req-336462af-e6a3-43ab-a5fb-737131f9ebd0 service nova] Acquiring lock "5e6a5fff-570c-4ee2-b883-415ec828ef97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7727a0f7-22d2-4f32-b59e-078f447c37bf req-336462af-e6a3-43ab-a5fb-737131f9ebd0 service nova] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7727a0f7-22d2-4f32-b59e-078f447c37bf req-336462af-e6a3-43ab-a5fb-737131f9ebd0 service nova] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG nova.compute.manager [req-7727a0f7-22d2-4f32-b59e-078f447c37bf req-336462af-e6a3-43ab-a5fb-737131f9ebd0 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] No waiting events found dispatching network-vif-unplugged-0bfc720a-e7ed-4eb1-b945-6565c661adef {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG nova.compute.manager [req-7727a0f7-22d2-4f32-b59e-078f447c37bf req-336462af-e6a3-43ab-a5fb-737131f9ebd0 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Received event network-vif-unplugged-0bfc720a-e7ed-4eb1-b945-6565c661adef for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG nova.compute.manager [req-7727a0f7-22d2-4f32-b59e-078f447c37bf req-336462af-e6a3-43ab-a5fb-737131f9ebd0 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Received event network-vif-plugged-0bfc720a-e7ed-4eb1-b945-6565c661adef {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7727a0f7-22d2-4f32-b59e-078f447c37bf req-336462af-e6a3-43ab-a5fb-737131f9ebd0 service nova] Acquiring lock "5e6a5fff-570c-4ee2-b883-415ec828ef97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7727a0f7-22d2-4f32-b59e-078f447c37bf req-336462af-e6a3-43ab-a5fb-737131f9ebd0 service nova] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7727a0f7-22d2-4f32-b59e-078f447c37bf req-336462af-e6a3-43ab-a5fb-737131f9ebd0 service nova] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG nova.compute.manager [req-7727a0f7-22d2-4f32-b59e-078f447c37bf req-336462af-e6a3-43ab-a5fb-737131f9ebd0 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] No waiting events found dispatching network-vif-plugged-0bfc720a-e7ed-4eb1-b945-6565c661adef {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:51 user nova-compute[70243]: WARNING nova.compute.manager [req-7727a0f7-22d2-4f32-b59e-078f447c37bf req-336462af-e6a3-43ab-a5fb-737131f9ebd0 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Received unexpected event network-vif-plugged-0bfc720a-e7ed-4eb1-b945-6565c661adef for instance with vm_state active and task_state deleting.
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:21:51 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c47b92-0ea3-4505-b19b-497294492e68]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG os_brick.utils [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Updating existing volume attachment record: 372e3c98-8322-4862-ba47-a6efc69d676e {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:21:51 user nova-compute[70243]: INFO nova.compute.manager [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Rebuilding instance
Jul 24 16:21:51 user nova-compute[70243]: DEBUG nova.objects.instance [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lazy-loading 'trusted_certs' on Instance uuid fd314e21-b1a5-425d-a5e0-c1b3303b72d4 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG nova.compute.manager [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:21:51 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Took 2.00 seconds to deallocate network for instance.
Jul 24 16:21:51 user nova-compute[70243]: DEBUG nova.compute.manager [req-fa72347b-b8de-41b2-90ee-f2252fe0b372 req-a6bf13b2-c673-42bc-b186-d27b2853e4f7 service nova] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Received event network-vif-deleted-0bfc720a-e7ed-4eb1-b945-6565c661adef {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG nova.objects.instance [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lazy-loading 'pci_requests' on Instance uuid fd314e21-b1a5-425d-a5e0-c1b3303b72d4 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG nova.objects.instance [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lazy-loading 'pci_devices' on Instance uuid fd314e21-b1a5-425d-a5e0-c1b3303b72d4 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG nova.objects.instance [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lazy-loading 'resources' on Instance uuid fd314e21-b1a5-425d-a5e0-c1b3303b72d4 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG nova.objects.instance [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lazy-loading 'migration_context' on Instance uuid fd314e21-b1a5-425d-a5e0-c1b3303b72d4 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG nova.objects.instance [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70243) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Successfully updated port: ee32acf5-1ead-4f29-b7a0-77a16d10778e {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '23765303132633366', 'path': '/dev/sdb'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765303132633366', 'path': '/dev/sdb'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG nova.objects.instance [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lazy-loading 'flavor' on Instance uuid de22ea98-b041-4f3f-8986-435c43267a2e {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:21:52 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:21:52 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:21:52 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:21:52 user nova-compute[70243]:   <serial>914f1c49-d025-4757-84d7-32fa800e552b</serial>
Jul 24 16:21:52 user nova-compute[70243]: </disk>
Jul 24 16:21:52 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:52 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Deleted allocations for instance 5e6a5fff-570c-4ee2-b883-415ec828ef97
Jul 24 16:21:52 user nova-compute[70243]: DEBUG nova.compute.manager [req-819ad5ce-1eb2-44d5-aa41-9cef85335cf2 req-4e9eb043-0b41-4342-bf5e-1bf453f74575 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-changed-44c70c07-ac30-4af3-b1a2-5f886d4ca1c1 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG nova.compute.manager [req-819ad5ce-1eb2-44d5-aa41-9cef85335cf2 req-4e9eb043-0b41-4342-bf5e-1bf453f74575 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Refreshing instance network info cache due to event network-changed-44c70c07-ac30-4af3-b1a2-5f886d4ca1c1. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-819ad5ce-1eb2-44d5-aa41-9cef85335cf2 req-4e9eb043-0b41-4342-bf5e-1bf453f74575 service nova] Acquiring lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-819ad5ce-1eb2-44d5-aa41-9cef85335cf2 req-4e9eb043-0b41-4342-bf5e-1bf453f74575 service nova] Acquired lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG nova.network.neutron [req-819ad5ce-1eb2-44d5-aa41-9cef85335cf2 req-4e9eb043-0b41-4342-bf5e-1bf453f74575 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Refreshing network info cache for port 44c70c07-ac30-4af3-b1a2-5f886d4ca1c1 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d16f116c-a4e4-485f-b923-596fe0434933 tempest-TestVolumeSwap-1908203650 tempest-TestVolumeSwap-1908203650-project-member] Lock "5e6a5fff-570c-4ee2-b883-415ec828ef97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.644s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] No VIF found with MAC fa:16:3e:0a:84:99, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG nova.network.neutron [req-819ad5ce-1eb2-44d5-aa41-9cef85335cf2 req-4e9eb043-0b41-4342-bf5e-1bf453f74575 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:21:52 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Instance destroyed successfully.
Jul 24 16:21:52 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Instance destroyed successfully.
Jul 24 16:21:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:19:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1975041839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1050817232',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJugPMjzC3sjisDM8EAfC1nB8cVCVLT9x+8UIOeaWrQRyN8J62vtUyTY9fsadBD/m66uRYjMwVz+mSleYDM8PIyy3oS1j2G/C6AKWNTLgTzZDawO9o6JDWYdg27VAeNPCw==',key_name='tempest-keypair-987230631',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:20:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ec24d98248104f5f898cf6f79207435b',ramdisk_id='',reservation_id='r-xz0z2ofe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1173962228',owner_user_name='tempest-ServerActionsV293TestJSON-1173962228-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:21:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93b6ed534c2c44d08a71f3050e212644',uuid=fd314e21-b1a5-425d-a5e0-c1b3303b72d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "address": "fa:16:3e:92:b1:e8", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc58b9-95", "ovs_interfaceid": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Converting VIF {"id": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "address": "fa:16:3e:92:b1:e8", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc58b9-95", "ovs_interfaceid": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:b1:e8,bridge_name='br-int',has_traffic_filtering=True,id=51cc58b9-958f-41dd-bf1d-596ca7c6d5ce,network=Network(3ed67d60-f22b-4d39-9563-c680c176858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cc58b9-95') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG os_vif [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:b1:e8,bridge_name='br-int',has_traffic_filtering=True,id=51cc58b9-958f-41dd-bf1d-596ca7c6d5ce,network=Network(3ed67d60-f22b-4d39-9563-c680c176858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cc58b9-95') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51cc58b9-95, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:52 user nova-compute[70243]: INFO os_vif [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:b1:e8,bridge_name='br-int',has_traffic_filtering=True,id=51cc58b9-958f-41dd-bf1d-596ca7c6d5ce,network=Network(3ed67d60-f22b-4d39-9563-c680c176858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cc58b9-95')
Jul 24 16:21:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'futGLMdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:21:52 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 16:21:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0f898a-5e8e-4144-b4a8-2820dea29e20]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:21:52 user nova-compute[70243]: No targets found.
Jul 24 16:21:52 user nova-compute[70243]: iSNS:
Jul 24 16:21:52 user nova-compute[70243]: No targets found.
Jul 24 16:21:52 user nova-compute[70243]: STATIC:
Jul 24 16:21:52 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b
Jul 24 16:21:52 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:52 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:52 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73
Jul 24 16:21:52 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:52 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:52 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c
Jul 24 16:21:52 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:52 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:52 user nova-compute[70243]: FIRMWARE:
Jul 24 16:21:52 user nova-compute[70243]: No targets found.
Jul 24 16:21:52 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:21:52 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:21:52 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5544fd8c-e49c-4381-b160-39ef43d3da74]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa345288-41c5-4bc2-8010-49124baa65e9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:21:52 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:21:52 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:21:52 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:21:52 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:21:52 user nova-compute[70243]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:21:52 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc7b6680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73'): ({'sdf'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Removing single pathed devices sdf {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAkhOXje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:21:52 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:21:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26af736-9ec7-46e5-995c-74c2ec7bf20c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.048s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b9f001-811d-4ef2-844c-e22374c2ee2b]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Flushing IO for device /dev/sdf {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG nova.network.neutron [req-819ad5ce-1eb2-44d5-aa41-9cef85335cf2 req-4e9eb043-0b41-4342-bf5e-1bf453f74575 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-819ad5ce-1eb2-44d5-aa41-9cef85335cf2 req-4e9eb043-0b41-4342-bf5e-1bf453f74575 service nova] Releasing lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG nova.compute.manager [req-819ad5ce-1eb2-44d5-aa41-9cef85335cf2 req-4e9eb043-0b41-4342-bf5e-1bf453f74575 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-changed-ee32acf5-1ead-4f29-b7a0-77a16d10778e {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG nova.compute.manager [req-819ad5ce-1eb2-44d5-aa41-9cef85335cf2 req-4e9eb043-0b41-4342-bf5e-1bf453f74575 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Refreshing instance network info cache due to event network-changed-ee32acf5-1ead-4f29-b7a0-77a16d10778e. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-819ad5ce-1eb2-44d5-aa41-9cef85335cf2 req-4e9eb043-0b41-4342-bf5e-1bf453f74575 service nova] Acquiring lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-819ad5ce-1eb2-44d5-aa41-9cef85335cf2 req-4e9eb043-0b41-4342-bf5e-1bf453f74575 service nova] Acquired lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG nova.network.neutron [req-819ad5ce-1eb2-44d5-aa41-9cef85335cf2 req-4e9eb043-0b41-4342-bf5e-1bf453f74575 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Refreshing network info cache for port ee32acf5-1ead-4f29-b7a0-77a16d10778e {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[271542ec-3be2-44e4-b432-ab81bab6564f]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:21:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.068s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf24055c-1bf1-4e9a-a12c-e0e0a187c1dc]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] SCSI volumes sdf have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[527ab798-d8da-424b-a1d9-ff809c4b85c1]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG nova.network.neutron [req-819ad5ce-1eb2-44d5-aa41-9cef85335cf2 req-4e9eb043-0b41-4342-bf5e-1bf453f74575 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a940ff4f-5b5a-40cb-bd5b-d8731cdd613c]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73, portal: 172.16.0.220,3260]
Jul 24 16:21:53 user nova-compute[70243]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73, portal: 172.16.0.220,3260] successful.
Jul 24 16:21:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e51025-7286-4252-ac57-44e15fcb3e6e]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] <== disconnect_volume: return (412ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:21:53 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Deleting instance files /opt/stack/data/nova/instances/fd314e21-b1a5-425d-a5e0-c1b3303b72d4_del
Jul 24 16:21:53 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Deletion of /opt/stack/data/nova/instances/fd314e21-b1a5-425d-a5e0-c1b3303b72d4_del complete
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.299s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:21:53 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:21:53 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8ccded55-cdc8-4c3b-972d-84e0fd8e7b25 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "de22ea98-b041-4f3f-8986-435c43267a2e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.636s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edc8a5e-23d3-4f72-872f-196fc7a8c645]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:21:53 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cb7b9a-2dab-4002-8d2a-9328fa85b1bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b] added
Jul 24 16:21:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69a5baa-fd2c-4cd1-b1f2-527c878fc89c]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd20fbd9-0385-4d06-9210-d3aa68df3563]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BAkhOXje {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG nova.network.neutron [req-819ad5ce-1eb2-44d5-aa41-9cef85335cf2 req-4e9eb043-0b41-4342-bf5e-1bf453f74575 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-819ad5ce-1eb2-44d5-aa41-9cef85335cf2 req-4e9eb043-0b41-4342-bf5e-1bf453f74575 service nova] Releasing lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BAkhOXje" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[03571605-ac16-480c-8c1c-9e562399205d]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BAkhOXje'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b92323d-8b55-4736-9cf6-68bd2f4250b6]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfe242d-9492-4090-a2fb-b53df2f9be91]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:21:53 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:21:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:21:53 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:21:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:53 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance fd314e21-b1a5-425d-a5e0-c1b3303b72d4 could not be found.
Jul 24 16:21:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'futGLMdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:21:53 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4ca034-0791-4ec9-b9d6-5cb9404b030b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b, portal: 172.16.0.220,3260]
Jul 24 16:21:53 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b, portal: 172.16.0.220,3260] successful.
Jul 24 16:21:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9474172-253e-444c-9b43-6730453a80cf]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb37cfb2-2ec7-442d-a9e4-3253a75789af]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:21:53 user nova-compute[70243]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:21:53 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:21:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:21:53 user nova-compute[70243]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:21:53 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:21:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Successfully updated port: e71b975d-1eaa-46f2-b6a7-01771b71b484 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Acquiring lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Acquired lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[93633123-4dc1-45a6-ae8d-f8a0db136168]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAkhOXje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:21:53 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG nova.compute.manager [req-a7df87f6-633c-4a5e-95d1-d63be1090c76 req-0348bd48-d6ad-4f60-953b-82d85a75e364 service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Received event network-vif-unplugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a7df87f6-633c-4a5e-95d1-d63be1090c76 req-0348bd48-d6ad-4f60-953b-82d85a75e364 service nova] Acquiring lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a7df87f6-633c-4a5e-95d1-d63be1090c76 req-0348bd48-d6ad-4f60-953b-82d85a75e364 service nova] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a7df87f6-633c-4a5e-95d1-d63be1090c76 req-0348bd48-d6ad-4f60-953b-82d85a75e364 service nova] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG nova.compute.manager [req-a7df87f6-633c-4a5e-95d1-d63be1090c76 req-0348bd48-d6ad-4f60-953b-82d85a75e364 service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] No waiting events found dispatching network-vif-unplugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:54 user nova-compute[70243]: WARNING nova.compute.manager [req-a7df87f6-633c-4a5e-95d1-d63be1090c76 req-0348bd48-d6ad-4f60-953b-82d85a75e364 service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Received unexpected event network-vif-unplugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce for instance with vm_state active and task_state rebuilding.
Jul 24 16:21:54 user nova-compute[70243]: DEBUG nova.compute.manager [req-a7df87f6-633c-4a5e-95d1-d63be1090c76 req-0348bd48-d6ad-4f60-953b-82d85a75e364 service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Received event network-vif-plugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a7df87f6-633c-4a5e-95d1-d63be1090c76 req-0348bd48-d6ad-4f60-953b-82d85a75e364 service nova] Acquiring lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a7df87f6-633c-4a5e-95d1-d63be1090c76 req-0348bd48-d6ad-4f60-953b-82d85a75e364 service nova] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a7df87f6-633c-4a5e-95d1-d63be1090c76 req-0348bd48-d6ad-4f60-953b-82d85a75e364 service nova] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG nova.compute.manager [req-a7df87f6-633c-4a5e-95d1-d63be1090c76 req-0348bd48-d6ad-4f60-953b-82d85a75e364 service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] No waiting events found dispatching network-vif-plugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:54 user nova-compute[70243]: WARNING nova.compute.manager [req-a7df87f6-633c-4a5e-95d1-d63be1090c76 req-0348bd48-d6ad-4f60-953b-82d85a75e364 service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Received unexpected event network-vif-plugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce for instance with vm_state active and task_state rebuilding.
Jul 24 16:21:54 user nova-compute[70243]: DEBUG nova.compute.manager [req-a7df87f6-633c-4a5e-95d1-d63be1090c76 req-0348bd48-d6ad-4f60-953b-82d85a75e364 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-changed-e71b975d-1eaa-46f2-b6a7-01771b71b484 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG nova.compute.manager [req-a7df87f6-633c-4a5e-95d1-d63be1090c76 req-0348bd48-d6ad-4f60-953b-82d85a75e364 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Refreshing instance network info cache due to event network-changed-e71b975d-1eaa-46f2-b6a7-01771b71b484. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a7df87f6-633c-4a5e-95d1-d63be1090c76 req-0348bd48-d6ad-4f60-953b-82d85a75e364 service nova] Acquiring lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] <== connect_volume: return (1656ms) {'type': 'block', 'scsi_wwn': '23739663534663035', 'path': '/dev/sdc'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739663534663035', 'path': '/dev/sdc'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.100s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG nova.objects.instance [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lazy-loading 'flavor' on Instance uuid a13c243a-2b98-4ef1-b17c-e2e15ba005fd {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:21:54 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:21:54 user nova-compute[70243]:   <source dev="/dev/sdc"/>
Jul 24 16:21:54 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:21:54 user nova-compute[70243]:   <serial>fa6f7d2d-caff-4248-b9c7-4d785414616b</serial>
Jul 24 16:21:54 user nova-compute[70243]: </disk>
Jul 24 16:21:54 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9442286-69ee-474f-8c16-5688935f7805]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:21:54 user nova-compute[70243]: No targets found.
Jul 24 16:21:54 user nova-compute[70243]: iSNS:
Jul 24 16:21:54 user nova-compute[70243]: No targets found.
Jul 24 16:21:54 user nova-compute[70243]: STATIC:
Jul 24 16:21:54 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b
Jul 24 16:21:54 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:54 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:54 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b
Jul 24 16:21:54 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:54 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:54 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c
Jul 24 16:21:54 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:54 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:54 user nova-compute[70243]: FIRMWARE:
Jul 24 16:21:54 user nova-compute[70243]: No targets found.
Jul 24 16:21:54 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:21:54 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:21:54 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[652f313d-b73f-49de-b3d3-5b978149616b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf10a5e7-2761-4115-b6fb-c7dfa2481d6a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:21:54 user nova-compute[70243]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:21:54 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:21:54 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:21:54 user nova-compute[70243]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:21:54 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:21:54 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc10acb0>, {}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Disconnecting from: [] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.106s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] <== disconnect_volume: return (1206ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:21:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:21:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:21:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:21:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] No VIF found with MAC fa:16:3e:92:8d:42, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:21:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Preparing to wait for external event volume-reimaged-75d2beea-53f6-4026-a9fa-a819238dbf73 {{(pid=70243) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Jul 24 16:21:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6be4b175-24d0-4077-8ba1-aa1af6f35c8a tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.855s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:55 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Updating instance_info_cache with network_info: [{"id": "dabb3818-16d0-4d10-9912-15dd72754963", "address": "fa:16:3e:d6:1b:31", "network": {"id": "f0c2213f-980e-4179-b927-2472447e6418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253590851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdabb3818-16", "ovs_interfaceid": "dabb3818-16d0-4d10-9912-15dd72754963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "address": "fa:16:3e:ac:a6:57", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d99894-04", "ovs_interfaceid": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c469bd25-6546-47e3-92f6-96674f256be6", "address": "fa:16:3e:e4:76:c9", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc469bd25-65", "ovs_interfaceid": "c469bd25-6546-47e3-92f6-96674f256be6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "address": "fa:16:3e:35:0c:a4", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2077cf2-6c", "ovs_interfaceid": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "address": "fa:16:3e:6f:63:28", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c70c07-ac", "ovs_interfaceid": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "address": "fa:16:3e:2d:f2:1f", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee32acf5-1e", "ovs_interfaceid": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "address": "fa:16:3e:ed:cc:00", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71b975d-1e", "ovs_interfaceid": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:21:55 user nova-compute[70243]: INFO nova.compute.manager [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Rebuilding instance
Jul 24 16:21:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Releasing lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:21:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Instance network_info: |[{"id": "dabb3818-16d0-4d10-9912-15dd72754963", "address": "fa:16:3e:d6:1b:31", "network": {"id": "f0c2213f-980e-4179-b927-2472447e6418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253590851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdabb3818-16", "ovs_interfaceid": "dabb3818-16d0-4d10-9912-15dd72754963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "address": "fa:16:3e:ac:a6:57", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d99894-04", "ovs_interfaceid": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c469bd25-6546-47e3-92f6-96674f256be6", "address": "fa:16:3e:e4:76:c9", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc469bd25-65", "ovs_interfaceid": "c469bd25-6546-47e3-92f6-96674f256be6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "address": "fa:16:3e:35:0c:a4", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2077cf2-6c", "ovs_interfaceid": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "address": "fa:16:3e:6f:63:28", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c70c07-ac", "ovs_interfaceid": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "address": "fa:16:3e:2d:f2:1f", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee32acf5-1e", "ovs_interfaceid": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "address": "fa:16:3e:ed:cc:00", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71b975d-1e", "ovs_interfaceid": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:21:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a7df87f6-633c-4a5e-95d1-d63be1090c76 req-0348bd48-d6ad-4f60-953b-82d85a75e364 service nova] Acquired lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:21:55 user nova-compute[70243]: DEBUG nova.network.neutron [req-a7df87f6-633c-4a5e-95d1-d63be1090c76 req-0348bd48-d6ad-4f60-953b-82d85a75e364 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Refreshing network info cache for port e71b975d-1eaa-46f2-b6a7-01771b71b484 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:21:55 user nova-compute[70243]: DEBUG nova.objects.instance [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lazy-loading 'trusted_certs' on Instance uuid de22ea98-b041-4f3f-8986-435c43267a2e {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:21:56 user nova-compute[70243]: DEBUG nova.objects.instance [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lazy-loading 'pci_requests' on Instance uuid de22ea98-b041-4f3f-8986-435c43267a2e {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:56 user nova-compute[70243]: DEBUG nova.objects.instance [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lazy-loading 'pci_devices' on Instance uuid de22ea98-b041-4f3f-8986-435c43267a2e {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:56 user nova-compute[70243]: DEBUG nova.objects.instance [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lazy-loading 'resources' on Instance uuid de22ea98-b041-4f3f-8986-435c43267a2e {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:56 user nova-compute[70243]: DEBUG nova.objects.instance [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lazy-loading 'migration_context' on Instance uuid de22ea98-b041-4f3f-8986-435c43267a2e {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:56 user nova-compute[70243]: DEBUG nova.objects.instance [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70243) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 24 16:21:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:56 user nova-compute[70243]: DEBUG nova.compute.manager [req-a7867204-2809-4101-a9bf-6e532fed12c3 req-1d9482c6-da05-4c3a-bd43-cd86b1bf0f89 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Received event network-vif-unplugged-e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a7867204-2809-4101-a9bf-6e532fed12c3 req-1d9482c6-da05-4c3a-bd43-cd86b1bf0f89 service nova] Acquiring lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a7867204-2809-4101-a9bf-6e532fed12c3 req-1d9482c6-da05-4c3a-bd43-cd86b1bf0f89 service nova] Lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a7867204-2809-4101-a9bf-6e532fed12c3 req-1d9482c6-da05-4c3a-bd43-cd86b1bf0f89 service nova] Lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:56 user nova-compute[70243]: DEBUG nova.compute.manager [req-a7867204-2809-4101-a9bf-6e532fed12c3 req-1d9482c6-da05-4c3a-bd43-cd86b1bf0f89 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] No waiting events found dispatching network-vif-unplugged-e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:56 user nova-compute[70243]: WARNING nova.compute.manager [req-a7867204-2809-4101-a9bf-6e532fed12c3 req-1d9482c6-da05-4c3a-bd43-cd86b1bf0f89 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Received unexpected event network-vif-unplugged-e709e269-eff5-4ac2-8c2a-29048448a422 for instance with vm_state active and task_state rebuilding.
Jul 24 16:21:56 user nova-compute[70243]: DEBUG nova.network.neutron [req-a7df87f6-633c-4a5e-95d1-d63be1090c76 req-0348bd48-d6ad-4f60-953b-82d85a75e364 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Updated VIF entry in instance network info cache for port e71b975d-1eaa-46f2-b6a7-01771b71b484. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:21:56 user nova-compute[70243]: DEBUG nova.network.neutron [req-a7df87f6-633c-4a5e-95d1-d63be1090c76 req-0348bd48-d6ad-4f60-953b-82d85a75e364 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Updating instance_info_cache with network_info: [{"id": "dabb3818-16d0-4d10-9912-15dd72754963", "address": "fa:16:3e:d6:1b:31", "network": {"id": "f0c2213f-980e-4179-b927-2472447e6418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253590851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdabb3818-16", "ovs_interfaceid": "dabb3818-16d0-4d10-9912-15dd72754963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "address": "fa:16:3e:ac:a6:57", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d99894-04", "ovs_interfaceid": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c469bd25-6546-47e3-92f6-96674f256be6", "address": "fa:16:3e:e4:76:c9", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc469bd25-65", "ovs_interfaceid": "c469bd25-6546-47e3-92f6-96674f256be6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "address": "fa:16:3e:35:0c:a4", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2077cf2-6c", "ovs_interfaceid": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "address": "fa:16:3e:6f:63:28", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c70c07-ac", "ovs_interfaceid": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "address": "fa:16:3e:2d:f2:1f", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee32acf5-1e", "ovs_interfaceid": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "address": "fa:16:3e:ed:cc:00", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71b975d-1e", "ovs_interfaceid": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a7df87f6-633c-4a5e-95d1-d63be1090c76 req-0348bd48-d6ad-4f60-953b-82d85a75e364 service nova] Releasing lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:21:57 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Instance destroyed successfully.
Jul 24 16:21:57 user nova-compute[70243]: INFO nova.compute.manager [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Detaching volume 914f1c49-d025-4757-84d7-32fa800e552b
Jul 24 16:21:57 user nova-compute[70243]: INFO nova.compute.manager [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Rescuing
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquiring lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquired lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG nova.network.neutron [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:21:57 user nova-compute[70243]: INFO nova.virt.block_device [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Attempting to driver detach volume 914f1c49-d025-4757-84d7-32fa800e552b from mountpoint /dev/vdb
Jul 24 16:21:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Attempting to detach device vdb from instance de22ea98-b041-4f3f-8986-435c43267a2e from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:21:57 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:21:57 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:21:57 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:21:57 user nova-compute[70243]:   <serial>914f1c49-d025-4757-84d7-32fa800e552b</serial>
Jul 24 16:21:57 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:21:57 user nova-compute[70243]: </disk>
Jul 24 16:21:57 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:21:57 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Successfully detached device vdb from instance de22ea98-b041-4f3f-8986-435c43267a2e from the persistent domain config.
Jul 24 16:21:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIXqhlWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:21:57 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 16:21:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3e4157-1627-421c-8c3f-1753b957d8be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:21:57 user nova-compute[70243]: No targets found.
Jul 24 16:21:57 user nova-compute[70243]: iSNS:
Jul 24 16:21:57 user nova-compute[70243]: No targets found.
Jul 24 16:21:57 user nova-compute[70243]: STATIC:
Jul 24 16:21:57 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b
Jul 24 16:21:57 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:57 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:57 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b
Jul 24 16:21:57 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:57 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:57 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c
Jul 24 16:21:57 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:57 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:57 user nova-compute[70243]: FIRMWARE:
Jul 24 16:21:57 user nova-compute[70243]: No targets found.
Jul 24 16:21:57 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:21:57 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:21:57 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba05e0eb-0b95-4fac-a5ce-8ddf6c1fa6f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa766fbd-a839-43fa-af4c-9118f2aba2a9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:21:57 user nova-compute[70243]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:21:57 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:21:57 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:21:57 user nova-compute[70243]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:21:57 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:21:57 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc135870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b'): ({'sdb'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Removing single pathed devices sdb {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[604bb59e-8423-485c-b444-de76c5a779ba]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e37b12b-92a7-45af-ad12-cb5723724cd8]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Flushing IO for device /dev/sdb {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[120bfc00-9e4a-420a-94c2-2bcebfc9578f]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9ef859-cf1a-4b33-8edf-367271c6ac7b]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bed6ef4-dc48-41d9-9aaf-6daf746c4d55]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[479dccc0-dc44-4e98-b911-1c03724f3ce3]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b, portal: 172.16.0.220,3260]
Jul 24 16:21:57 user nova-compute[70243]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b, portal: 172.16.0.220,3260] successful.
Jul 24 16:21:57 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5dceee-f154-4638-aa08-35b7238244c0]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] <== disconnect_volume: return (327ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG nova.network.neutron [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Updating instance_info_cache with network_info: [{"id": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "address": "fa:16:3e:92:8d:42", "network": {"id": "69c0285e-5c28-41c5-893d-9d92e9626cb2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808448879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c70a6d9bf46466da48267f2fc2e02d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2943f763-29", "ovs_interfaceid": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:21:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Releasing lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-8665dafc-5692-4f0a-b9c2-968cfc712982 req-271b85fd-066d-41eb-89c7-b7855b92a0b3 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received event network-vif-unplugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8665dafc-5692-4f0a-b9c2-968cfc712982 req-271b85fd-066d-41eb-89c7-b7855b92a0b3 service nova] Acquiring lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8665dafc-5692-4f0a-b9c2-968cfc712982 req-271b85fd-066d-41eb-89c7-b7855b92a0b3 service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8665dafc-5692-4f0a-b9c2-968cfc712982 req-271b85fd-066d-41eb-89c7-b7855b92a0b3 service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-8665dafc-5692-4f0a-b9c2-968cfc712982 req-271b85fd-066d-41eb-89c7-b7855b92a0b3 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] No waiting events found dispatching network-vif-unplugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:58 user nova-compute[70243]: WARNING nova.compute.manager [req-8665dafc-5692-4f0a-b9c2-968cfc712982 req-271b85fd-066d-41eb-89c7-b7855b92a0b3 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received unexpected event network-vif-unplugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 for instance with vm_state active and task_state rescuing.
Jul 24 16:21:58 user nova-compute[70243]: DEBUG nova.objects.instance [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'flavor' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "refresh_cache-ad611655-ba4d-4a66-b78e-a82c058f4414" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquired lock "refresh_cache-ad611655-ba4d-4a66-b78e-a82c058f4414" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG nova.network.neutron [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG nova.objects.instance [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'info_cache' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:58 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Instance destroyed successfully.
Jul 24 16:21:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-318401571',display_name='tempest-ServerActionsTestOtherA-server-2125239384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-318401571',id=2,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNt4ywOtyDbY3gzVxioiadq0RHvp3ujVzU7+egeM9QHVtvP6DGqg4hSRwxq8r4OyAFnfBqKPWEeStDLSLwfjx+5dISRxZesWLAiccd5P+5WMBwka91+aa63O7dxU+RVwA==',key_name='tempest-keypair-283031417',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:18:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ebdb3cb079814db091227f80b2ed1b9d',ramdisk_id='',reservation_id='r-fjhaudds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-39125821',owner_user_name='tempest-ServerActionsTestOtherA-39125821-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:21:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa3936255d31421184e585e2fd17d7ef',uuid=de22ea98-b041-4f3f-8986-435c43267a2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e709e269-eff5-4ac2-8c2a-29048448a422", "address": "fa:16:3e:0a:84:99", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape709e269-ef", "ovs_interfaceid": "e709e269-eff5-4ac2-8c2a-29048448a422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converting VIF {"id": "e709e269-eff5-4ac2-8c2a-29048448a422", "address": "fa:16:3e:0a:84:99", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape709e269-ef", "ovs_interfaceid": "e709e269-eff5-4ac2-8c2a-29048448a422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:84:99,bridge_name='br-int',has_traffic_filtering=True,id=e709e269-eff5-4ac2-8c2a-29048448a422,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape709e269-ef') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG os_vif [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:84:99,bridge_name='br-int',has_traffic_filtering=True,id=e709e269-eff5-4ac2-8c2a-29048448a422,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape709e269-ef') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape709e269-ef, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:21:58 user nova-compute[70243]: INFO os_vif [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:84:99,bridge_name='br-int',has_traffic_filtering=True,id=e709e269-eff5-4ac2-8c2a-29048448a422,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape709e269-ef')
Jul 24 16:21:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIXqhlWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:21:58 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 16:21:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:58 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Instance destroyed successfully.
Jul 24 16:21:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-2833d3cd-d2c3-4413-a8d8-ac4fb59db40f req-5782ef3c-5f90-4794-b426-78674c4dca34 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Received event network-vif-plugged-e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2833d3cd-d2c3-4413-a8d8-ac4fb59db40f req-5782ef3c-5f90-4794-b426-78674c4dca34 service nova] Acquiring lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2833d3cd-d2c3-4413-a8d8-ac4fb59db40f req-5782ef3c-5f90-4794-b426-78674c4dca34 service nova] Lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2833d3cd-d2c3-4413-a8d8-ac4fb59db40f req-5782ef3c-5f90-4794-b426-78674c4dca34 service nova] Lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-2833d3cd-d2c3-4413-a8d8-ac4fb59db40f req-5782ef3c-5f90-4794-b426-78674c4dca34 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] No waiting events found dispatching network-vif-plugged-e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:21:58 user nova-compute[70243]: WARNING nova.compute.manager [req-2833d3cd-d2c3-4413-a8d8-ac4fb59db40f req-5782ef3c-5f90-4794-b426-78674c4dca34 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Received unexpected event network-vif-plugged-e709e269-eff5-4ac2-8c2a-29048448a422 for instance with vm_state active and task_state rebuilding.
Jul 24 16:21:58 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Attempting a stable device rescue
Jul 24 16:21:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c278f5-dc0b-4128-9b35-b4e91ce0006d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:21:58 user nova-compute[70243]: No targets found.
Jul 24 16:21:58 user nova-compute[70243]: iSNS:
Jul 24 16:21:58 user nova-compute[70243]: No targets found.
Jul 24 16:21:58 user nova-compute[70243]: STATIC:
Jul 24 16:21:58 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b
Jul 24 16:21:58 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:58 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:58 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c
Jul 24 16:21:58 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:21:58 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:21:58 user nova-compute[70243]: FIRMWARE:
Jul 24 16:21:58 user nova-compute[70243]: No targets found.
Jul 24 16:21:58 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:21:58 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:21:58 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=70243) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe362666-f38c-48f4-b86b-b9cb135de80c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Instance directory exists: not creating {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 16:21:58 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Creating image(s)
Jul 24 16:21:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquiring lock "/opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "/opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "/opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG nova.objects.instance [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lazy-loading 'trusted_certs' on Instance uuid a13c243a-2b98-4ef1-b17c-e2e15ba005fd {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquiring lock "5d7ee6cf9ab4380359ba0dce28f68ec467404d38" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "5d7ee6cf9ab4380359ba0dce28f68ec467404d38" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb47f808-aa3f-46bc-917f-086487cb929f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:21:58 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:21:58 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:21:58 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:21:58 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc10b250>, {}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Disconnecting from: [] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.106s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] <== disconnect_volume: return (107ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:21:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:21:58 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Deleting instance files /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e_del
Jul 24 16:21:58 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Deletion of /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e_del complete
Jul 24 16:21:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d7ee6cf9ab4380359ba0dce28f68ec467404d38.part --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:21:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:00 user nova-compute[70243]: INFO nova.virt.block_device [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Booting with volume 914f1c49-d025-4757-84d7-32fa800e552b at /dev/vdb
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d7ee6cf9ab4380359ba0dce28f68ec467404d38.part --force-share --output=json" returned: 0 in 0.155s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG nova.virt.images [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] 3ed7ea29-e2b2-459f-acbf-11a24c8cb116 was qcow2, converting to raw {{(pid=70243) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG nova.privsep.utils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70243) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d7ee6cf9ab4380359ba0dce28f68ec467404d38.part /opt/stack/data/nova/instances/_base/5d7ee6cf9ab4380359ba0dce28f68ec467404d38.converted {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG os_brick.utils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c422fb-b69d-44f1-84e8-8b41e5617ae3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e6d531-dbc2-496b-8f65-60ec4a115d5e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[82463ce0-d98c-406c-b2a9-2ae954082d00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88a0fcd-e533-44c1-9dcb-b2f9c4b6a395]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:22:00 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea375cc4-0df6-458a-add8-6c3d7232dd5f]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG os_brick.utils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Updating existing volume attachment record: 32b958cc-3fa9-454c-9088-86fd54bec6f3 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d7ee6cf9ab4380359ba0dce28f68ec467404d38.part /opt/stack/data/nova/instances/_base/5d7ee6cf9ab4380359ba0dce28f68ec467404d38.converted" returned: 0 in 0.482s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d7ee6cf9ab4380359ba0dce28f68ec467404d38.converted --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Updating instance_info_cache with network_info: [{"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG nova.compute.manager [req-eb83c891-ef44-4d2c-b5c4-75b1b523a2e6 req-f68c4ea3-29dc-435d-88c7-68058fcbab15 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received event network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-eb83c891-ef44-4d2c-b5c4-75b1b523a2e6 req-f68c4ea3-29dc-435d-88c7-68058fcbab15 service nova] Acquiring lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-eb83c891-ef44-4d2c-b5c4-75b1b523a2e6 req-f68c4ea3-29dc-435d-88c7-68058fcbab15 service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-eb83c891-ef44-4d2c-b5c4-75b1b523a2e6 req-f68c4ea3-29dc-435d-88c7-68058fcbab15 service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG nova.compute.manager [req-eb83c891-ef44-4d2c-b5c4-75b1b523a2e6 req-f68c4ea3-29dc-435d-88c7-68058fcbab15 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] No waiting events found dispatching network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:00 user nova-compute[70243]: WARNING nova.compute.manager [req-eb83c891-ef44-4d2c-b5c4-75b1b523a2e6 req-f68c4ea3-29dc-435d-88c7-68058fcbab15 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received unexpected event network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 for instance with vm_state active and task_state rescuing.
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Releasing lock "refresh_cache-ad611655-ba4d-4a66-b78e-a82c058f4414" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:22:00 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Instance destroyed successfully.
Jul 24 16:22:00 user nova-compute[70243]: DEBUG nova.objects.instance [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'resources' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1592531500',display_name='tempest-AttachVolumeTestJSON-server-1592531500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1592531500',id=5,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyqJB6onbLaD2r1QfVtdarKDSnujLrUpKPczrv1sRKzUEbnqnXysxM1e2pVM0BKjCFI6X1To86Tx81MPL8yxdaUKlyWRVQ/8A7Y/aJ/EGuRxG0ZYo3tQwvjAcenmDrEEg==',key_name='tempest-keypair-810229109',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:18:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d099632b940545b9bbe000e5cc323ec1',ramdisk_id='',reservation_id='r-6lakmpdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1836925262',owner_user_name='tempest-AttachVolumeTestJSON-1836925262-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:20:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7de0cd9dd23d4569939884728bde772c',uuid=ad611655-ba4d-4a66-b78e-a82c058f4414,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converting VIF {"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d8:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef8e7d11-464b-421b-bfc9-0d5a17f610d4,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8e7d11-46') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG os_vif [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d8:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef8e7d11-464b-421b-bfc9-0d5a17f610d4,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8e7d11-46') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef8e7d11-46, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:00 user nova-compute[70243]: INFO os_vif [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d8:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef8e7d11-464b-421b-bfc9-0d5a17f610d4,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8e7d11-46')
Jul 24 16:22:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'raMPwoih', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:22:00 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:22:00 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d7ee6cf9ab4380359ba0dce28f68ec467404d38.converted --force-share --output=json" returned: 0 in 0.195s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "5d7ee6cf9ab4380359ba0dce28f68ec467404d38" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.893s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquiring lock "5d7ee6cf9ab4380359ba0dce28f68ec467404d38" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "5d7ee6cf9ab4380359ba0dce28f68ec467404d38" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d7ee6cf9ab4380359ba0dce28f68ec467404d38 --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca703ab7-1cbc-4f3a-b19b-1a0ffd1f23fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:22:00 user nova-compute[70243]: No targets found.
Jul 24 16:22:00 user nova-compute[70243]: iSNS:
Jul 24 16:22:00 user nova-compute[70243]: No targets found.
Jul 24 16:22:00 user nova-compute[70243]: STATIC:
Jul 24 16:22:00 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b
Jul 24 16:22:00 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:22:00 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:22:00 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c
Jul 24 16:22:00 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:22:00 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:22:00 user nova-compute[70243]: FIRMWARE:
Jul 24 16:22:00 user nova-compute[70243]: No targets found.
Jul 24 16:22:00 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:22:00 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:22:00 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d6daa6-1d4d-474e-91ed-26c3f04ffb13]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[63562256-f5eb-4ba3-bc71-789434ae8ce1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:00 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:00 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:00 user nova-compute[70243]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:00 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc1351b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c'): ({'sde'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Removing single pathed devices sde {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c5c02f-ee74-4e4b-89db-4ef803de1650]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d7ee6cf9ab4380359ba0dce28f68ec467404d38 --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d7ee6cf9ab4380359ba0dce28f68ec467404d38,backing_fmt=raw /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk.rescue {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f3c561-88bc-44bc-8472-721597e693ee]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Flushing IO for device /dev/sde {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d7ee6cf9ab4380359ba0dce28f68ec467404d38,backing_fmt=raw /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk.rescue" returned: 0 in 0.061s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "5d7ee6cf9ab4380359ba0dce28f68ec467404d38" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG nova.objects.instance [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lazy-loading 'migration_context' on Instance uuid a13c243a-2b98-4ef1-b17c-e2e15ba005fd {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77796ea-c9a3-45f3-9cfc-63825208be05]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Start _get_guest_xml network_info=[{"id": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "address": "fa:16:3e:92:8d:42", "network": {"id": "69c0285e-5c28-41c5-893d-9d92e9626cb2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808448879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-808448879-network", "vif_mac": "fa:16:3e:92:8d:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c70a6d9bf46466da48267f2fc2e02d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2943f763-29", "ovs_interfaceid": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3ed7ea29-e2b2-459f-acbf-11a24c8cb116', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAkhOXje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'a13c243a-2b98-4ef1-b17c-e2e15ba005fd', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa6f7d2d-caff-4248-b9c7-4d785414616b', 'serial': 'fa6f7d2d-caff-4248-b9c7-4d785414616b'}, 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '7ff29e64-ed0d-468e-b572-065fa2f380e0', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:22:00 user nova-compute[70243]: DEBUG nova.objects.instance [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lazy-loading 'resources' on Instance uuid a13c243a-2b98-4ef1-b17c-e2e15ba005fd {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.objects.instance [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lazy-loading 'numa_topology' on Instance uuid a13c243a-2b98-4ef1-b17c-e2e15ba005fd {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[40165c8f-6d4a-4352-9df0-76c036c8d69a]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] SCSI volumes sde have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:22:01 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.objects.instance [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lazy-loading 'vcpu_model' on Instance uuid a13c243a-2b98-4ef1-b17c-e2e15ba005fd {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac19e3b5-7dd9-424c-8a7c-15bf9119d87d]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAkhOXje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:22:01 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2bc4b2-15f9-468e-b131-31b1b7d781b1]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c, portal: 172.16.0.220,3260]
Jul 24 16:22:01 user nova-compute[70243]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c, portal: 172.16.0.220,3260] successful.
Jul 24 16:22:01 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ed520c-57a1-46f9-8e04-fc02caae5668]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] <== disconnect_volume: return (421ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.053s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:22:01 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:22:01 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Start _get_guest_xml network_info=[{"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'raMPwoih', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'ad611655-ba4d-4a66-b78e-a82c058f4414', 'attached_at': '', 'detached_at': '', 'volume_id': 'd2139cf8-69f4-4150-a7c5-221311a1ac1c', 'serial': 'd2139cf8-69f4-4150-a7c5-221311a1ac1c'}, 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '3982e3ca-8bf1-41b8-9064-00db6e116651', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.objects.instance [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'numa_topology' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[682e3c4d-1501-4a3e-96e7-4cf8ab6b09d4]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = BAkhOXje\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 24 16:22:01 user nova-compute[70243]: node.name = iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b
Jul 24 16:22:01 user nova-compute[70243]: node.tpgt = -1
Jul 24 16:22:01 user nova-compute[70243]: node.startup = automatic
Jul 24 16:22:01 user nova-compute[70243]: node.leading_login = No
Jul 24 16:22:01 user nova-compute[70243]: iface.iscsi_ifacename = default
Jul 24 16:22:01 user nova-compute[70243]: iface.net_ifacename = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.ipaddress = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.prefix_len = 0
Jul 24 16:22:01 user nova-compute[70243]: iface.hwaddress = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.transport_name = tcp
Jul 24 16:22:01 user nova-compute[70243]: iface.initiatorname = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.state = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.vlan_id = 0
Jul 24 16:22:01 user nova-compute[70243]: iface.vlan_priority = 0
Jul 24 16:22:01 user nova-compute[70243]: iface.vlan_state = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.iface_num = 0
Jul 24 16:22:01 user nova-compute[70243]: iface.mtu = 0
Jul 24 16:22:01 user nova-compute[70243]: iface.port = 0
Jul 24 16:22:01 user nova-compute[70243]: iface.bootproto = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.subnet_mask = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.gateway = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.dhcp_alt_client_id_state = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.dhcp_alt_client_id = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.dhcp_dns = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.dhcp_learn_iqn = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.dhcp_req_vendor_id_state = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.dhcp_vendor_id_state = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.dhcp_vendor_id = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.dhcp_slp_da = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.fragmentation = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.gratuitous_arp = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.incoming_forwarding = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.tos_state = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.tos = 0
Jul 24 16:22:01 user nova-compute[70243]: iface.ttl = 0
Jul 24 16:22:01 user nova-compute[70243]: iface.delayed_ack = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.tcp_nagle = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.tcp_wsf_state = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.tcp_wsf = 0
Jul 24 16:22:01 user nova-compute[70243]: iface.tcp_timer_scale = 0
Jul 24 16:22:01 user nova-compute[70243]: iface.tcp_timestamp = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.redirect = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.def_task_mgmt_timeout = 0
Jul 24 16:22:01 user nova-compute[70243]: iface.header_digest = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.data_digest = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.immediate_data = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.initial_r2t = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.data_seq_inorder = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.data_pdu_inorder = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.erl = 0
Jul 24 16:22:01 user nova-compute[70243]: iface.max_receive_data_len = 0
Jul 24 16:22:01 user nova-compute[70243]: iface.first_burst_len = 0
Jul 24 16:22:01 user nova-compute[70243]: iface.max_outstanding_r2t = 0
Jul 24 16:22:01 user nova-compute[70243]: iface.max_burst_len = 0
Jul 24 16:22:01 user nova-compute[70243]: iface.chap_auth = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.bidi_chap = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.strict_login_compliance = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.discovery_auth = <empty>
Jul 24 16:22:01 user nova-compute[70243]: iface.discovery_logout = <empty>
Jul 24 16:22:01 user nova-compute[70243]: node.discovery_address = <empty>
Jul 24 16:22:01 user nova-compute[70243]: node.discovery_port = 0
Jul 24 16:22:01 user nova-compute[70243]: node.discovery_type = static
Jul 24 16:22:01 user nova-compute[70243]: node.session.initial_cmdsn = 0
Jul 24 16:22:01 user nova-compute[70243]: node.session.initial_login_retry_max = 8
Jul 24 16:22:01 user nova-compute[70243]: node.session.xmit_thread_priority = -20
Jul 24 16:22:01 user nova-compute[70243]: node.session.cmds_max = 128
Jul 24 16:22:01 user nova-compute[70243]: node.session.queue_depth = 32
Jul 24 16:22:01 user nova-compute[70243]: node.session.nr_sessions = 1
Jul 24 16:22:01 user nova-compute[70243]: node.session.auth.authmethod = CHAP
Jul 24 16:22:01 user nova-compute[70243]: node.session.auth.username = BAkhOXje
Jul 24 16:22:01 user nova-compute[70243]: node.session.auth.password = ***
Jul 24 16:22:01 user nova-compute[70243]: node.session.auth.username_in = <empty>
Jul 24 16:22:01 user nova-compute[70243]: node.session.auth.password_in = <empty>
Jul 24 16:22:01 user nova-compute[70243]: node.session.auth.chap_algs = MD5
Jul 24 16:22:01 user nova-compute[70243]: node.session.timeo.replacement_timeout = 120
Jul 24 16:22:01 user nova-compute[70243]: node.session.err_timeo.abort_timeout = 15
Jul 24 16:22:01 user nova-compute[70243]: node.session.err_timeo.lu_reset_timeout = 30
Jul 24 16:22:01 user nova-compute[70243]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 24 16:22:01 user nova-compute[70243]: node.session.err_timeo.host_reset_timeout = 60
Jul 24 16:22:01 user nova-compute[70243]: node.session.iscsi.FastAbort = Yes
Jul 24 16:22:01 user nova-compute[70243]: node.session.iscsi.InitialR2T = No
Jul 24 16:22:01 user nova-compute[70243]: node.session.iscsi.ImmediateData = Yes
Jul 24 16:22:01 user nova-compute[70243]: node.session.iscsi.FirstBurstLength = 262144
Jul 24 16:22:01 user nova-compute[70243]: node.session.iscsi.MaxBurstLength = 16776192
Jul 24 16:22:01 user nova-compute[70243]: node.session.iscsi.DefaultTime2Retain = 0
Jul 24 16:22:01 user nova-compute[70243]: node.session.iscsi.DefaultTime2Wait = 2
Jul 24 16:22:01 user nova-compute[70243]: node.session.iscsi.MaxConnections = 1
Jul 24 16:22:01 user nova-compute[70243]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 24 16:22:01 user nova-compute[70243]: node.session.iscsi.ERL = 0
Jul 24 16:22:01 user nova-compute[70243]: node.session.scan = manual
Jul 24 16:22:01 user nova-compute[70243]: node.session.reopen_max = 0
Jul 24 16:22:01 user nova-compute[70243]: node.conn[0].address = 172.16.0.220
Jul 24 16:22:01 user nova-compute[70243]: node.conn[0].port = 3260
Jul 24 16:22:01 user nova-compute[70243]: node.conn[0].startup = manual
Jul 24 16:22:01 user nova-compute[70243]: node.conn[0].tcp.window_size = 524288
Jul 24 16:22:01 user nova-compute[70243]: node.conn[0].tcp.type_of_service = 0
Jul 24 16:22:01 user nova-compute[70243]: node.conn[0].timeo.logout_timeout = 15
Jul 24 16:22:01 user nova-compute[70243]: node.conn[0].timeo.login_timeout = 15
Jul 24 16:22:01 user nova-compute[70243]: node.conn[0].timeo.auth_timeout = 45
Jul 24 16:22:01 user nova-compute[70243]: node.conn[0].timeo.noop_out_interval = 5
Jul 24 16:22:01 user nova-compute[70243]: node.conn[0].timeo.noop_out_timeout = 5
Jul 24 16:22:01 user nova-compute[70243]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 24 16:22:01 user nova-compute[70243]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 24 16:22:01 user nova-compute[70243]: node.conn[0].iscsi.HeaderDigest = None
Jul 24 16:22:01 user nova-compute[70243]: node.conn[0].iscsi.DataDigest = None
Jul 24 16:22:01 user nova-compute[70243]: node.conn[0].iscsi.IFMarker = No
Jul 24 16:22:01 user nova-compute[70243]: node.conn[0].iscsi.OFMarker = No
Jul 24 16:22:01 user nova-compute[70243]: # END RECORD
Jul 24 16:22:01 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:22:01 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.objects.instance [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'vcpu_model' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e659a50-3bd2-433f-a6eb-f0a5bce47ae4]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'raMPwoih', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:22:01 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c5e041-3f3e-4230-9ace-f27c9ae59388]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BAkhOXje {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BAkhOXje" returned: 0 in 0.031s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b15d18-199b-40c0-92ae-c59918b81fcb]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BAkhOXje'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[974f0a4e-f06a-444c-863d-25dca0dace8b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ba1110-c5c5-45c9-b61b-37a0b40555b9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:01 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:01 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.211s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] HCTL ('34', '0', '0', 0) found on session 14 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[08146e58-5b4f-41cd-bb14-5f571d12d57f]: (4, ('0 0 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Searching for a device in session 14 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAkhOXje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.239s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] <== connect_volume: return (292ms) {'type': 'block', 'scsi_wwn': '23739663534663035', 'path': '/dev/sdc'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739663534663035', 'path': '/dev/sdc'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.121s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:22:01 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:22:01 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79d430f-14f9-4b9a-88fb-cd90f28bcd00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:22:01 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2052048387',display_name='tempest-ServerStableDeviceRescueTest-server-2052048387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2052048387',id=4,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxyg7GKQZgiFcqgBrRCAKYhBgpz6QF7p7ruGhqH37zaYL25ozkQKcEfngpDlxwde/ZCtd+vcFLzRscQnyUxcajhFeR/MGJHm2Mv330WuzoMeAS6WZFsRGOHNqib8c36Bw==',key_name='tempest-keypair-258761738',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:18:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c70a6d9bf46466da48267f2fc2e02d6',ramdisk_id='',reservation_id='r-yozkpi2d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1068915189',owner_user_name='tempest-ServerStableDeviceRescueTest-1068915189-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:19:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afda4138db34a6c95e974a5814ea26a',uuid=a13c243a-2b98-4ef1-b17c-e2e15ba005fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "address": "fa:16:3e:92:8d:42", "network": {"id": "69c0285e-5c28-41c5-893d-9d92e9626cb2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808448879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-808448879-network", "vif_mac": "fa:16:3e:92:8d:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c70a6d9bf46466da48267f2fc2e02d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2943f763-29", "ovs_interfaceid": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Converting VIF {"id": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "address": "fa:16:3e:92:8d:42", "network": {"id": "69c0285e-5c28-41c5-893d-9d92e9626cb2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808448879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-808448879-network", "vif_mac": "fa:16:3e:92:8d:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c70a6d9bf46466da48267f2fc2e02d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2943f763-29", "ovs_interfaceid": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:8d:42,bridge_name='br-int',has_traffic_filtering=True,id=2943f763-290c-46a8-90cf-f0e6b59a2be4,network=Network(69c0285e-5c28-41c5-893d-9d92e9626cb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2943f763-29') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.objects.instance [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lazy-loading 'pci_devices' on Instance uuid a13c243a-2b98-4ef1-b17c-e2e15ba005fd {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f35a67a-b504-430c-bb21-d911449ac4e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c] added
Jul 24 16:22:01 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:22:01 user nova-compute[70243]:   <uuid>a13c243a-2b98-4ef1-b17c-e2e15ba005fd</uuid>
Jul 24 16:22:01 user nova-compute[70243]:   <name>instance-00000004</name>
Jul 24 16:22:01 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:22:01 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:22:01 user nova-compute[70243]:   <metadata>
Jul 24 16:22:01 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:22:01 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:22:01 user nova-compute[70243]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2052048387</nova:name>
Jul 24 16:22:01 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:22:01</nova:creationTime>
Jul 24 16:22:01 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:22:01 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:22:01 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:22:01 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:22:01 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:22:01 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:22:01 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:22:01 user nova-compute[70243]:       <nova:owner>
Jul 24 16:22:01 user nova-compute[70243]:         <nova:user uuid="5afda4138db34a6c95e974a5814ea26a">tempest-ServerStableDeviceRescueTest-1068915189-project-member</nova:user>
Jul 24 16:22:01 user nova-compute[70243]:         <nova:project uuid="5c70a6d9bf46466da48267f2fc2e02d6">tempest-ServerStableDeviceRescueTest-1068915189</nova:project>
Jul 24 16:22:01 user nova-compute[70243]:       </nova:owner>
Jul 24 16:22:01 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:22:01 user nova-compute[70243]:       <nova:ports>
Jul 24 16:22:01 user nova-compute[70243]:         <nova:port uuid="2943f763-290c-46a8-90cf-f0e6b59a2be4">
Jul 24 16:22:01 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 24 16:22:01 user nova-compute[70243]:         </nova:port>
Jul 24 16:22:01 user nova-compute[70243]:       </nova:ports>
Jul 24 16:22:01 user nova-compute[70243]:     </nova:instance>
Jul 24 16:22:01 user nova-compute[70243]:   </metadata>
Jul 24 16:22:01 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:22:01 user nova-compute[70243]:     <system>
Jul 24 16:22:01 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:22:01 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:22:01 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:22:01 user nova-compute[70243]:       <entry name="serial">a13c243a-2b98-4ef1-b17c-e2e15ba005fd</entry>
Jul 24 16:22:01 user nova-compute[70243]:       <entry name="uuid">a13c243a-2b98-4ef1-b17c-e2e15ba005fd</entry>
Jul 24 16:22:01 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:22:01 user nova-compute[70243]:     </system>
Jul 24 16:22:01 user nova-compute[70243]:   </sysinfo>
Jul 24 16:22:01 user nova-compute[70243]:   <os>
Jul 24 16:22:01 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:22:01 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:22:01 user nova-compute[70243]:   </os>
Jul 24 16:22:01 user nova-compute[70243]:   <features>
Jul 24 16:22:01 user nova-compute[70243]:     <acpi/>
Jul 24 16:22:01 user nova-compute[70243]:     <apic/>
Jul 24 16:22:01 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:22:01 user nova-compute[70243]:   </features>
Jul 24 16:22:01 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:22:01 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:22:01 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:22:01 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:22:01 user nova-compute[70243]:   </clock>
Jul 24 16:22:01 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:22:01 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:22:01 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:22:01 user nova-compute[70243]:   </cpu>
Jul 24 16:22:01 user nova-compute[70243]:   <devices>
Jul 24 16:22:01 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:22:01 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:22:01 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk"/>
Jul 24 16:22:01 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:22:01 user nova-compute[70243]:     </disk>
Jul 24 16:22:01 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:22:01 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:22:01 user nova-compute[70243]:       <source dev="/dev/sdc"/>
Jul 24 16:22:01 user nova-compute[70243]:       <target dev="vdb" bus="virtio"/>
Jul 24 16:22:01 user nova-compute[70243]:       <serial>fa6f7d2d-caff-4248-b9c7-4d785414616b</serial>
Jul 24 16:22:01 user nova-compute[70243]:     </disk>
Jul 24 16:22:01 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:22:01 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:22:01 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk.rescue"/>
Jul 24 16:22:01 user nova-compute[70243]:       <target dev="vdc" bus="virtio"/>
Jul 24 16:22:01 user nova-compute[70243]:       <boot order="1"/>
Jul 24 16:22:01 user nova-compute[70243]:     </disk>
Jul 24 16:22:01 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:22:01 user nova-compute[70243]:       <mac address="fa:16:3e:92:8d:42"/>
Jul 24 16:22:01 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:22:01 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:22:01 user nova-compute[70243]:       <target dev="tap2943f763-29"/>
Jul 24 16:22:01 user nova-compute[70243]:     </interface>
Jul 24 16:22:01 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:22:01 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/console.log" append="off"/>
Jul 24 16:22:01 user nova-compute[70243]:     </serial>
Jul 24 16:22:01 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:22:01 user nova-compute[70243]:     <video>
Jul 24 16:22:01 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:22:01 user nova-compute[70243]:     </video>
Jul 24 16:22:01 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:22:01 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:22:01 user nova-compute[70243]:     </rng>
Jul 24 16:22:01 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:22:01 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:22:01 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:22:01 user nova-compute[70243]:     </memballoon>
Jul 24 16:22:01 user nova-compute[70243]:   </devices>
Jul 24 16:22:01 user nova-compute[70243]: </domain>
Jul 24 16:22:01 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:22:01 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Instance destroyed successfully.
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5484714-0b79-4742-a6c0-cc15101576b6]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf22777-980f-4740-b12a-e0d66cb0e831]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v raMPwoih {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v raMPwoih" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[632c73d6-1763-402a-b68f-6a5be5af7553]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'raMPwoih'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] No VIF found with MAC fa:16:3e:92:8d:42, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b5992f-c6ff-4fb0-98eb-4c6c9c6ba9ea]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[75781897-da7b-4177-833e-0eb3940be08f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:01 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:01 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0003a5cc-d182-41f6-8c19-f48709e124f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c, portal: 172.16.0.220,3260]
Jul 24 16:22:01 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c, portal: 172.16.0.220,3260] successful.
Jul 24 16:22:01 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05dcec3-1f46-4358-8404-842d64797101]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: INFO nova.virt.block_device [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Booting with volume d496c16a-c676-4702-a76c-cd73626058c5 at /dev/vdc
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a65f100-cace-4387-bc02-9c23508b52a7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:01 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:01 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:01 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:01 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35f9e73-a22d-4c1d-be31-18f2d2cb2c93]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'raMPwoih', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.utils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d261bec5-d02b-4a02-8f69-794ba0e2a49c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcc37b5-4345-4c89-a7ea-34d97d6df707]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c003bbf4-597c-48cd-86aa-5626c8c44579]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[58423137-3d83-4882-8c71-3df2b2f8a14b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:22:01 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:22:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3496b2-e52c-42cc-be3f-55d484ed187d]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG os_brick.utils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:22:01 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Updating existing volume attachment record: 846af343-0338-432d-8af0-e94d9afa2854 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:22:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:22:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] <== connect_volume: return (1498ms) {'type': 'block', 'scsi_wwn': '26532636234623563', 'path': '/dev/sdb'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:22:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532636234623563', 'path': '/dev/sdb'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:22:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1592531500',display_name='tempest-AttachVolumeTestJSON-server-1592531500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1592531500',id=5,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyqJB6onbLaD2r1QfVtdarKDSnujLrUpKPczrv1sRKzUEbnqnXysxM1e2pVM0BKjCFI6X1To86Tx81MPL8yxdaUKlyWRVQ/8A7Y/aJ/EGuRxG0ZYo3tQwvjAcenmDrEEg==',key_name='tempest-keypair-810229109',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:18:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d099632b940545b9bbe000e5cc323ec1',ramdisk_id='',reservation_id='r-6lakmpdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1836925262',owner_user_name='tempest-AttachVolumeTestJSON-1836925262-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:20:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7de0cd9dd23d4569939884728bde772c',uuid=ad611655-ba4d-4a66-b78e-a82c058f4414,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:22:02 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converting VIF {"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:02 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d8:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef8e7d11-464b-421b-bfc9-0d5a17f610d4,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8e7d11-46') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:02 user nova-compute[70243]: DEBUG nova.objects.instance [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'pci_devices' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:22:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:22:02 user nova-compute[70243]:   <uuid>ad611655-ba4d-4a66-b78e-a82c058f4414</uuid>
Jul 24 16:22:02 user nova-compute[70243]:   <name>instance-00000005</name>
Jul 24 16:22:02 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:22:02 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:22:02 user nova-compute[70243]:   <metadata>
Jul 24 16:22:02 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:22:02 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:22:02 user nova-compute[70243]:       <nova:name>tempest-AttachVolumeTestJSON-server-1592531500</nova:name>
Jul 24 16:22:02 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:22:01</nova:creationTime>
Jul 24 16:22:02 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:22:02 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:22:02 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:22:02 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:22:02 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:22:02 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:22:02 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:22:02 user nova-compute[70243]:       <nova:owner>
Jul 24 16:22:02 user nova-compute[70243]:         <nova:user uuid="7de0cd9dd23d4569939884728bde772c">tempest-AttachVolumeTestJSON-1836925262-project-member</nova:user>
Jul 24 16:22:02 user nova-compute[70243]:         <nova:project uuid="d099632b940545b9bbe000e5cc323ec1">tempest-AttachVolumeTestJSON-1836925262</nova:project>
Jul 24 16:22:02 user nova-compute[70243]:       </nova:owner>
Jul 24 16:22:02 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:22:02 user nova-compute[70243]:       <nova:ports>
Jul 24 16:22:02 user nova-compute[70243]:         <nova:port uuid="ef8e7d11-464b-421b-bfc9-0d5a17f610d4">
Jul 24 16:22:02 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 24 16:22:02 user nova-compute[70243]:         </nova:port>
Jul 24 16:22:02 user nova-compute[70243]:       </nova:ports>
Jul 24 16:22:02 user nova-compute[70243]:     </nova:instance>
Jul 24 16:22:02 user nova-compute[70243]:   </metadata>
Jul 24 16:22:02 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:22:02 user nova-compute[70243]:     <system>
Jul 24 16:22:02 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:22:02 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:22:02 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:22:02 user nova-compute[70243]:       <entry name="serial">ad611655-ba4d-4a66-b78e-a82c058f4414</entry>
Jul 24 16:22:02 user nova-compute[70243]:       <entry name="uuid">ad611655-ba4d-4a66-b78e-a82c058f4414</entry>
Jul 24 16:22:02 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:22:02 user nova-compute[70243]:     </system>
Jul 24 16:22:02 user nova-compute[70243]:   </sysinfo>
Jul 24 16:22:02 user nova-compute[70243]:   <os>
Jul 24 16:22:02 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:22:02 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:22:02 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:22:02 user nova-compute[70243]:   </os>
Jul 24 16:22:02 user nova-compute[70243]:   <features>
Jul 24 16:22:02 user nova-compute[70243]:     <acpi/>
Jul 24 16:22:02 user nova-compute[70243]:     <apic/>
Jul 24 16:22:02 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:22:02 user nova-compute[70243]:   </features>
Jul 24 16:22:02 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:22:02 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:22:02 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:22:02 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:22:02 user nova-compute[70243]:   </clock>
Jul 24 16:22:02 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:22:02 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:22:02 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:22:02 user nova-compute[70243]:   </cpu>
Jul 24 16:22:02 user nova-compute[70243]:   <devices>
Jul 24 16:22:02 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:22:02 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:22:02 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk"/>
Jul 24 16:22:02 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:22:02 user nova-compute[70243]:     </disk>
Jul 24 16:22:02 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:22:02 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:22:02 user nova-compute[70243]:       <source dev="/dev/sdb"/>
Jul 24 16:22:02 user nova-compute[70243]:       <target dev="vdb" bus="virtio"/>
Jul 24 16:22:02 user nova-compute[70243]:       <serial>d2139cf8-69f4-4150-a7c5-221311a1ac1c</serial>
Jul 24 16:22:02 user nova-compute[70243]:     </disk>
Jul 24 16:22:02 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:22:02 user nova-compute[70243]:       <mac address="fa:16:3e:0e:d8:8a"/>
Jul 24 16:22:02 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:22:02 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:22:02 user nova-compute[70243]:       <target dev="tapef8e7d11-46"/>
Jul 24 16:22:02 user nova-compute[70243]:     </interface>
Jul 24 16:22:02 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:22:02 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/console.log" append="off"/>
Jul 24 16:22:02 user nova-compute[70243]:     </serial>
Jul 24 16:22:02 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:22:02 user nova-compute[70243]:     <video>
Jul 24 16:22:02 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:22:02 user nova-compute[70243]:     </video>
Jul 24 16:22:02 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:22:02 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:22:02 user nova-compute[70243]:     </rng>
Jul 24 16:22:02 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:22:02 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:22:02 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:22:02 user nova-compute[70243]:     </memballoon>
Jul 24 16:22:02 user nova-compute[70243]:   </devices>
Jul 24 16:22:02 user nova-compute[70243]: </domain>
Jul 24 16:22:02 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:22:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG nova.objects.instance [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'trusted_certs' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG nova.compute.manager [req-dcf5b5c5-ca7c-46ef-a905-011f9cece4a0 req-68da224e-de34-4ad2-b05f-4d3a53d3a452 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received event network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dcf5b5c5-ca7c-46ef-a905-011f9cece4a0 req-68da224e-de34-4ad2-b05f-4d3a53d3a452 service nova] Acquiring lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dcf5b5c5-ca7c-46ef-a905-011f9cece4a0 req-68da224e-de34-4ad2-b05f-4d3a53d3a452 service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dcf5b5c5-ca7c-46ef-a905-011f9cece4a0 req-68da224e-de34-4ad2-b05f-4d3a53d3a452 service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG nova.compute.manager [req-dcf5b5c5-ca7c-46ef-a905-011f9cece4a0 req-68da224e-de34-4ad2-b05f-4d3a53d3a452 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] No waiting events found dispatching network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:03 user nova-compute[70243]: WARNING nova.compute.manager [req-dcf5b5c5-ca7c-46ef-a905-011f9cece4a0 req-68da224e-de34-4ad2-b05f-4d3a53d3a452 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received unexpected event network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 for instance with vm_state active and task_state rescuing.
Jul 24 16:22:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.193s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Cannot resize image /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG nova.objects.instance [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'migration_context' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1592531500',display_name='tempest-AttachVolumeTestJSON-server-1592531500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1592531500',id=5,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyqJB6onbLaD2r1QfVtdarKDSnujLrUpKPczrv1sRKzUEbnqnXysxM1e2pVM0BKjCFI6X1To86Tx81MPL8yxdaUKlyWRVQ/8A7Y/aJ/EGuRxG0ZYo3tQwvjAcenmDrEEg==',key_name='tempest-keypair-810229109',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:18:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d099632b940545b9bbe000e5cc323ec1',ramdisk_id='',reservation_id='r-6lakmpdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1836925262',owner_user_name='tempest-AttachVolumeTestJSON-1836925262-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:20:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7de0cd9dd23d4569939884728bde772c',uuid=ad611655-ba4d-4a66-b78e-a82c058f4414,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converting VIF {"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d8:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef8e7d11-464b-421b-bfc9-0d5a17f610d4,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8e7d11-46') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG os_vif [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d8:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef8e7d11-464b-421b-bfc9-0d5a17f610d4,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8e7d11-46') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef8e7d11-46, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef8e7d11-46, col_values=(('external_ids', {'iface-id': 'ef8e7d11-464b-421b-bfc9-0d5a17f610d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:d8:8a', 'vm-uuid': 'ad611655-ba4d-4a66-b78e-a82c058f4414'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:03 user nova-compute[70243]: INFO os_vif [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d8:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef8e7d11-464b-421b-bfc9-0d5a17f610d4,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8e7d11-46')
Jul 24 16:22:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:04 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690215709.5924888, 5e6a5fff-570c-4ee2-b883-415ec828ef97 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:22:04 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] VM Stopped (Lifecycle Event)
Jul 24 16:22:04 user nova-compute[70243]: DEBUG nova.compute.manager [None req-35274116-f70a-44bc-b2bd-39005193c862 None None] [instance: 5e6a5fff-570c-4ee2-b883-415ec828ef97] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:22:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-c0bd4f74-3eee-4f83-b225-8fd2b916adf8 req-6a202e43-3c3b-421b-9d91-fabec9467f67 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received event network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c0bd4f74-3eee-4f83-b225-8fd2b916adf8 req-6a202e43-3c3b-421b-9d91-fabec9467f67 service nova] Acquiring lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c0bd4f74-3eee-4f83-b225-8fd2b916adf8 req-6a202e43-3c3b-421b-9d91-fabec9467f67 service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c0bd4f74-3eee-4f83-b225-8fd2b916adf8 req-6a202e43-3c3b-421b-9d91-fabec9467f67 service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-c0bd4f74-3eee-4f83-b225-8fd2b916adf8 req-6a202e43-3c3b-421b-9d91-fabec9467f67 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] No waiting events found dispatching network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:05 user nova-compute[70243]: WARNING nova.compute.manager [req-c0bd4f74-3eee-4f83-b225-8fd2b916adf8 req-6a202e43-3c3b-421b-9d91-fabec9467f67 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received unexpected event network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 for instance with vm_state active and task_state rescuing.
Jul 24 16:22:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-c0bd4f74-3eee-4f83-b225-8fd2b916adf8 req-6a202e43-3c3b-421b-9d91-fabec9467f67 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received event network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c0bd4f74-3eee-4f83-b225-8fd2b916adf8 req-6a202e43-3c3b-421b-9d91-fabec9467f67 service nova] Acquiring lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c0bd4f74-3eee-4f83-b225-8fd2b916adf8 req-6a202e43-3c3b-421b-9d91-fabec9467f67 service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c0bd4f74-3eee-4f83-b225-8fd2b916adf8 req-6a202e43-3c3b-421b-9d91-fabec9467f67 service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-c0bd4f74-3eee-4f83-b225-8fd2b916adf8 req-6a202e43-3c3b-421b-9d91-fabec9467f67 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] No waiting events found dispatching network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:05 user nova-compute[70243]: WARNING nova.compute.manager [req-c0bd4f74-3eee-4f83-b225-8fd2b916adf8 req-6a202e43-3c3b-421b-9d91-fabec9467f67 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received unexpected event network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 for instance with vm_state stopped and task_state powering-on.
Jul 24 16:22:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Removed pending event for a13c243a-2b98-4ef1-b17c-e2e15ba005fd due to event {{(pid=70243) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 16:22:05 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215725.7022905, a13c243a-2b98-4ef1-b17c-e2e15ba005fd => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:22:05 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] VM Resumed (Lifecycle Event)
Jul 24 16:22:05 user nova-compute[70243]: DEBUG nova.compute.manager [None req-fb949f5e-292b-49a2-b863-6aef0a0460ec tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:22:05 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:22:05 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:22:05 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 24 16:22:05 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215725.7075205, a13c243a-2b98-4ef1-b17c-e2e15ba005fd => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:22:05 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] VM Started (Lifecycle Event)
Jul 24 16:22:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:05 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:22:05 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:22:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OARbsQWM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:22:06 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:22:06 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:22:06 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e32847-f820-41ed-b595-ee94573d30b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:22:06 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[055a35bf-0bbc-48e6-b8ed-745e773eea4e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b] added
Jul 24 16:22:06 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[96411aff-92d3-4010-a7dd-0a2ae200ada4]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f747e688-77f3-4e4b-8645-edff0aeee1d6]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OARbsQWM {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OARbsQWM" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4852989-e529-479f-912c-2a67f44ed683]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OARbsQWM'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[801cdbce-81cb-4a38-8f90-ee1a5611f95d]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a9b8e7-c339-4040-bf2a-c15ec9bb9ca7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:06 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:06 user nova-compute[70243]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:22:06 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:06 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:06 user nova-compute[70243]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:22:06 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8ae16a-21c1-44e8-b4db-ee11f94c11d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260]
Jul 24 16:22:06 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260] successful.
Jul 24 16:22:06 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a4c959-0754-4b91-ad0f-624c619f961a]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b1575a-a6d2-4d51-bb81-abb2e1953115]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:06 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:06 user nova-compute[70243]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:22:06 user nova-compute[70243]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:22:06 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:06 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:06 user nova-compute[70243]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:22:06 user nova-compute[70243]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:22:06 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c157cb8-2a9c-47b9-904a-a361a49190e1]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:22:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OARbsQWM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:22:07 user nova-compute[70243]: DEBUG nova.compute.manager [req-86ead27c-5feb-4547-9262-30f0e9cf291a req-725276e1-c795-44a8-b7c6-3a04e48997ee service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received event network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-86ead27c-5feb-4547-9262-30f0e9cf291a req-725276e1-c795-44a8-b7c6-3a04e48997ee service nova] Acquiring lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-86ead27c-5feb-4547-9262-30f0e9cf291a req-725276e1-c795-44a8-b7c6-3a04e48997ee service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-86ead27c-5feb-4547-9262-30f0e9cf291a req-725276e1-c795-44a8-b7c6-3a04e48997ee service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:07 user nova-compute[70243]: DEBUG nova.compute.manager [req-86ead27c-5feb-4547-9262-30f0e9cf291a req-725276e1-c795-44a8-b7c6-3a04e48997ee service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] No waiting events found dispatching network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:07 user nova-compute[70243]: WARNING nova.compute.manager [req-86ead27c-5feb-4547-9262-30f0e9cf291a req-725276e1-c795-44a8-b7c6-3a04e48997ee service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received unexpected event network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 for instance with vm_state stopped and task_state powering-on.
Jul 24 16:22:07 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215727.5774605, ad611655-ba4d-4a66-b78e-a82c058f4414 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:22:07 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] VM Resumed (Lifecycle Event)
Jul 24 16:22:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:22:07 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Instance rebooted successfully.
Jul 24 16:22:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-baefc602-7c54-4119-aea3-0c0470a3dbee tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:22:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:22:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:22:07 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 24 16:22:07 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215727.5786955, ad611655-ba4d-4a66-b78e-a82c058f4414 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:22:07 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] VM Started (Lifecycle Event)
Jul 24 16:22:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:22:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:22:07 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690215712.695665, fd314e21-b1a5-425d-a5e0-c1b3303b72d4 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:22:07 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] VM Stopped (Lifecycle Event)
Jul 24 16:22:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-28586559-0b26-4acd-9d3e-0e7e3fe8c0a4 None None] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:22:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:22:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '23736366534623431', 'path': '/dev/sde'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:22:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736366534623431', 'path': '/dev/sde'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:22:07 user nova-compute[70243]: DEBUG nova.objects.instance [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lazy-loading 'flavor' on Instance uuid 5f70528b-33db-4257-96fe-e5fad869a224 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:22:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:22:07 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:22:07 user nova-compute[70243]:   <source dev="/dev/sde"/>
Jul 24 16:22:07 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:22:07 user nova-compute[70243]:   <serial>5d0447c3-66c4-4105-9a6f-9187ae43f96b</serial>
Jul 24 16:22:07 user nova-compute[70243]: </disk>
Jul 24 16:22:07 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:22:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:22:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:22:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] No VIF found with MAC fa:16:3e:b0:61:6c, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:22:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d0dd7812-e5ab-48a2-adaa-29197282409e tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "5f70528b-33db-4257-96fe-e5fad869a224" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.578s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:22:08 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Creating image(s)
Jul 24 16:22:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "/opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "/opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "/opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.221s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.217s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk 1073741824" returned: 0 in 0.104s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.192s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:09 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:22:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:09 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Cannot resize image /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:22:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:22:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Ensure instance console log exists: /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:22:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Start _get_guest_xml network_info=[{"id": "e709e269-eff5-4ac2-8c2a-29048448a422", "address": "fa:16:3e:0a:84:99", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape709e269-ef", "ovs_interfaceid": "e709e269-eff5-4ac2-8c2a-29048448a422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIXqhlWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'de22ea98-b041-4f3f-8986-435c43267a2e', 'attached_at': '', 'detached_at': '', 'volume_id': '914f1c49-d025-4757-84d7-32fa800e552b', 'serial': '914f1c49-d025-4757-84d7-32fa800e552b'}, 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '32b958cc-3fa9-454c-9088-86fd54bec6f3', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:22:09 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 24 16:22:09 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 24 16:22:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:22:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG nova.objects.instance [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lazy-loading 'vcpu_model' on Instance uuid de22ea98-b041-4f3f-8986-435c43267a2e {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIXqhlWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:22:10 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 16:22:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:22:10 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 16:22:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:22:10 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b07c4a8-e4c6-4ee6-982f-e2e2306220de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:22:10 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.038s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9ddd78-b36a-4524-a9e8-761bb08b661c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b] added
Jul 24 16:22:10 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddda764-e72a-40f3-b979-a83d12a705ac]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[078a2309-a9e6-41be-ad28-a922b613c86c]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vIXqhlWN {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vIXqhlWN" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c85e0a-79a2-4f44-ad23-0538aeda9c8c]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vIXqhlWN'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc3fb46-ab62-4470-a097-09729d9a216f]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6956b52-e41c-4840-a7e2-390b12f6b264]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:10 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:10 user nova-compute[70243]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:22:10 user nova-compute[70243]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:22:10 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:10 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:10 user nova-compute[70243]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:22:10 user nova-compute[70243]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:22:10 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[29817b81-f942-4cc7-9a27-df16ea005a53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b, portal: 172.16.0.220,3260]
Jul 24 16:22:10 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b, portal: 172.16.0.220,3260] successful.
Jul 24 16:22:10 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[685bb2b0-3a8b-4fad-9a78-80392039be90]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3370664a-e222-46c3-9f0c-1c654addfdb2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:10 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:10 user nova-compute[70243]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:22:10 user nova-compute[70243]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:22:10 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:10 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:10 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:10 user nova-compute[70243]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:22:10 user nova-compute[70243]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:22:10 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:10 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.188s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a976ff19-58d9-4ea6-ab1f-4febebba12e3]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:10 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: None {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG nova.compute.manager [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Stashing vm_state: active {{(pid=70243) _prep_resize /opt/stack/nova/nova/compute/manager.py:5529}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG nova.objects.instance [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lazy-loading 'pci_requests' on Instance uuid 5f70528b-33db-4257-96fe-e5fad869a224 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:22:11 user nova-compute[70243]: INFO nova.compute.claims [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Claim successful on node user
Jul 24 16:22:11 user nova-compute[70243]: DEBUG nova.objects.instance [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lazy-loading 'resources' on Instance uuid 5f70528b-33db-4257-96fe-e5fad869a224 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG nova.objects.instance [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f70528b-33db-4257-96fe-e5fad869a224 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:22:11 user nova-compute[70243]: INFO nova.compute.resource_tracker [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Updating resource usage from migration 2665c832-2ece-47d5-a25b-f3b87ff0d645
Jul 24 16:22:11 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIXqhlWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.605s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] <== connect_volume: return (1607ms) {'type': 'block', 'scsi_wwn': '23765303132633366', 'path': '/dev/sdf'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765303132633366', 'path': '/dev/sdf'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T16:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-318401571',display_name='tempest-ServerActionsTestOtherA-server-2125239384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-318401571',id=2,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNt4ywOtyDbY3gzVxioiadq0RHvp3ujVzU7+egeM9QHVtvP6DGqg4hSRwxq8r4OyAFnfBqKPWEeStDLSLwfjx+5dISRxZesWLAiccd5P+5WMBwka91+aa63O7dxU+RVwA==',key_name='tempest-keypair-283031417',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:18:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ebdb3cb079814db091227f80b2ed1b9d',ramdisk_id='',reservation_id='r-fjhaudds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-39125821',owner_user_name='tempest-ServerActionsTestOtherA-39125821-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:22:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa3936255d31421184e585e2fd17d7ef',uuid=de22ea98-b041-4f3f-8986-435c43267a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e709e269-eff5-4ac2-8c2a-29048448a422", "address": "fa:16:3e:0a:84:99", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape709e269-ef", "ovs_interfaceid": "e709e269-eff5-4ac2-8c2a-29048448a422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converting VIF {"id": "e709e269-eff5-4ac2-8c2a-29048448a422", "address": "fa:16:3e:0a:84:99", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape709e269-ef", "ovs_interfaceid": "e709e269-eff5-4ac2-8c2a-29048448a422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:84:99,bridge_name='br-int',has_traffic_filtering=True,id=e709e269-eff5-4ac2-8c2a-29048448a422,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape709e269-ef') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:22:11 user nova-compute[70243]:   <uuid>de22ea98-b041-4f3f-8986-435c43267a2e</uuid>
Jul 24 16:22:11 user nova-compute[70243]:   <name>instance-00000002</name>
Jul 24 16:22:11 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:22:11 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:22:11 user nova-compute[70243]:   <metadata>
Jul 24 16:22:11 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:22:11 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:22:11 user nova-compute[70243]:       <nova:name>tempest-ServerActionsTestOtherA-server-2125239384</nova:name>
Jul 24 16:22:11 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:22:09</nova:creationTime>
Jul 24 16:22:11 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:22:11 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:22:11 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:22:11 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:22:11 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:22:11 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:22:11 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:22:11 user nova-compute[70243]:       <nova:owner>
Jul 24 16:22:11 user nova-compute[70243]:         <nova:user uuid="aa3936255d31421184e585e2fd17d7ef">tempest-ServerActionsTestOtherA-39125821-project-member</nova:user>
Jul 24 16:22:11 user nova-compute[70243]:         <nova:project uuid="ebdb3cb079814db091227f80b2ed1b9d">tempest-ServerActionsTestOtherA-39125821</nova:project>
Jul 24 16:22:11 user nova-compute[70243]:       </nova:owner>
Jul 24 16:22:11 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:22:11 user nova-compute[70243]:       <nova:ports>
Jul 24 16:22:11 user nova-compute[70243]:         <nova:port uuid="e709e269-eff5-4ac2-8c2a-29048448a422">
Jul 24 16:22:11 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 24 16:22:11 user nova-compute[70243]:         </nova:port>
Jul 24 16:22:11 user nova-compute[70243]:       </nova:ports>
Jul 24 16:22:11 user nova-compute[70243]:     </nova:instance>
Jul 24 16:22:11 user nova-compute[70243]:   </metadata>
Jul 24 16:22:11 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:22:11 user nova-compute[70243]:     <system>
Jul 24 16:22:11 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:22:11 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:22:11 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:22:11 user nova-compute[70243]:       <entry name="serial">de22ea98-b041-4f3f-8986-435c43267a2e</entry>
Jul 24 16:22:11 user nova-compute[70243]:       <entry name="uuid">de22ea98-b041-4f3f-8986-435c43267a2e</entry>
Jul 24 16:22:11 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:22:11 user nova-compute[70243]:     </system>
Jul 24 16:22:11 user nova-compute[70243]:   </sysinfo>
Jul 24 16:22:11 user nova-compute[70243]:   <os>
Jul 24 16:22:11 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:22:11 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:22:11 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:22:11 user nova-compute[70243]:   </os>
Jul 24 16:22:11 user nova-compute[70243]:   <features>
Jul 24 16:22:11 user nova-compute[70243]:     <acpi/>
Jul 24 16:22:11 user nova-compute[70243]:     <apic/>
Jul 24 16:22:11 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:22:11 user nova-compute[70243]:   </features>
Jul 24 16:22:11 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:22:11 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:22:11 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:22:11 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:22:11 user nova-compute[70243]:   </clock>
Jul 24 16:22:11 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:22:11 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:22:11 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:22:11 user nova-compute[70243]:   </cpu>
Jul 24 16:22:11 user nova-compute[70243]:   <devices>
Jul 24 16:22:11 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:22:11 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:22:11 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk"/>
Jul 24 16:22:11 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:22:11 user nova-compute[70243]:     </disk>
Jul 24 16:22:11 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:22:11 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:22:11 user nova-compute[70243]:       <source dev="/dev/sdf"/>
Jul 24 16:22:11 user nova-compute[70243]:       <target dev="vdb" bus="virtio"/>
Jul 24 16:22:11 user nova-compute[70243]:       <serial>914f1c49-d025-4757-84d7-32fa800e552b</serial>
Jul 24 16:22:11 user nova-compute[70243]:     </disk>
Jul 24 16:22:11 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:22:11 user nova-compute[70243]:       <mac address="fa:16:3e:0a:84:99"/>
Jul 24 16:22:11 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:22:11 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:22:11 user nova-compute[70243]:       <target dev="tape709e269-ef"/>
Jul 24 16:22:11 user nova-compute[70243]:     </interface>
Jul 24 16:22:11 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:22:11 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/console.log" append="off"/>
Jul 24 16:22:11 user nova-compute[70243]:     </serial>
Jul 24 16:22:11 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:22:11 user nova-compute[70243]:     <video>
Jul 24 16:22:11 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:22:11 user nova-compute[70243]:     </video>
Jul 24 16:22:11 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:22:11 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:22:11 user nova-compute[70243]:     </rng>
Jul 24 16:22:11 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:22:11 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:22:11 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:22:11 user nova-compute[70243]:     </memballoon>
Jul 24 16:22:11 user nova-compute[70243]:   </devices>
Jul 24 16:22:11 user nova-compute[70243]: </domain>
Jul 24 16:22:11 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T16:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-318401571',display_name='tempest-ServerActionsTestOtherA-server-2125239384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-318401571',id=2,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNt4ywOtyDbY3gzVxioiadq0RHvp3ujVzU7+egeM9QHVtvP6DGqg4hSRwxq8r4OyAFnfBqKPWEeStDLSLwfjx+5dISRxZesWLAiccd5P+5WMBwka91+aa63O7dxU+RVwA==',key_name='tempest-keypair-283031417',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:18:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ebdb3cb079814db091227f80b2ed1b9d',ramdisk_id='',reservation_id='r-fjhaudds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-39125821',owner_user_name='tempest-ServerActionsTestOtherA-39125821-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:22:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa3936255d31421184e585e2fd17d7ef',uuid=de22ea98-b041-4f3f-8986-435c43267a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e709e269-eff5-4ac2-8c2a-29048448a422", "address": "fa:16:3e:0a:84:99", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape709e269-ef", "ovs_interfaceid": "e709e269-eff5-4ac2-8c2a-29048448a422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converting VIF {"id": "e709e269-eff5-4ac2-8c2a-29048448a422", "address": "fa:16:3e:0a:84:99", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape709e269-ef", "ovs_interfaceid": "e709e269-eff5-4ac2-8c2a-29048448a422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:84:99,bridge_name='br-int',has_traffic_filtering=True,id=e709e269-eff5-4ac2-8c2a-29048448a422,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape709e269-ef') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG os_vif [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:84:99,bridge_name='br-int',has_traffic_filtering=True,id=e709e269-eff5-4ac2-8c2a-29048448a422,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape709e269-ef') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape709e269-ef, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape709e269-ef, col_values=(('external_ids', {'iface-id': 'e709e269-eff5-4ac2-8c2a-29048448a422', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:84:99', 'vm-uuid': 'de22ea98-b041-4f3f-8986-435c43267a2e'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:11 user nova-compute[70243]: INFO os_vif [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:84:99,bridge_name='br-int',has_traffic_filtering=True,id=e709e269-eff5-4ac2-8c2a-29048448a422,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape709e269-ef')
Jul 24 16:22:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] No VIF found with MAC fa:16:3e:0a:84:99, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.683s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:11 user nova-compute[70243]: INFO nova.compute.manager [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Migrating
Jul 24 16:22:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:22:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquired lock "compute-rpcapi-router" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:22:11 user nova-compute[70243]: INFO nova.compute.rpcapi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Jul 24 16:22:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Releasing lock "compute-rpcapi-router" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:22:12 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690215717.042437, de22ea98-b041-4f3f-8986-435c43267a2e => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:22:12 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] VM Stopped (Lifecycle Event)
Jul 24 16:22:12 user nova-compute[70243]: DEBUG nova.compute.manager [None req-8e5e31ba-fe82-4d52-8025-1de921cfaae3 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:22:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:22:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquired lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:22:12 user nova-compute[70243]: DEBUG nova.network.neutron [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:22:12 user nova-compute[70243]: DEBUG nova.network.neutron [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Updating instance_info_cache with network_info: [{"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:22:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Releasing lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:22:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Starting migrate_disk_and_power_off {{(pid=70243) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 24 16:22:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:12 user nova-compute[70243]: DEBUG nova.compute.manager [req-89181ae9-bdfd-4c7d-b743-dade763adbd2 req-09e648f4-9a15-4452-8115-1aeea3b17b84 service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Received event volume-reimaged-75d2beea-53f6-4026-a9fa-a819238dbf73 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-89181ae9-bdfd-4c7d-b743-dade763adbd2 req-09e648f4-9a15-4452-8115-1aeea3b17b84 service nova] Acquiring lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-89181ae9-bdfd-4c7d-b743-dade763adbd2 req-09e648f4-9a15-4452-8115-1aeea3b17b84 service nova] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-89181ae9-bdfd-4c7d-b743-dade763adbd2 req-09e648f4-9a15-4452-8115-1aeea3b17b84 service nova] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:12 user nova-compute[70243]: DEBUG nova.compute.manager [req-89181ae9-bdfd-4c7d-b743-dade763adbd2 req-09e648f4-9a15-4452-8115-1aeea3b17b84 service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Processing event volume-reimaged-75d2beea-53f6-4026-a9fa-a819238dbf73 {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10772}}
Jul 24 16:22:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:12 user nova-compute[70243]: DEBUG nova.compute.manager [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Instance event wait completed in 17 seconds for volume-reimaged {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:22:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:12 user nova-compute[70243]: INFO nova.virt.block_device [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Booting with volume 75d2beea-53f6-4026-a9fa-a819238dbf73 at /dev/vda
Jul 24 16:22:13 user nova-compute[70243]: DEBUG os_brick.utils [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bf53e0-0178-4f6a-84e7-d04edd320ae2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG nova.compute.manager [req-06d8ab49-2b2a-4bdf-b4fa-66c8368ab48f req-eb2f2193-48a7-46f8-ac52-0ff408cbd409 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received event network-vif-unplugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-06d8ab49-2b2a-4bdf-b4fa-66c8368ab48f req-eb2f2193-48a7-46f8-ac52-0ff408cbd409 service nova] Acquiring lock "5f70528b-33db-4257-96fe-e5fad869a224-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-06d8ab49-2b2a-4bdf-b4fa-66c8368ab48f req-eb2f2193-48a7-46f8-ac52-0ff408cbd409 service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-06d8ab49-2b2a-4bdf-b4fa-66c8368ab48f req-eb2f2193-48a7-46f8-ac52-0ff408cbd409 service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG nova.compute.manager [req-06d8ab49-2b2a-4bdf-b4fa-66c8368ab48f req-eb2f2193-48a7-46f8-ac52-0ff408cbd409 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] No waiting events found dispatching network-vif-unplugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:13 user nova-compute[70243]: WARNING nova.compute.manager [req-06d8ab49-2b2a-4bdf-b4fa-66c8368ab48f req-eb2f2193-48a7-46f8-ac52-0ff408cbd409 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received unexpected event network-vif-unplugged-66249aa8-373c-45b2-940f-74f7e6228bce for instance with vm_state active and task_state resize_migrating.
Jul 24 16:22:13 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cab148-11b9-4845-abae-5bc71c86e77f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaedf88-a2db-434a-b17d-59a8330daff0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3061721-28c8-44b5-b8d4-d317ff4dcc2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:22:13 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:22:13 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7db8229-975a-4423-a644-1c7b6be6f979]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG os_brick.utils [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Updating existing volume attachment record: 0133a525-2df2-48df-b882-6b845a51499d {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG nova.compute.manager [req-5eeda889-6f1c-4472-9244-71ce0ee24930 req-bb8ce71e-0533-490c-a670-3decf0691f3a service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Received event network-vif-plugged-e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5eeda889-6f1c-4472-9244-71ce0ee24930 req-bb8ce71e-0533-490c-a670-3decf0691f3a service nova] Acquiring lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5eeda889-6f1c-4472-9244-71ce0ee24930 req-bb8ce71e-0533-490c-a670-3decf0691f3a service nova] Lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5eeda889-6f1c-4472-9244-71ce0ee24930 req-bb8ce71e-0533-490c-a670-3decf0691f3a service nova] Lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:13 user nova-compute[70243]: DEBUG nova.compute.manager [req-5eeda889-6f1c-4472-9244-71ce0ee24930 req-bb8ce71e-0533-490c-a670-3decf0691f3a service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] No waiting events found dispatching network-vif-plugged-e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:13 user nova-compute[70243]: WARNING nova.compute.manager [req-5eeda889-6f1c-4472-9244-71ce0ee24930 req-bb8ce71e-0533-490c-a670-3decf0691f3a service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Received unexpected event network-vif-plugged-e709e269-eff5-4ac2-8c2a-29048448a422 for instance with vm_state active and task_state rebuild_spawning.
Jul 24 16:22:14 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Instance destroyed successfully.
Jul 24 16:22:14 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1291679900',display_name='tempest-ServerActionsTestOtherB-server-1291679900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1291679900',id=6,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqymb2uus6Bkqa8Jv1s5ZbibCwJHiHaRW+MVWVRPkPu9Fm+8ajStg97Lu5Oh0gjEFACHSPElKL2d/v4nyEqxN0n8bX7piloSV6v2kR0JjimuB49HIj2A6fdu+bprtip6w==',key_name='tempest-keypair-692701',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:18:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5385c4cfc8d84d1abd728c11d75c003d',ramdisk_id='',reservation_id='r-tutxnqyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-485175328',owner_user_name='tempest-ServerActionsTestOtherB-485175328-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:22:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9db33a574c334a2d91afc72b21ef15e6',uuid=5f70528b-33db-4257-96fe-e5fad869a224,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1518946588-network", "vif_mac": "fa:16:3e:b0:61:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Converting VIF {"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1518946588-network", "vif_mac": "fa:16:3e:b0:61:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=66249aa8-373c-45b2-940f-74f7e6228bce,network=Network(109feefe-8734-40ee-a8b8-2defa6e83853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66249aa8-37') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG os_vif [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=66249aa8-373c-45b2-940f-74f7e6228bce,network=Network(109feefe-8734-40ee-a8b8-2defa6e83853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66249aa8-37') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66249aa8-37, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:22:14 user nova-compute[70243]: INFO os_vif [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=66249aa8-373c-45b2-940f-74f7e6228bce,network=Network(109feefe-8734-40ee-a8b8-2defa6e83853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66249aa8-37')
Jul 24 16:22:14 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OARbsQWM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:22:14 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:22:14 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5553c3-7cba-43bf-b0b1-3dbe3d92e0db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:22:14 user nova-compute[70243]: No targets found.
Jul 24 16:22:14 user nova-compute[70243]: iSNS:
Jul 24 16:22:14 user nova-compute[70243]: No targets found.
Jul 24 16:22:14 user nova-compute[70243]: STATIC:
Jul 24 16:22:14 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b
Jul 24 16:22:14 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:22:14 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:22:14 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b
Jul 24 16:22:14 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:22:14 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:22:14 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c
Jul 24 16:22:14 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:22:14 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:22:14 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b
Jul 24 16:22:14 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:22:14 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:22:14 user nova-compute[70243]: FIRMWARE:
Jul 24 16:22:14 user nova-compute[70243]: No targets found.
Jul 24 16:22:14 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:22:14 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:22:14 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.040s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb2a372-9479-423f-a750-574ad3bf878d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c674bc43-5706-415d-8d54-a59a2c7bcb57]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:14 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:14 user nova-compute[70243]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:22:14 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:14 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:14 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:14 user nova-compute[70243]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:22:14 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:14 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc14b880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b'): ({'sde'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Removing single pathed devices sde {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[47807d3c-6cb2-498b-a712-056169780a69]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eaf7da-4beb-4878-86e5-5d404e4c2c11]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Flushing IO for device /dev/sde {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40b7193-d62a-4ee6-af47-8c189fe1049e]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cae0bd4-f90d-4dac-a679-9727ecd3be29]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] SCSI volumes sde have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f84c4f-2534-4c3e-a7a9-4e5e159873ef]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8108180f-0a0e-47bb-bfad-423df5d94e6b]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260]
Jul 24 16:22:14 user nova-compute[70243]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260] successful.
Jul 24 16:22:14 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8f9cc4-9d3a-4613-a819-f16a2b7551f8]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] <== disconnect_volume: return (385ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:22:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224_resize/disk /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.compute.manager [req-6575a486-75f5-41b9-8648-bc25d4147ef7 req-934f02ce-9981-4b0b-a073-c6997dd0639d service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received event network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6575a486-75f5-41b9-8648-bc25d4147ef7 req-934f02ce-9981-4b0b-a073-c6997dd0639d service nova] Acquiring lock "5f70528b-33db-4257-96fe-e5fad869a224-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6575a486-75f5-41b9-8648-bc25d4147ef7 req-934f02ce-9981-4b0b-a073-c6997dd0639d service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6575a486-75f5-41b9-8648-bc25d4147ef7 req-934f02ce-9981-4b0b-a073-c6997dd0639d service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.compute.manager [req-6575a486-75f5-41b9-8648-bc25d4147ef7 req-934f02ce-9981-4b0b-a073-c6997dd0639d service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] No waiting events found dispatching network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:15 user nova-compute[70243]: WARNING nova.compute.manager [req-6575a486-75f5-41b9-8648-bc25d4147ef7 req-934f02ce-9981-4b0b-a073-c6997dd0639d service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received unexpected event network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce for instance with vm_state active and task_state resize_migrating.
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] CMD "cp -r /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224_resize/disk /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk" returned: 0 in 0.385s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224_resize/disk.info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk.info {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] CMD "cp -r /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224_resize/disk.info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk.info" returned: 0 in 0.038s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:22:15 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Creating image(s)
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Did not create local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Ensure instance console log exists: /opt/stack/data/nova/instances/edf964e0-bee8-42c8-b4eb-dd490d3fa2ab/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Start _get_guest_xml network_info=[{"id": "dabb3818-16d0-4d10-9912-15dd72754963", "address": "fa:16:3e:d6:1b:31", "network": {"id": "f0c2213f-980e-4179-b927-2472447e6418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253590851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdabb3818-16", "ovs_interfaceid": "dabb3818-16d0-4d10-9912-15dd72754963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "address": "fa:16:3e:ac:a6:57", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d99894-04", "ovs_interfaceid": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c469bd25-6546-47e3-92f6-96674f256be6", "address": "fa:16:3e:e4:76:c9", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc469bd25-65", "ovs_interfaceid": "c469bd25-6546-47e3-92f6-96674f256be6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "address": "fa:16:3e:35:0c:a4", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2077cf2-6c", "ovs_interfaceid": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "address": "fa:16:3e:6f:63:28", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c70c07-ac", "ovs_interfaceid": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "address": "fa:16:3e:2d:f2:1f", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee32acf5-1e", "ovs_interfaceid": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "address": "fa:16:3e:ed:cc:00", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71b975d-1e", "ovs_interfaceid": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsiWyznj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'edf964e0-bee8-42c8-b4eb-dd490d3fa2ab', 'attached_at': '', 'detached_at': '', 'volume_id': '42c9f323-641d-40da-ad5f-876db0d03c30', 'serial': '42c9f323-641d-40da-ad5f-876db0d03c30'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '6be1fda4-f2ef-4118-8c13-9507075bcd05', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOLFATIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'edf964e0-bee8-42c8-b4eb-dd490d3fa2ab', 'attached_at': '', 'detached_at': '', 'volume_id': 'f7373fa4-1362-4914-9741-3ae96ce33f3b', 'serial': 'f7373fa4-1362-4914-9741-3ae96ce33f3b'}, 'disk_bus': 'virtio', 'boot_index': 1, 'attachment_id': '0331d41e-8e17-4486-9376-9b9306a0e8e7', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjUIfiFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'edf964e0-bee8-42c8-b4eb-dd490d3fa2ab', 'attached_at': '', 'detached_at': '', 'volume_id': 'd496c16a-c676-4702-a76c-cd73626058c5', 'serial': 'd496c16a-c676-4702-a76c-cd73626058c5'}, 'disk_bus': 'virtio', 'boot_index': 2, 'attachment_id': '846af343-0338-432d-8af0-e94d9afa2854', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:22:15 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:22:15 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsiWyznj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:22:15 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:22:15 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:22:15 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:22:15 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:22:15 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9779c3-239f-49ed-9b17-c958bd6728f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:22:15 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74b820f-8c95-4234-a480-76fe93daa625]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30] added
Jul 24 16:22:15 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[239e300a-1bdf-4425-a776-edad32b8f7a5]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a900ed-222c-448b-aab1-67412619980a]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FsiWyznj {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.compute.manager [req-abef157a-90e8-483a-8de7-40ac55db91d1 req-12ec6ad9-b67b-4bf4-988b-da1401b7b1a8 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Received event network-vif-plugged-e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-abef157a-90e8-483a-8de7-40ac55db91d1 req-12ec6ad9-b67b-4bf4-988b-da1401b7b1a8 service nova] Acquiring lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-abef157a-90e8-483a-8de7-40ac55db91d1 req-12ec6ad9-b67b-4bf4-988b-da1401b7b1a8 service nova] Lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-abef157a-90e8-483a-8de7-40ac55db91d1 req-12ec6ad9-b67b-4bf4-988b-da1401b7b1a8 service nova] Lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG nova.compute.manager [req-abef157a-90e8-483a-8de7-40ac55db91d1 req-12ec6ad9-b67b-4bf4-988b-da1401b7b1a8 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] No waiting events found dispatching network-vif-plugged-e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:15 user nova-compute[70243]: WARNING nova.compute.manager [req-abef157a-90e8-483a-8de7-40ac55db91d1 req-12ec6ad9-b67b-4bf4-988b-da1401b7b1a8 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Received unexpected event network-vif-plugged-e709e269-eff5-4ac2-8c2a-29048448a422 for instance with vm_state active and task_state rebuild_spawning.
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FsiWyznj" returned: 0 in 0.033s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2075ee3-be54-48e0-b2de-70ff4f1fd2dc]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FsiWyznj'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[034df38f-25a1-44a5-adcc-817474b1125b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[029bafc8-ece8-4c1b-abb6-f174959d5733]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:15 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:15 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:15 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:15 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:15 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:15 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[01eb0651-6297-49c0-bfff-7e7c4a8517be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30, portal: 172.16.0.220,3260]
Jul 24 16:22:15 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30, portal: 172.16.0.220,3260] successful.
Jul 24 16:22:15 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.039s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd1fb2c-c774-413b-a707-5c9624576f07]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1806a9-056a-4220-82dc-13a3ad946df9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:16 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:16 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:16 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:22:16 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:16 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:16 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:16 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:22:16 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[85daf568-8828-4a17-99a8-e67ccb1b3b9f]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsiWyznj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215736.2475708, de22ea98-b041-4f3f-8986-435c43267a2e => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:22:16 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] VM Resumed (Lifecycle Event)
Jul 24 16:22:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:22:16 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Instance spawned successfully.
Jul 24 16:22:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:22:16 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 24 16:22:16 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215736.2551682, de22ea98-b041-4f3f-8986-435c43267a2e => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:22:16 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] VM Started (Lifecycle Event)
Jul 24 16:22:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:22:16 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 24 16:22:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG nova.objects.instance [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70243) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 24 16:22:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-60aac1b1-f59a-4715-854c-94f96cd72aba tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.101s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '26432623738663231', 'path': '/dev/sdd'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432623738663231', 'path': '/dev/sdd'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOLFATIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:22:17 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:22:17 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:22:17 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[06479dac-ba5a-491c-bf24-24ee1dff2a4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:22:17 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ceab937-ca9c-4c76-b09b-d494cba410ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b] added
Jul 24 16:22:17 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.041s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c673ee-5bfd-4729-9475-80a2a038092e]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[64922887-24b6-4298-a016-079c4657ca17]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YOLFATIP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YOLFATIP" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3d5794-8ffb-48a6-8e91-617cd4c676b3]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YOLFATIP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d56ad32-8d56-43b2-afc9-67045762b02c]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f115afca-6870-4d9d-a55d-0cb2941b1de2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:17 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:17 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:17 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:22:17 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:17 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:17 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:17 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:22:17 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37df7a1-25e3-47ab-a371-cdef662d7d2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b, portal: 172.16.0.220,3260]
Jul 24 16:22:17 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b, portal: 172.16.0.220,3260] successful.
Jul 24 16:22:17 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ec5f9c-1293-4097-9303-eeafcb403700]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cbdb45-7ace-46be-9dd0-97f9664ab00b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:17 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:17 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:17 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:22:17 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:22:17 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:17 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:17 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:17 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:22:17 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:22:17 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.397s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[894f02cd-70ba-4ba1-8ee9-7b5b317aaf0e]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOLFATIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG nova.network.neutron [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Port 66249aa8-373c-45b2-940f-74f7e6228bce binding to destination host user is already ACTIVE {{(pid=70243) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "5f70528b-33db-4257-96fe-e5fad869a224-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquired lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:22:17 user nova-compute[70243]: DEBUG nova.network.neutron [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG nova.network.neutron [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Updating instance_info_cache with network_info: [{"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Releasing lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '26332343866633234', 'path': '/dev/sde'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332343866633234', 'path': '/dev/sde'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjUIfiFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:22:18 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:22:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:22:18 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:22:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:22:18 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc6047a-73ba-42b1-acc2-cdb80ecf6c36]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:22:18 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG os_brick.utils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ea486b-e21d-4085-9a5b-ea9b0aab60a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4961f1-a5b3-45d7-8091-2ddcd90504a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a75bca0-5955-40d8-aa89-a2e454002dbd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ecbea7-bc00-4422-a014-23f0af27c6be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:22:18 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2ed3d5-7def-4fec-ba64-0e78530e9e13]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG os_brick.utils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.182s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9466775a-98e2-4242-b77c-ba637289510f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5] added
Jul 24 16:22:18 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[249392d7-207a-43a7-9131-81eabb3b7763]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc1ef42-33c9-4286-bfb2-7d5363fe7c87]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gjUIfiFt {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gjUIfiFt" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ababb4e-beee-44b0-87b7-9cf60ecbb882]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gjUIfiFt'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e5835c-0308-496f-830f-e729117474f5]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4193d186-1b5a-4fd3-8cd1-15669f0eb174]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:18 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:18 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:18 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:22:18 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:22:18 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:18 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:18 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:18 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:22:18 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:22:18 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:22:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.111s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81c9b83-ab66-4184-81fb-ab7a7700d7a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5, portal: 172.16.0.220,3260]
Jul 24 16:22:19 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5, portal: 172.16.0.220,3260] successful.
Jul 24 16:22:19 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8845909a-28a0-4d31-9156-c8d86276282f]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[238edb35-03cc-4aa2-b5c3-1b349237e18f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:19 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:19 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:19 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:22:19 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:22:19 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:22:19 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:19 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:19 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:19 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:22:19 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:22:19 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:22:19 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.594s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] HCTL ('38', '-', '-', 0) found on session 21 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b0216b-9f3f-41bc-91ed-face2222fafb]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Searching for a device in session 21 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjUIfiFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:22:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.640s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] <== connect_volume: return (1642ms) {'type': 'block', 'scsi_wwn': '23631333730386464', 'path': '/dev/sdg'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631333730386464', 'path': '/dev/sdg'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-488468712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-488468712',id=14,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PUuPlsoV8RAEroCr7yqwqWCbzL6gt5zhn8mBhOM1I200TRSrsoWL78JDc5i5DfcY+plTXx5ph8drPnUVxltX5H2XI9hczCgCzgFO1tUHzOc8Y+UBeKfw9JDlNegfFzA==',key_name='tempest-keypair-608430385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1580d59d0e041ec980753d98a90158a',ramdisk_id='',reservation_id='r-bng46r0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1365347111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1365347111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a20e83d9f14ba69a4e552a1ac7b985',uuid=edf964e0-bee8-42c8-b4eb-dd490d3fa2ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dabb3818-16d0-4d10-9912-15dd72754963", "address": "fa:16:3e:d6:1b:31", "network": {"id": "f0c2213f-980e-4179-b927-2472447e6418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253590851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdabb3818-16", "ovs_interfaceid": "dabb3818-16d0-4d10-9912-15dd72754963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converting VIF {"id": "dabb3818-16d0-4d10-9912-15dd72754963", "address": "fa:16:3e:d6:1b:31", "network": {"id": "f0c2213f-980e-4179-b927-2472447e6418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253590851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdabb3818-16", "ovs_interfaceid": "dabb3818-16d0-4d10-9912-15dd72754963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:1b:31,bridge_name='br-int',has_traffic_filtering=True,id=dabb3818-16d0-4d10-9912-15dd72754963,network=Network(f0c2213f-980e-4179-b927-2472447e6418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdabb3818-16') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-488468712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-488468712',id=14,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PUuPlsoV8RAEroCr7yqwqWCbzL6gt5zhn8mBhOM1I200TRSrsoWL78JDc5i5DfcY+plTXx5ph8drPnUVxltX5H2XI9hczCgCzgFO1tUHzOc8Y+UBeKfw9JDlNegfFzA==',key_name='tempest-keypair-608430385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1580d59d0e041ec980753d98a90158a',ramdisk_id='',reservation_id='r-bng46r0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1365347111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1365347111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a20e83d9f14ba69a4e552a1ac7b985',uuid=edf964e0-bee8-42c8-b4eb-dd490d3fa2ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "address": "fa:16:3e:ac:a6:57", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d99894-04", "ovs_interfaceid": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converting VIF {"id": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "address": "fa:16:3e:ac:a6:57", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d99894-04", "ovs_interfaceid": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:a6:57,bridge_name='br-int',has_traffic_filtering=True,id=15d99894-04b8-415b-a03a-ccc794f9d8dc,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15d99894-04') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-488468712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-488468712',id=14,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PUuPlsoV8RAEroCr7yqwqWCbzL6gt5zhn8mBhOM1I200TRSrsoWL78JDc5i5DfcY+plTXx5ph8drPnUVxltX5H2XI9hczCgCzgFO1tUHzOc8Y+UBeKfw9JDlNegfFzA==',key_name='tempest-keypair-608430385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1580d59d0e041ec980753d98a90158a',ramdisk_id='',reservation_id='r-bng46r0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1365347111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1365347111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a20e83d9f14ba69a4e552a1ac7b985',uuid=edf964e0-bee8-42c8-b4eb-dd490d3fa2ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c469bd25-6546-47e3-92f6-96674f256be6", "address": "fa:16:3e:e4:76:c9", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc469bd25-65", "ovs_interfaceid": "c469bd25-6546-47e3-92f6-96674f256be6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converting VIF {"id": "c469bd25-6546-47e3-92f6-96674f256be6", "address": "fa:16:3e:e4:76:c9", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc469bd25-65", "ovs_interfaceid": "c469bd25-6546-47e3-92f6-96674f256be6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:76:c9,bridge_name='br-int',has_traffic_filtering=True,id=c469bd25-6546-47e3-92f6-96674f256be6,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc469bd25-65') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-488468712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-488468712',id=14,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PUuPlsoV8RAEroCr7yqwqWCbzL6gt5zhn8mBhOM1I200TRSrsoWL78JDc5i5DfcY+plTXx5ph8drPnUVxltX5H2XI9hczCgCzgFO1tUHzOc8Y+UBeKfw9JDlNegfFzA==',key_name='tempest-keypair-608430385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1580d59d0e041ec980753d98a90158a',ramdisk_id='',reservation_id='r-bng46r0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1365347111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1365347111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a20e83d9f14ba69a4e552a1ac7b985',uuid=edf964e0-bee8-42c8-b4eb-dd490d3fa2ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "address": "fa:16:3e:35:0c:a4", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2077cf2-6c", "ovs_interfaceid": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converting VIF {"id": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "address": "fa:16:3e:35:0c:a4", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2077cf2-6c", "ovs_interfaceid": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:0c:a4,bridge_name='br-int',has_traffic_filtering=True,id=a2077cf2-6cf5-47e2-b50e-22625dd1c118,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2077cf2-6c') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-488468712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-488468712',id=14,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PUuPlsoV8RAEroCr7yqwqWCbzL6gt5zhn8mBhOM1I200TRSrsoWL78JDc5i5DfcY+plTXx5ph8drPnUVxltX5H2XI9hczCgCzgFO1tUHzOc8Y+UBeKfw9JDlNegfFzA==',key_name='tempest-keypair-608430385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1580d59d0e041ec980753d98a90158a',ramdisk_id='',reservation_id='r-bng46r0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1365347111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1365347111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a20e83d9f14ba69a4e552a1ac7b985',uuid=edf964e0-bee8-42c8-b4eb-dd490d3fa2ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "address": "fa:16:3e:6f:63:28", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c70c07-ac", "ovs_interfaceid": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converting VIF {"id": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "address": "fa:16:3e:6f:63:28", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c70c07-ac", "ovs_interfaceid": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:63:28,bridge_name='br-int',has_traffic_filtering=True,id=44c70c07-ac30-4af3-b1a2-5f886d4ca1c1,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c70c07-ac') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-488468712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-488468712',id=14,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PUuPlsoV8RAEroCr7yqwqWCbzL6gt5zhn8mBhOM1I200TRSrsoWL78JDc5i5DfcY+plTXx5ph8drPnUVxltX5H2XI9hczCgCzgFO1tUHzOc8Y+UBeKfw9JDlNegfFzA==',key_name='tempest-keypair-608430385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1580d59d0e041ec980753d98a90158a',ramdisk_id='',reservation_id='r-bng46r0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1365347111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1365347111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a20e83d9f14ba69a4e552a1ac7b985',uuid=edf964e0-bee8-42c8-b4eb-dd490d3fa2ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "address": "fa:16:3e:2d:f2:1f", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee32acf5-1e", "ovs_interfaceid": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converting VIF {"id": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "address": "fa:16:3e:2d:f2:1f", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee32acf5-1e", "ovs_interfaceid": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:1f,bridge_name='br-int',has_traffic_filtering=True,id=ee32acf5-1ead-4f29-b7a0-77a16d10778e,network=Network(3a15cd1c-bddd-4029-8b69-efb6444b93bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee32acf5-1e') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-488468712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-488468712',id=14,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PUuPlsoV8RAEroCr7yqwqWCbzL6gt5zhn8mBhOM1I200TRSrsoWL78JDc5i5DfcY+plTXx5ph8drPnUVxltX5H2XI9hczCgCzgFO1tUHzOc8Y+UBeKfw9JDlNegfFzA==',key_name='tempest-keypair-608430385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1580d59d0e041ec980753d98a90158a',ramdisk_id='',reservation_id='r-bng46r0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1365347111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1365347111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a20e83d9f14ba69a4e552a1ac7b985',uuid=edf964e0-bee8-42c8-b4eb-dd490d3fa2ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "address": "fa:16:3e:ed:cc:00", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71b975d-1e", "ovs_interfaceid": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converting VIF {"id": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "address": "fa:16:3e:ed:cc:00", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71b975d-1e", "ovs_interfaceid": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:cc:00,bridge_name='br-int',has_traffic_filtering=True,id=e71b975d-1eaa-46f2-b6a7-01771b71b484,network=Network(3a15cd1c-bddd-4029-8b69-efb6444b93bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape71b975d-1e') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lazy-loading 'pci_devices' on Instance uuid edf964e0-bee8-42c8-b4eb-dd490d3fa2ab {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:22:20 user nova-compute[70243]:   <uuid>edf964e0-bee8-42c8-b4eb-dd490d3fa2ab</uuid>
Jul 24 16:22:20 user nova-compute[70243]:   <name>instance-0000000e</name>
Jul 24 16:22:20 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:22:20 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:22:20 user nova-compute[70243]:   <metadata>
Jul 24 16:22:20 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:22:20 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:22:20 user nova-compute[70243]:       <nova:name>tempest-device-tagging-server-488468712</nova:name>
Jul 24 16:22:20 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:22:15</nova:creationTime>
Jul 24 16:22:20 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:22:20 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:22:20 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:22:20 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:22:20 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:22:20 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:22:20 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:22:20 user nova-compute[70243]:       <nova:owner>
Jul 24 16:22:20 user nova-compute[70243]:         <nova:user uuid="b2a20e83d9f14ba69a4e552a1ac7b985">tempest-TaggedBootDevicesTest_v242-1365347111-project-member</nova:user>
Jul 24 16:22:20 user nova-compute[70243]:         <nova:project uuid="b1580d59d0e041ec980753d98a90158a">tempest-TaggedBootDevicesTest_v242-1365347111</nova:project>
Jul 24 16:22:20 user nova-compute[70243]:       </nova:owner>
Jul 24 16:22:20 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:22:20 user nova-compute[70243]:       <nova:ports>
Jul 24 16:22:20 user nova-compute[70243]:         <nova:port uuid="dabb3818-16d0-4d10-9912-15dd72754963">
Jul 24 16:22:20 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 16:22:20 user nova-compute[70243]:         </nova:port>
Jul 24 16:22:20 user nova-compute[70243]:         <nova:port uuid="15d99894-04b8-415b-a03a-ccc794f9d8dc">
Jul 24 16:22:20 user nova-compute[70243]:           <nova:ip type="fixed" address="10.1.1.88" ipVersion="4"/>
Jul 24 16:22:20 user nova-compute[70243]:         </nova:port>
Jul 24 16:22:20 user nova-compute[70243]:         <nova:port uuid="c469bd25-6546-47e3-92f6-96674f256be6">
Jul 24 16:22:20 user nova-compute[70243]:           <nova:ip type="fixed" address="10.1.1.185" ipVersion="4"/>
Jul 24 16:22:20 user nova-compute[70243]:         </nova:port>
Jul 24 16:22:20 user nova-compute[70243]:         <nova:port uuid="a2077cf2-6cf5-47e2-b50e-22625dd1c118">
Jul 24 16:22:20 user nova-compute[70243]:           <nova:ip type="fixed" address="10.1.1.157" ipVersion="4"/>
Jul 24 16:22:20 user nova-compute[70243]:         </nova:port>
Jul 24 16:22:20 user nova-compute[70243]:         <nova:port uuid="44c70c07-ac30-4af3-b1a2-5f886d4ca1c1">
Jul 24 16:22:20 user nova-compute[70243]:           <nova:ip type="fixed" address="10.1.1.112" ipVersion="4"/>
Jul 24 16:22:20 user nova-compute[70243]:         </nova:port>
Jul 24 16:22:20 user nova-compute[70243]:         <nova:port uuid="ee32acf5-1ead-4f29-b7a0-77a16d10778e">
Jul 24 16:22:20 user nova-compute[70243]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 24 16:22:20 user nova-compute[70243]:         </nova:port>
Jul 24 16:22:20 user nova-compute[70243]:         <nova:port uuid="e71b975d-1eaa-46f2-b6a7-01771b71b484">
Jul 24 16:22:20 user nova-compute[70243]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 24 16:22:20 user nova-compute[70243]:         </nova:port>
Jul 24 16:22:20 user nova-compute[70243]:       </nova:ports>
Jul 24 16:22:20 user nova-compute[70243]:     </nova:instance>
Jul 24 16:22:20 user nova-compute[70243]:   </metadata>
Jul 24 16:22:20 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:22:20 user nova-compute[70243]:     <system>
Jul 24 16:22:20 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:22:20 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:22:20 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:22:20 user nova-compute[70243]:       <entry name="serial">edf964e0-bee8-42c8-b4eb-dd490d3fa2ab</entry>
Jul 24 16:22:20 user nova-compute[70243]:       <entry name="uuid">edf964e0-bee8-42c8-b4eb-dd490d3fa2ab</entry>
Jul 24 16:22:20 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:22:20 user nova-compute[70243]:     </system>
Jul 24 16:22:20 user nova-compute[70243]:   </sysinfo>
Jul 24 16:22:20 user nova-compute[70243]:   <os>
Jul 24 16:22:20 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:22:20 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:22:20 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:22:20 user nova-compute[70243]:   </os>
Jul 24 16:22:20 user nova-compute[70243]:   <features>
Jul 24 16:22:20 user nova-compute[70243]:     <acpi/>
Jul 24 16:22:20 user nova-compute[70243]:     <apic/>
Jul 24 16:22:20 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:22:20 user nova-compute[70243]:   </features>
Jul 24 16:22:20 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:22:20 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:22:20 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:22:20 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:22:20 user nova-compute[70243]:   </clock>
Jul 24 16:22:20 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:22:20 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:22:20 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:22:20 user nova-compute[70243]:   </cpu>
Jul 24 16:22:20 user nova-compute[70243]:   <devices>
Jul 24 16:22:20 user nova-compute[70243]:     <disk type="file" device="cdrom">
Jul 24 16:22:20 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none"/>
Jul 24 16:22:20 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/edf964e0-bee8-42c8-b4eb-dd490d3fa2ab/disk.config"/>
Jul 24 16:22:20 user nova-compute[70243]:       <target dev="hda" bus="ide"/>
Jul 24 16:22:20 user nova-compute[70243]:     </disk>
Jul 24 16:22:20 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:22:20 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:22:20 user nova-compute[70243]:       <source dev="/dev/sdd"/>
Jul 24 16:22:20 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:22:20 user nova-compute[70243]:       <serial>42c9f323-641d-40da-ad5f-876db0d03c30</serial>
Jul 24 16:22:20 user nova-compute[70243]:     </disk>
Jul 24 16:22:20 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:22:20 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:22:20 user nova-compute[70243]:       <source dev="/dev/sde"/>
Jul 24 16:22:20 user nova-compute[70243]:       <target dev="vdb" bus="virtio"/>
Jul 24 16:22:20 user nova-compute[70243]:       <serial>f7373fa4-1362-4914-9741-3ae96ce33f3b</serial>
Jul 24 16:22:20 user nova-compute[70243]:     </disk>
Jul 24 16:22:20 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:22:20 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:22:20 user nova-compute[70243]:       <source dev="/dev/sdg"/>
Jul 24 16:22:20 user nova-compute[70243]:       <target dev="vdc" bus="virtio"/>
Jul 24 16:22:20 user nova-compute[70243]:       <serial>d496c16a-c676-4702-a76c-cd73626058c5</serial>
Jul 24 16:22:20 user nova-compute[70243]:     </disk>
Jul 24 16:22:20 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:22:20 user nova-compute[70243]:       <mac address="fa:16:3e:d6:1b:31"/>
Jul 24 16:22:20 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:22:20 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:22:20 user nova-compute[70243]:       <target dev="tapdabb3818-16"/>
Jul 24 16:22:20 user nova-compute[70243]:     </interface>
Jul 24 16:22:20 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:22:20 user nova-compute[70243]:       <mac address="fa:16:3e:ac:a6:57"/>
Jul 24 16:22:20 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:22:20 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:22:20 user nova-compute[70243]:       <target dev="tap15d99894-04"/>
Jul 24 16:22:20 user nova-compute[70243]:     </interface>
Jul 24 16:22:20 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:22:20 user nova-compute[70243]:       <mac address="fa:16:3e:e4:76:c9"/>
Jul 24 16:22:20 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:22:20 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:22:20 user nova-compute[70243]:       <target dev="tapc469bd25-65"/>
Jul 24 16:22:20 user nova-compute[70243]:     </interface>
Jul 24 16:22:20 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:22:20 user nova-compute[70243]:       <mac address="fa:16:3e:35:0c:a4"/>
Jul 24 16:22:20 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:22:20 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:22:20 user nova-compute[70243]:       <target dev="tapa2077cf2-6c"/>
Jul 24 16:22:20 user nova-compute[70243]:     </interface>
Jul 24 16:22:20 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:22:20 user nova-compute[70243]:       <mac address="fa:16:3e:6f:63:28"/>
Jul 24 16:22:20 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:22:20 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:22:20 user nova-compute[70243]:       <target dev="tap44c70c07-ac"/>
Jul 24 16:22:20 user nova-compute[70243]:     </interface>
Jul 24 16:22:20 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:22:20 user nova-compute[70243]:       <mac address="fa:16:3e:2d:f2:1f"/>
Jul 24 16:22:20 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:22:20 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:22:20 user nova-compute[70243]:       <target dev="tapee32acf5-1e"/>
Jul 24 16:22:20 user nova-compute[70243]:     </interface>
Jul 24 16:22:20 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:22:20 user nova-compute[70243]:       <mac address="fa:16:3e:ed:cc:00"/>
Jul 24 16:22:20 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:22:20 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:22:20 user nova-compute[70243]:       <target dev="tape71b975d-1e"/>
Jul 24 16:22:20 user nova-compute[70243]:     </interface>
Jul 24 16:22:20 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:22:20 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/edf964e0-bee8-42c8-b4eb-dd490d3fa2ab/console.log" append="off"/>
Jul 24 16:22:20 user nova-compute[70243]:     </serial>
Jul 24 16:22:20 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:22:20 user nova-compute[70243]:     <video>
Jul 24 16:22:20 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:22:20 user nova-compute[70243]:     </video>
Jul 24 16:22:20 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:22:20 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:22:20 user nova-compute[70243]:     </rng>
Jul 24 16:22:20 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:22:20 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:22:20 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:22:20 user nova-compute[70243]:     </memballoon>
Jul 24 16:22:20 user nova-compute[70243]:   </devices>
Jul 24 16:22:20 user nova-compute[70243]: </domain>
Jul 24 16:22:20 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-488468712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-488468712',id=14,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PUuPlsoV8RAEroCr7yqwqWCbzL6gt5zhn8mBhOM1I200TRSrsoWL78JDc5i5DfcY+plTXx5ph8drPnUVxltX5H2XI9hczCgCzgFO1tUHzOc8Y+UBeKfw9JDlNegfFzA==',key_name='tempest-keypair-608430385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1580d59d0e041ec980753d98a90158a',ramdisk_id='',reservation_id='r-bng46r0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1365347111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1365347111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a20e83d9f14ba69a4e552a1ac7b985',uuid=edf964e0-bee8-42c8-b4eb-dd490d3fa2ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dabb3818-16d0-4d10-9912-15dd72754963", "address": "fa:16:3e:d6:1b:31", "network": {"id": "f0c2213f-980e-4179-b927-2472447e6418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253590851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdabb3818-16", "ovs_interfaceid": "dabb3818-16d0-4d10-9912-15dd72754963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converting VIF {"id": "dabb3818-16d0-4d10-9912-15dd72754963", "address": "fa:16:3e:d6:1b:31", "network": {"id": "f0c2213f-980e-4179-b927-2472447e6418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253590851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdabb3818-16", "ovs_interfaceid": "dabb3818-16d0-4d10-9912-15dd72754963", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:1b:31,bridge_name='br-int',has_traffic_filtering=True,id=dabb3818-16d0-4d10-9912-15dd72754963,network=Network(f0c2213f-980e-4179-b927-2472447e6418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdabb3818-16') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG os_vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:1b:31,bridge_name='br-int',has_traffic_filtering=True,id=dabb3818-16d0-4d10-9912-15dd72754963,network=Network(f0c2213f-980e-4179-b927-2472447e6418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdabb3818-16') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdabb3818-16, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdabb3818-16, col_values=(('external_ids', {'iface-id': 'dabb3818-16d0-4d10-9912-15dd72754963', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:1b:31', 'vm-uuid': 'edf964e0-bee8-42c8-b4eb-dd490d3fa2ab'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: INFO os_vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:1b:31,bridge_name='br-int',has_traffic_filtering=True,id=dabb3818-16d0-4d10-9912-15dd72754963,network=Network(f0c2213f-980e-4179-b927-2472447e6418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdabb3818-16')
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-488468712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-488468712',id=14,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PUuPlsoV8RAEroCr7yqwqWCbzL6gt5zhn8mBhOM1I200TRSrsoWL78JDc5i5DfcY+plTXx5ph8drPnUVxltX5H2XI9hczCgCzgFO1tUHzOc8Y+UBeKfw9JDlNegfFzA==',key_name='tempest-keypair-608430385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1580d59d0e041ec980753d98a90158a',ramdisk_id='',reservation_id='r-bng46r0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1365347111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1365347111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a20e83d9f14ba69a4e552a1ac7b985',uuid=edf964e0-bee8-42c8-b4eb-dd490d3fa2ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "address": "fa:16:3e:ac:a6:57", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d99894-04", "ovs_interfaceid": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converting VIF {"id": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "address": "fa:16:3e:ac:a6:57", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d99894-04", "ovs_interfaceid": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:a6:57,bridge_name='br-int',has_traffic_filtering=True,id=15d99894-04b8-415b-a03a-ccc794f9d8dc,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15d99894-04') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG os_vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:a6:57,bridge_name='br-int',has_traffic_filtering=True,id=15d99894-04b8-415b-a03a-ccc794f9d8dc,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15d99894-04') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15d99894-04, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap15d99894-04, col_values=(('external_ids', {'iface-id': '15d99894-04b8-415b-a03a-ccc794f9d8dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:a6:57', 'vm-uuid': 'edf964e0-bee8-42c8-b4eb-dd490d3fa2ab'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: INFO os_vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:a6:57,bridge_name='br-int',has_traffic_filtering=True,id=15d99894-04b8-415b-a03a-ccc794f9d8dc,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15d99894-04')
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-488468712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-488468712',id=14,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PUuPlsoV8RAEroCr7yqwqWCbzL6gt5zhn8mBhOM1I200TRSrsoWL78JDc5i5DfcY+plTXx5ph8drPnUVxltX5H2XI9hczCgCzgFO1tUHzOc8Y+UBeKfw9JDlNegfFzA==',key_name='tempest-keypair-608430385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1580d59d0e041ec980753d98a90158a',ramdisk_id='',reservation_id='r-bng46r0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1365347111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1365347111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a20e83d9f14ba69a4e552a1ac7b985',uuid=edf964e0-bee8-42c8-b4eb-dd490d3fa2ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c469bd25-6546-47e3-92f6-96674f256be6", "address": "fa:16:3e:e4:76:c9", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc469bd25-65", "ovs_interfaceid": "c469bd25-6546-47e3-92f6-96674f256be6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converting VIF {"id": "c469bd25-6546-47e3-92f6-96674f256be6", "address": "fa:16:3e:e4:76:c9", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc469bd25-65", "ovs_interfaceid": "c469bd25-6546-47e3-92f6-96674f256be6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:76:c9,bridge_name='br-int',has_traffic_filtering=True,id=c469bd25-6546-47e3-92f6-96674f256be6,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc469bd25-65') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG os_vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:76:c9,bridge_name='br-int',has_traffic_filtering=True,id=c469bd25-6546-47e3-92f6-96674f256be6,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc469bd25-65') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc469bd25-65, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc469bd25-65, col_values=(('external_ids', {'iface-id': 'c469bd25-6546-47e3-92f6-96674f256be6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:76:c9', 'vm-uuid': 'edf964e0-bee8-42c8-b4eb-dd490d3fa2ab'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: INFO os_vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:76:c9,bridge_name='br-int',has_traffic_filtering=True,id=c469bd25-6546-47e3-92f6-96674f256be6,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc469bd25-65')
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-488468712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-488468712',id=14,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PUuPlsoV8RAEroCr7yqwqWCbzL6gt5zhn8mBhOM1I200TRSrsoWL78JDc5i5DfcY+plTXx5ph8drPnUVxltX5H2XI9hczCgCzgFO1tUHzOc8Y+UBeKfw9JDlNegfFzA==',key_name='tempest-keypair-608430385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1580d59d0e041ec980753d98a90158a',ramdisk_id='',reservation_id='r-bng46r0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1365347111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1365347111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a20e83d9f14ba69a4e552a1ac7b985',uuid=edf964e0-bee8-42c8-b4eb-dd490d3fa2ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "address": "fa:16:3e:35:0c:a4", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2077cf2-6c", "ovs_interfaceid": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converting VIF {"id": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "address": "fa:16:3e:35:0c:a4", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2077cf2-6c", "ovs_interfaceid": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:0c:a4,bridge_name='br-int',has_traffic_filtering=True,id=a2077cf2-6cf5-47e2-b50e-22625dd1c118,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2077cf2-6c') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG os_vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:0c:a4,bridge_name='br-int',has_traffic_filtering=True,id=a2077cf2-6cf5-47e2-b50e-22625dd1c118,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2077cf2-6c') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2077cf2-6c, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa2077cf2-6c, col_values=(('external_ids', {'iface-id': 'a2077cf2-6cf5-47e2-b50e-22625dd1c118', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:0c:a4', 'vm-uuid': 'edf964e0-bee8-42c8-b4eb-dd490d3fa2ab'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: INFO os_vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:0c:a4,bridge_name='br-int',has_traffic_filtering=True,id=a2077cf2-6cf5-47e2-b50e-22625dd1c118,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2077cf2-6c')
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-488468712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-488468712',id=14,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PUuPlsoV8RAEroCr7yqwqWCbzL6gt5zhn8mBhOM1I200TRSrsoWL78JDc5i5DfcY+plTXx5ph8drPnUVxltX5H2XI9hczCgCzgFO1tUHzOc8Y+UBeKfw9JDlNegfFzA==',key_name='tempest-keypair-608430385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1580d59d0e041ec980753d98a90158a',ramdisk_id='',reservation_id='r-bng46r0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1365347111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1365347111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a20e83d9f14ba69a4e552a1ac7b985',uuid=edf964e0-bee8-42c8-b4eb-dd490d3fa2ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "address": "fa:16:3e:6f:63:28", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c70c07-ac", "ovs_interfaceid": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converting VIF {"id": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "address": "fa:16:3e:6f:63:28", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c70c07-ac", "ovs_interfaceid": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:63:28,bridge_name='br-int',has_traffic_filtering=True,id=44c70c07-ac30-4af3-b1a2-5f886d4ca1c1,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c70c07-ac') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG os_vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:63:28,bridge_name='br-int',has_traffic_filtering=True,id=44c70c07-ac30-4af3-b1a2-5f886d4ca1c1,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c70c07-ac') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44c70c07-ac, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap44c70c07-ac, col_values=(('external_ids', {'iface-id': '44c70c07-ac30-4af3-b1a2-5f886d4ca1c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:63:28', 'vm-uuid': 'edf964e0-bee8-42c8-b4eb-dd490d3fa2ab'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: INFO os_vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:63:28,bridge_name='br-int',has_traffic_filtering=True,id=44c70c07-ac30-4af3-b1a2-5f886d4ca1c1,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c70c07-ac')
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-488468712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-488468712',id=14,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PUuPlsoV8RAEroCr7yqwqWCbzL6gt5zhn8mBhOM1I200TRSrsoWL78JDc5i5DfcY+plTXx5ph8drPnUVxltX5H2XI9hczCgCzgFO1tUHzOc8Y+UBeKfw9JDlNegfFzA==',key_name='tempest-keypair-608430385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1580d59d0e041ec980753d98a90158a',ramdisk_id='',reservation_id='r-bng46r0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1365347111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1365347111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a20e83d9f14ba69a4e552a1ac7b985',uuid=edf964e0-bee8-42c8-b4eb-dd490d3fa2ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "address": "fa:16:3e:2d:f2:1f", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee32acf5-1e", "ovs_interfaceid": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converting VIF {"id": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "address": "fa:16:3e:2d:f2:1f", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee32acf5-1e", "ovs_interfaceid": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:1f,bridge_name='br-int',has_traffic_filtering=True,id=ee32acf5-1ead-4f29-b7a0-77a16d10778e,network=Network(3a15cd1c-bddd-4029-8b69-efb6444b93bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee32acf5-1e') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG os_vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:1f,bridge_name='br-int',has_traffic_filtering=True,id=ee32acf5-1ead-4f29-b7a0-77a16d10778e,network=Network(3a15cd1c-bddd-4029-8b69-efb6444b93bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee32acf5-1e') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee32acf5-1e, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee32acf5-1e, col_values=(('external_ids', {'iface-id': 'ee32acf5-1ead-4f29-b7a0-77a16d10778e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:f2:1f', 'vm-uuid': 'edf964e0-bee8-42c8-b4eb-dd490d3fa2ab'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: INFO os_vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:1f,bridge_name='br-int',has_traffic_filtering=True,id=ee32acf5-1ead-4f29-b7a0-77a16d10778e,network=Network(3a15cd1c-bddd-4029-8b69-efb6444b93bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee32acf5-1e')
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-488468712',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-488468712',id=14,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PUuPlsoV8RAEroCr7yqwqWCbzL6gt5zhn8mBhOM1I200TRSrsoWL78JDc5i5DfcY+plTXx5ph8drPnUVxltX5H2XI9hczCgCzgFO1tUHzOc8Y+UBeKfw9JDlNegfFzA==',key_name='tempest-keypair-608430385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1580d59d0e041ec980753d98a90158a',ramdisk_id='',reservation_id='r-bng46r0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1365347111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1365347111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a20e83d9f14ba69a4e552a1ac7b985',uuid=edf964e0-bee8-42c8-b4eb-dd490d3fa2ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "address": "fa:16:3e:ed:cc:00", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71b975d-1e", "ovs_interfaceid": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converting VIF {"id": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "address": "fa:16:3e:ed:cc:00", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71b975d-1e", "ovs_interfaceid": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:cc:00,bridge_name='br-int',has_traffic_filtering=True,id=e71b975d-1eaa-46f2-b6a7-01771b71b484,network=Network(3a15cd1c-bddd-4029-8b69-efb6444b93bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape71b975d-1e') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG os_vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:cc:00,bridge_name='br-int',has_traffic_filtering=True,id=e71b975d-1eaa-46f2-b6a7-01771b71b484,network=Network(3a15cd1c-bddd-4029-8b69-efb6444b93bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape71b975d-1e') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape71b975d-1e, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape71b975d-1e, col_values=(('external_ids', {'iface-id': 'e71b975d-1eaa-46f2-b6a7-01771b71b484', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:cc:00', 'vm-uuid': 'edf964e0-bee8-42c8-b4eb-dd490d3fa2ab'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:20 user nova-compute[70243]: INFO os_vif [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:cc:00,bridge_name='br-int',has_traffic_filtering=True,id=e71b975d-1eaa-46f2-b6a7-01771b71b484,network=Network(3a15cd1c-bddd-4029-8b69-efb6444b93bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape71b975d-1e')
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] No BDM found with device name hda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] No VIF found with MAC fa:16:3e:d6:1b:31, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:22:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] No VIF found with MAC fa:16:3e:6f:63:28, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:22:20 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Using config drive
Jul 24 16:22:21 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Creating config drive at /opt/stack/data/nova/instances/edf964e0-bee8-42c8-b4eb-dd490d3fa2ab/disk.config
Jul 24 16:22:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/edf964e0-bee8-42c8-b4eb-dd490d3fa2ab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptq4gi55u {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/edf964e0-bee8-42c8-b4eb-dd490d3fa2ab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptq4gi55u" returned: 0 in 0.068s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:23 user nova-compute[70243]: DEBUG nova.compute.manager [req-8ca63d05-d643-430c-8455-9b5d58dc14a1 req-3d045ff1-06b9-406c-a78d-4e5731dd4026 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-plugged-dabb3818-16d0-4d10-9912-15dd72754963 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8ca63d05-d643-430c-8455-9b5d58dc14a1 req-3d045ff1-06b9-406c-a78d-4e5731dd4026 service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8ca63d05-d643-430c-8455-9b5d58dc14a1 req-3d045ff1-06b9-406c-a78d-4e5731dd4026 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8ca63d05-d643-430c-8455-9b5d58dc14a1 req-3d045ff1-06b9-406c-a78d-4e5731dd4026 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:23 user nova-compute[70243]: DEBUG nova.compute.manager [req-8ca63d05-d643-430c-8455-9b5d58dc14a1 req-3d045ff1-06b9-406c-a78d-4e5731dd4026 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-plugged-dabb3818-16d0-4d10-9912-15dd72754963 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:23 user nova-compute[70243]: WARNING nova.compute.manager [req-8ca63d05-d643-430c-8455-9b5d58dc14a1 req-3d045ff1-06b9-406c-a78d-4e5731dd4026 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received unexpected event network-vif-plugged-dabb3818-16d0-4d10-9912-15dd72754963 for instance with vm_state building and task_state spawning.
Jul 24 16:22:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-cfe84492-d3f2-469e-852a-539aa6c26a87 req-5e8bc3b3-3e5d-4863-b00b-11a654062c1e service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-plugged-15d99894-04b8-415b-a03a-ccc794f9d8dc {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cfe84492-d3f2-469e-852a-539aa6c26a87 req-5e8bc3b3-3e5d-4863-b00b-11a654062c1e service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cfe84492-d3f2-469e-852a-539aa6c26a87 req-5e8bc3b3-3e5d-4863-b00b-11a654062c1e service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cfe84492-d3f2-469e-852a-539aa6c26a87 req-5e8bc3b3-3e5d-4863-b00b-11a654062c1e service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-cfe84492-d3f2-469e-852a-539aa6c26a87 req-5e8bc3b3-3e5d-4863-b00b-11a654062c1e service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-plugged-15d99894-04b8-415b-a03a-ccc794f9d8dc {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:24 user nova-compute[70243]: WARNING nova.compute.manager [req-cfe84492-d3f2-469e-852a-539aa6c26a87 req-5e8bc3b3-3e5d-4863-b00b-11a654062c1e service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received unexpected event network-vif-plugged-15d99894-04b8-415b-a03a-ccc794f9d8dc for instance with vm_state building and task_state spawning.
Jul 24 16:22:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:25 user nova-compute[70243]: DEBUG nova.compute.manager [req-fa13cffe-7a12-43c0-bf23-67b6521ddfed req-b0da6b5c-4508-43c8-9ae8-a65bd9af79c1 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-plugged-44c70c07-ac30-4af3-b1a2-5f886d4ca1c1 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fa13cffe-7a12-43c0-bf23-67b6521ddfed req-b0da6b5c-4508-43c8-9ae8-a65bd9af79c1 service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fa13cffe-7a12-43c0-bf23-67b6521ddfed req-b0da6b5c-4508-43c8-9ae8-a65bd9af79c1 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fa13cffe-7a12-43c0-bf23-67b6521ddfed req-b0da6b5c-4508-43c8-9ae8-a65bd9af79c1 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:25 user nova-compute[70243]: DEBUG nova.compute.manager [req-fa13cffe-7a12-43c0-bf23-67b6521ddfed req-b0da6b5c-4508-43c8-9ae8-a65bd9af79c1 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-plugged-44c70c07-ac30-4af3-b1a2-5f886d4ca1c1 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:25 user nova-compute[70243]: WARNING nova.compute.manager [req-fa13cffe-7a12-43c0-bf23-67b6521ddfed req-b0da6b5c-4508-43c8-9ae8-a65bd9af79c1 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received unexpected event network-vif-plugged-44c70c07-ac30-4af3-b1a2-5f886d4ca1c1 for instance with vm_state building and task_state spawning.
Jul 24 16:22:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:25 user nova-compute[70243]: DEBUG nova.compute.manager [req-1708e908-1ff4-4527-a3d8-f2e302a47e3e req-958c60e3-73c3-4e2c-a720-6ee58b2df009 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-plugged-dabb3818-16d0-4d10-9912-15dd72754963 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1708e908-1ff4-4527-a3d8-f2e302a47e3e req-958c60e3-73c3-4e2c-a720-6ee58b2df009 service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1708e908-1ff4-4527-a3d8-f2e302a47e3e req-958c60e3-73c3-4e2c-a720-6ee58b2df009 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1708e908-1ff4-4527-a3d8-f2e302a47e3e req-958c60e3-73c3-4e2c-a720-6ee58b2df009 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:25 user nova-compute[70243]: DEBUG nova.compute.manager [req-1708e908-1ff4-4527-a3d8-f2e302a47e3e req-958c60e3-73c3-4e2c-a720-6ee58b2df009 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-plugged-dabb3818-16d0-4d10-9912-15dd72754963 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:25 user nova-compute[70243]: WARNING nova.compute.manager [req-1708e908-1ff4-4527-a3d8-f2e302a47e3e req-958c60e3-73c3-4e2c-a720-6ee58b2df009 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received unexpected event network-vif-plugged-dabb3818-16d0-4d10-9912-15dd72754963 for instance with vm_state building and task_state spawning.
Jul 24 16:22:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-plugged-15d99894-04b8-415b-a03a-ccc794f9d8dc {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-plugged-15d99894-04b8-415b-a03a-ccc794f9d8dc {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:26 user nova-compute[70243]: WARNING nova.compute.manager [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received unexpected event network-vif-plugged-15d99894-04b8-415b-a03a-ccc794f9d8dc for instance with vm_state building and task_state spawning.
Jul 24 16:22:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-plugged-c469bd25-6546-47e3-92f6-96674f256be6 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-plugged-c469bd25-6546-47e3-92f6-96674f256be6 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:26 user nova-compute[70243]: WARNING nova.compute.manager [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received unexpected event network-vif-plugged-c469bd25-6546-47e3-92f6-96674f256be6 for instance with vm_state building and task_state spawning.
Jul 24 16:22:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-plugged-c469bd25-6546-47e3-92f6-96674f256be6 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-plugged-c469bd25-6546-47e3-92f6-96674f256be6 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:26 user nova-compute[70243]: WARNING nova.compute.manager [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received unexpected event network-vif-plugged-c469bd25-6546-47e3-92f6-96674f256be6 for instance with vm_state building and task_state spawning.
Jul 24 16:22:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-plugged-a2077cf2-6cf5-47e2-b50e-22625dd1c118 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-plugged-a2077cf2-6cf5-47e2-b50e-22625dd1c118 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:26 user nova-compute[70243]: WARNING nova.compute.manager [req-e7c87179-9464-4f9c-a1a4-b002209532b0 req-fa4ceeb7-33b2-4f80-bb3a-b63a9c09d84e service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received unexpected event network-vif-plugged-a2077cf2-6cf5-47e2-b50e-22625dd1c118 for instance with vm_state building and task_state spawning.
Jul 24 16:22:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.compute.manager [req-01c89d80-8d81-4821-afb9-d54e5e56d99a req-6567d444-16a6-41e2-8b1f-727ee0253a09 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-plugged-44c70c07-ac30-4af3-b1a2-5f886d4ca1c1 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-01c89d80-8d81-4821-afb9-d54e5e56d99a req-6567d444-16a6-41e2-8b1f-727ee0253a09 service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-01c89d80-8d81-4821-afb9-d54e5e56d99a req-6567d444-16a6-41e2-8b1f-727ee0253a09 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-01c89d80-8d81-4821-afb9-d54e5e56d99a req-6567d444-16a6-41e2-8b1f-727ee0253a09 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.compute.manager [req-01c89d80-8d81-4821-afb9-d54e5e56d99a req-6567d444-16a6-41e2-8b1f-727ee0253a09 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-plugged-44c70c07-ac30-4af3-b1a2-5f886d4ca1c1 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:27 user nova-compute[70243]: WARNING nova.compute.manager [req-01c89d80-8d81-4821-afb9-d54e5e56d99a req-6567d444-16a6-41e2-8b1f-727ee0253a09 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received unexpected event network-vif-plugged-44c70c07-ac30-4af3-b1a2-5f886d4ca1c1 for instance with vm_state building and task_state spawning.
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:22:27 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Creating image(s)
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Did not create local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Ensure instance console log exists: /opt/stack/data/nova/instances/fd314e21-b1a5-425d-a5e0-c1b3303b72d4/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Start _get_guest_xml network_info=[{"id": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "address": "fa:16:3e:92:b1:e8", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc58b9-95", "ovs_interfaceid": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'futGLMdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fd314e21-b1a5-425d-a5e0-c1b3303b72d4', 'attached_at': '', 'detached_at': '', 'volume_id': '75d2beea-53f6-4026-a9fa-a819238dbf73', 'serial': '75d2beea-53f6-4026-a9fa-a819238dbf73'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '0133a525-2df2-48df-b882-6b845a51499d', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:22:27 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 24 16:22:27 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.objects.instance [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lazy-loading 'vcpu_model' on Instance uuid fd314e21-b1a5-425d-a5e0-c1b3303b72d4 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'futGLMdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:22:27 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 16:22:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:22:27 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 24 16:22:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:22:27 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.compute.manager [req-852c5f6b-1f81-4474-ac91-759a1355572e req-06355ccb-5d22-4a80-b6af-0ea24ccb694c service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-plugged-e71b975d-1eaa-46f2-b6a7-01771b71b484 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-852c5f6b-1f81-4474-ac91-759a1355572e req-06355ccb-5d22-4a80-b6af-0ea24ccb694c service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-852c5f6b-1f81-4474-ac91-759a1355572e req-06355ccb-5d22-4a80-b6af-0ea24ccb694c service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-852c5f6b-1f81-4474-ac91-759a1355572e req-06355ccb-5d22-4a80-b6af-0ea24ccb694c service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.compute.manager [req-852c5f6b-1f81-4474-ac91-759a1355572e req-06355ccb-5d22-4a80-b6af-0ea24ccb694c service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-plugged-e71b975d-1eaa-46f2-b6a7-01771b71b484 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:27 user nova-compute[70243]: WARNING nova.compute.manager [req-852c5f6b-1f81-4474-ac91-759a1355572e req-06355ccb-5d22-4a80-b6af-0ea24ccb694c service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received unexpected event network-vif-plugged-e71b975d-1eaa-46f2-b6a7-01771b71b484 for instance with vm_state building and task_state spawning.
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.compute.manager [req-852c5f6b-1f81-4474-ac91-759a1355572e req-06355ccb-5d22-4a80-b6af-0ea24ccb694c service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-plugged-e71b975d-1eaa-46f2-b6a7-01771b71b484 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-852c5f6b-1f81-4474-ac91-759a1355572e req-06355ccb-5d22-4a80-b6af-0ea24ccb694c service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-852c5f6b-1f81-4474-ac91-759a1355572e req-06355ccb-5d22-4a80-b6af-0ea24ccb694c service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-852c5f6b-1f81-4474-ac91-759a1355572e req-06355ccb-5d22-4a80-b6af-0ea24ccb694c service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG nova.compute.manager [req-852c5f6b-1f81-4474-ac91-759a1355572e req-06355ccb-5d22-4a80-b6af-0ea24ccb694c service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-plugged-e71b975d-1eaa-46f2-b6a7-01771b71b484 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:27 user nova-compute[70243]: WARNING nova.compute.manager [req-852c5f6b-1f81-4474-ac91-759a1355572e req-06355ccb-5d22-4a80-b6af-0ea24ccb694c service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received unexpected event network-vif-plugged-e71b975d-1eaa-46f2-b6a7-01771b71b484 for instance with vm_state building and task_state spawning.
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[20908fe1-77a4-4457-a482-2012111f4ee9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:22:27 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5669113-1cae-4088-807e-d4ee9f4c7779]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73] added
Jul 24 16:22:27 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7ec596-550a-4919-825f-0f19b303da92]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.041s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4320dbd6-d428-4d9e-97f2-1027714740a6]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v futGLMdw {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v futGLMdw" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7feccc8c-b32e-4ad8-8aa4-1a83259fc30c]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'futGLMdw'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe287b7-3d30-45da-97e6-8f330336175a]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64af28d-4fea-4c5d-b69e-a3d532a679b9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:28 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:28 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:28 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:22:28 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:22:28 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:22:28 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:28 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:28 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:28 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:22:28 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:22:28 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:22:28 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca657ae7-d65b-45b2-ad35-fc22ec48d031]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73, portal: 172.16.0.220,3260]
Jul 24 16:22:28 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73, portal: 172.16.0.220,3260] successful.
Jul 24 16:22:28 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa5af45-7176-4e77-90ce-f30170dec5c4]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41da2ee-aafd-49a2-a9ee-b2b247717ef4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:28 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:28 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:28 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:22:28 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:22:28 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:22:28 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:22:28 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:28 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:28 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:28 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:22:28 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:22:28 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:22:28 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:22:28 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.427s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] HCTL ('39', '-', '-', 0) found on session 22 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd7f185-fa36-4178-9b0a-1dc0b28c3bc0]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Searching for a device in session 22 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'futGLMdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-ee256ccd-7f1f-4d73-a552-8d9774fc0665 req-4d435bcd-75ce-4a55-8c8c-38b8deb5e2c4 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-plugged-a2077cf2-6cf5-47e2-b50e-22625dd1c118 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ee256ccd-7f1f-4d73-a552-8d9774fc0665 req-4d435bcd-75ce-4a55-8c8c-38b8deb5e2c4 service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ee256ccd-7f1f-4d73-a552-8d9774fc0665 req-4d435bcd-75ce-4a55-8c8c-38b8deb5e2c4 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ee256ccd-7f1f-4d73-a552-8d9774fc0665 req-4d435bcd-75ce-4a55-8c8c-38b8deb5e2c4 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-ee256ccd-7f1f-4d73-a552-8d9774fc0665 req-4d435bcd-75ce-4a55-8c8c-38b8deb5e2c4 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-plugged-a2077cf2-6cf5-47e2-b50e-22625dd1c118 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:28 user nova-compute[70243]: WARNING nova.compute.manager [req-ee256ccd-7f1f-4d73-a552-8d9774fc0665 req-4d435bcd-75ce-4a55-8c8c-38b8deb5e2c4 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received unexpected event network-vif-plugged-a2077cf2-6cf5-47e2-b50e-22625dd1c118 for instance with vm_state building and task_state spawning.
Jul 24 16:22:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-ee256ccd-7f1f-4d73-a552-8d9774fc0665 req-4d435bcd-75ce-4a55-8c8c-38b8deb5e2c4 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-plugged-ee32acf5-1ead-4f29-b7a0-77a16d10778e {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ee256ccd-7f1f-4d73-a552-8d9774fc0665 req-4d435bcd-75ce-4a55-8c8c-38b8deb5e2c4 service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ee256ccd-7f1f-4d73-a552-8d9774fc0665 req-4d435bcd-75ce-4a55-8c8c-38b8deb5e2c4 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ee256ccd-7f1f-4d73-a552-8d9774fc0665 req-4d435bcd-75ce-4a55-8c8c-38b8deb5e2c4 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-ee256ccd-7f1f-4d73-a552-8d9774fc0665 req-4d435bcd-75ce-4a55-8c8c-38b8deb5e2c4 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-plugged-ee32acf5-1ead-4f29-b7a0-77a16d10778e {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:28 user nova-compute[70243]: WARNING nova.compute.manager [req-ee256ccd-7f1f-4d73-a552-8d9774fc0665 req-4d435bcd-75ce-4a55-8c8c-38b8deb5e2c4 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received unexpected event network-vif-plugged-ee32acf5-1ead-4f29-b7a0-77a16d10778e for instance with vm_state building and task_state spawning.
Jul 24 16:22:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-ee256ccd-7f1f-4d73-a552-8d9774fc0665 req-4d435bcd-75ce-4a55-8c8c-38b8deb5e2c4 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-plugged-ee32acf5-1ead-4f29-b7a0-77a16d10778e {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ee256ccd-7f1f-4d73-a552-8d9774fc0665 req-4d435bcd-75ce-4a55-8c8c-38b8deb5e2c4 service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ee256ccd-7f1f-4d73-a552-8d9774fc0665 req-4d435bcd-75ce-4a55-8c8c-38b8deb5e2c4 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ee256ccd-7f1f-4d73-a552-8d9774fc0665 req-4d435bcd-75ce-4a55-8c8c-38b8deb5e2c4 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-ee256ccd-7f1f-4d73-a552-8d9774fc0665 req-4d435bcd-75ce-4a55-8c8c-38b8deb5e2c4 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-plugged-ee32acf5-1ead-4f29-b7a0-77a16d10778e {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:28 user nova-compute[70243]: WARNING nova.compute.manager [req-ee256ccd-7f1f-4d73-a552-8d9774fc0665 req-4d435bcd-75ce-4a55-8c8c-38b8deb5e2c4 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received unexpected event network-vif-plugged-ee32acf5-1ead-4f29-b7a0-77a16d10778e for instance with vm_state building and task_state spawning.
Jul 24 16:22:28 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215748.4502168, edf964e0-bee8-42c8-b4eb-dd490d3fa2ab => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:22:28 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] VM Resumed (Lifecycle Event)
Jul 24 16:22:28 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:22:28 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Instance spawned successfully.
Jul 24 16:22:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:22:28 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:22:28 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215748.4523113, edf964e0-bee8-42c8-b4eb-dd490d3fa2ab => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:22:28 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] VM Started (Lifecycle Event)
Jul 24 16:22:28 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:22:28 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:22:28 user nova-compute[70243]: INFO nova.compute.manager [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Took 13.08 seconds to spawn the instance on the hypervisor.
Jul 24 16:22:28 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:22:28 user nova-compute[70243]: INFO nova.compute.manager [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Took 49.02 seconds to build instance.
Jul 24 16:22:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c27d3f34-a690-4236-b3d2-605fa7adc682 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 49.175s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690215734.128328, 5f70528b-33db-4257-96fe-e5fad869a224 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:22:29 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] VM Stopped (Lifecycle Event)
Jul 24 16:22:29 user nova-compute[70243]: DEBUG nova.compute.manager [None req-8f3256e0-17b4-42ac-9adc-467a5750fe19 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG nova.compute.manager [None req-8f3256e0-17b4-42ac-9adc-467a5750fe19 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:22:29 user nova-compute[70243]: INFO nova.compute.manager [None req-8f3256e0-17b4-42ac-9adc-467a5750fe19 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 24 16:22:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.467s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] <== connect_volume: return (1469ms) {'type': 'block', 'scsi_wwn': '26666623236633332', 'path': '/dev/sdh'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666623236633332', 'path': '/dev/sdh'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T16:19:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1975041839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1050817232',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJugPMjzC3sjisDM8EAfC1nB8cVCVLT9x+8UIOeaWrQRyN8J62vtUyTY9fsadBD/m66uRYjMwVz+mSleYDM8PIyy3oS1j2G/C6AKWNTLgTzZDawO9o6JDWYdg27VAeNPCw==',key_name='tempest-keypair-987230631',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:20:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ec24d98248104f5f898cf6f79207435b',ramdisk_id='',reservation_id='r-xz0z2ofe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1173962228',owner_user_name='tempest-ServerActionsV293TestJSON-1173962228-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:22:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93b6ed534c2c44d08a71f3050e212644',uuid=fd314e21-b1a5-425d-a5e0-c1b3303b72d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "address": "fa:16:3e:92:b1:e8", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc58b9-95", "ovs_interfaceid": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Converting VIF {"id": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "address": "fa:16:3e:92:b1:e8", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc58b9-95", "ovs_interfaceid": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:b1:e8,bridge_name='br-int',has_traffic_filtering=True,id=51cc58b9-958f-41dd-bf1d-596ca7c6d5ce,network=Network(3ed67d60-f22b-4d39-9563-c680c176858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cc58b9-95') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:22:29 user nova-compute[70243]:   <uuid>fd314e21-b1a5-425d-a5e0-c1b3303b72d4</uuid>
Jul 24 16:22:29 user nova-compute[70243]:   <name>instance-0000000b</name>
Jul 24 16:22:29 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:22:29 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:22:29 user nova-compute[70243]:   <metadata>
Jul 24 16:22:29 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:22:29 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:22:29 user nova-compute[70243]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1975041839</nova:name>
Jul 24 16:22:29 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:22:27</nova:creationTime>
Jul 24 16:22:29 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:22:29 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:22:29 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:22:29 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:22:29 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:22:29 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:22:29 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:22:29 user nova-compute[70243]:       <nova:owner>
Jul 24 16:22:29 user nova-compute[70243]:         <nova:user uuid="93b6ed534c2c44d08a71f3050e212644">tempest-ServerActionsV293TestJSON-1173962228-project-member</nova:user>
Jul 24 16:22:29 user nova-compute[70243]:         <nova:project uuid="ec24d98248104f5f898cf6f79207435b">tempest-ServerActionsV293TestJSON-1173962228</nova:project>
Jul 24 16:22:29 user nova-compute[70243]:       </nova:owner>
Jul 24 16:22:29 user nova-compute[70243]:       <nova:ports>
Jul 24 16:22:29 user nova-compute[70243]:         <nova:port uuid="51cc58b9-958f-41dd-bf1d-596ca7c6d5ce">
Jul 24 16:22:29 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 24 16:22:29 user nova-compute[70243]:         </nova:port>
Jul 24 16:22:29 user nova-compute[70243]:       </nova:ports>
Jul 24 16:22:29 user nova-compute[70243]:     </nova:instance>
Jul 24 16:22:29 user nova-compute[70243]:   </metadata>
Jul 24 16:22:29 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:22:29 user nova-compute[70243]:     <system>
Jul 24 16:22:29 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:22:29 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:22:29 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:22:29 user nova-compute[70243]:       <entry name="serial">fd314e21-b1a5-425d-a5e0-c1b3303b72d4</entry>
Jul 24 16:22:29 user nova-compute[70243]:       <entry name="uuid">fd314e21-b1a5-425d-a5e0-c1b3303b72d4</entry>
Jul 24 16:22:29 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:22:29 user nova-compute[70243]:     </system>
Jul 24 16:22:29 user nova-compute[70243]:   </sysinfo>
Jul 24 16:22:29 user nova-compute[70243]:   <os>
Jul 24 16:22:29 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:22:29 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:22:29 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:22:29 user nova-compute[70243]:   </os>
Jul 24 16:22:29 user nova-compute[70243]:   <features>
Jul 24 16:22:29 user nova-compute[70243]:     <acpi/>
Jul 24 16:22:29 user nova-compute[70243]:     <apic/>
Jul 24 16:22:29 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:22:29 user nova-compute[70243]:   </features>
Jul 24 16:22:29 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:22:29 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:22:29 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:22:29 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:22:29 user nova-compute[70243]:   </clock>
Jul 24 16:22:29 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:22:29 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:22:29 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:22:29 user nova-compute[70243]:   </cpu>
Jul 24 16:22:29 user nova-compute[70243]:   <devices>
Jul 24 16:22:29 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:22:29 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:22:29 user nova-compute[70243]:       <source dev="/dev/sdh"/>
Jul 24 16:22:29 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:22:29 user nova-compute[70243]:       <serial>75d2beea-53f6-4026-a9fa-a819238dbf73</serial>
Jul 24 16:22:29 user nova-compute[70243]:     </disk>
Jul 24 16:22:29 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:22:29 user nova-compute[70243]:       <mac address="fa:16:3e:92:b1:e8"/>
Jul 24 16:22:29 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:22:29 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:22:29 user nova-compute[70243]:       <target dev="tap51cc58b9-95"/>
Jul 24 16:22:29 user nova-compute[70243]:     </interface>
Jul 24 16:22:29 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:22:29 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/fd314e21-b1a5-425d-a5e0-c1b3303b72d4/console.log" append="off"/>
Jul 24 16:22:29 user nova-compute[70243]:     </serial>
Jul 24 16:22:29 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:22:29 user nova-compute[70243]:     <video>
Jul 24 16:22:29 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:22:29 user nova-compute[70243]:     </video>
Jul 24 16:22:29 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:22:29 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:22:29 user nova-compute[70243]:     </rng>
Jul 24 16:22:29 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:22:29 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:22:29 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:22:29 user nova-compute[70243]:     </memballoon>
Jul 24 16:22:29 user nova-compute[70243]:   </devices>
Jul 24 16:22:29 user nova-compute[70243]: </domain>
Jul 24 16:22:29 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T16:19:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1975041839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1050817232',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJugPMjzC3sjisDM8EAfC1nB8cVCVLT9x+8UIOeaWrQRyN8J62vtUyTY9fsadBD/m66uRYjMwVz+mSleYDM8PIyy3oS1j2G/C6AKWNTLgTzZDawO9o6JDWYdg27VAeNPCw==',key_name='tempest-keypair-987230631',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:20:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ec24d98248104f5f898cf6f79207435b',ramdisk_id='',reservation_id='r-xz0z2ofe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1173962228',owner_user_name='tempest-ServerActionsV293TestJSON-1173962228-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:22:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93b6ed534c2c44d08a71f3050e212644',uuid=fd314e21-b1a5-425d-a5e0-c1b3303b72d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "address": "fa:16:3e:92:b1:e8", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc58b9-95", "ovs_interfaceid": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Converting VIF {"id": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "address": "fa:16:3e:92:b1:e8", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc58b9-95", "ovs_interfaceid": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:b1:e8,bridge_name='br-int',has_traffic_filtering=True,id=51cc58b9-958f-41dd-bf1d-596ca7c6d5ce,network=Network(3ed67d60-f22b-4d39-9563-c680c176858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cc58b9-95') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG os_vif [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:b1:e8,bridge_name='br-int',has_traffic_filtering=True,id=51cc58b9-958f-41dd-bf1d-596ca7c6d5ce,network=Network(3ed67d60-f22b-4d39-9563-c680c176858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cc58b9-95') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51cc58b9-95, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap51cc58b9-95, col_values=(('external_ids', {'iface-id': '51cc58b9-958f-41dd-bf1d-596ca7c6d5ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:b1:e8', 'vm-uuid': 'fd314e21-b1a5-425d-a5e0-c1b3303b72d4'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:29 user nova-compute[70243]: INFO os_vif [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:b1:e8,bridge_name='br-int',has_traffic_filtering=True,id=51cc58b9-958f-41dd-bf1d-596ca7c6d5ce,network=Network(3ed67d60-f22b-4d39-9563-c680c176858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cc58b9-95')
Jul 24 16:22:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] No VIF found with MAC fa:16:3e:92:b1:e8, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Starting finish_migration {{(pid=70243) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Instance directory exists: not creating {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 16:22:29 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Creating image(s)
Jul 24 16:22:29 user nova-compute[70243]: DEBUG nova.objects.instance [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5f70528b-33db-4257-96fe-e5fad869a224 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:22:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.161s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk. size=21474836480 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk 21474836480 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk 21474836480" returned: 0 in 0.048s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Did not create local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Ensure instance console log exists: /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Start _get_guest_xml network_info=[{"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1518946588-network", "vif_mac": "fa:16:3e:b0:61:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OARbsQWM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5f70528b-33db-4257-96fe-e5fad869a224', 'attached_at': '2023-07-24T16:22:30.000000', 'detached_at': '', 'volume_id': '5d0447c3-66c4-4105-9a6f-9187ae43f96b', 'serial': '5d0447c3-66c4-4105-9a6f-9187ae43f96b'}, 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '619a8b8f-38e5-46ea-b9da-70d7d337238c', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:22:30 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:22:30 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:22:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG nova.objects.instance [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5f70528b-33db-4257-96fe-e5fad869a224 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OARbsQWM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:22:30 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:22:30 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:22:30 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0a086f-27d8-4e15-a490-ba26dc67d292]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:22:30 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[35049fe8-7345-4239-a5ba-cc51ba3d2f3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b] added
Jul 24 16:22:30 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdad0414-2cab-42fa-9b7d-31e66a251d0c]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b3ec98-f9f4-47e0-9097-1f8249bf1dae]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OARbsQWM {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OARbsQWM" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbca90ce-091b-485a-baa0-c8c07f569af7]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OARbsQWM'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd58a9b-499b-4b80-9b20-c1e215faf1ff]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87a4574-5135-4da6-9b32-37fefb6ffd17]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:22:30 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:22:30 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --login" returned: 0 in 0.148s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d59dc96-9dbc-4120-9040-b7f0b0587d2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260]
Jul 24 16:22:30 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260] successful.
Jul 24 16:22:30 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e49c15-7961-4c5c-895e-8881c86ebebe]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ea5ba2-3cf4-495e-8ecc-085659b22ef7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:22:30 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:22:30 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:22:30 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.428s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] HCTL ('40', '-', '-', 0) found on session 23 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b506e5a5-a3b8-4190-8276-d14677f9890d]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Searching for a device in session 23 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:22:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OARbsQWM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG nova.compute.manager [req-2d96c361-02a3-429d-bea7-31a042c95ee0 req-10c3e497-7007-4550-af10-7b55086f5d4b service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Received event network-vif-plugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2d96c361-02a3-429d-bea7-31a042c95ee0 req-10c3e497-7007-4550-af10-7b55086f5d4b service nova] Acquiring lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2d96c361-02a3-429d-bea7-31a042c95ee0 req-10c3e497-7007-4550-af10-7b55086f5d4b service nova] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2d96c361-02a3-429d-bea7-31a042c95ee0 req-10c3e497-7007-4550-af10-7b55086f5d4b service nova] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG nova.compute.manager [req-2d96c361-02a3-429d-bea7-31a042c95ee0 req-10c3e497-7007-4550-af10-7b55086f5d4b service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] No waiting events found dispatching network-vif-plugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:31 user nova-compute[70243]: WARNING nova.compute.manager [req-2d96c361-02a3-429d-bea7-31a042c95ee0 req-10c3e497-7007-4550-af10-7b55086f5d4b service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Received unexpected event network-vif-plugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce for instance with vm_state active and task_state rebuild_spawning.
Jul 24 16:22:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.474s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] <== connect_volume: return (1475ms) {'type': 'block', 'scsi_wwn': '23736366534623431', 'path': '/dev/sdi'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736366534623431', 'path': '/dev/sdi'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1291679900',display_name='tempest-ServerActionsTestOtherB-server-1291679900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1291679900',id=6,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqymb2uus6Bkqa8Jv1s5ZbibCwJHiHaRW+MVWVRPkPu9Fm+8ajStg97Lu5Oh0gjEFACHSPElKL2d/v4nyEqxN0n8bX7piloSV6v2kR0JjimuB49HIj2A6fdu+bprtip6w==',key_name='tempest-keypair-692701',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:18:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5385c4cfc8d84d1abd728c11d75c003d',ramdisk_id='',reservation_id='r-tutxnqyd',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-485175328',owner_user_name='tempest-ServerActionsTestOtherB-485175328-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:22:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9db33a574c334a2d91afc72b21ef15e6',uuid=5f70528b-33db-4257-96fe-e5fad869a224,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1518946588-network", "vif_mac": "fa:16:3e:b0:61:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Converting VIF {"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1518946588-network", "vif_mac": "fa:16:3e:b0:61:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=66249aa8-373c-45b2-940f-74f7e6228bce,network=Network(109feefe-8734-40ee-a8b8-2defa6e83853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66249aa8-37') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:22:31 user nova-compute[70243]:   <uuid>5f70528b-33db-4257-96fe-e5fad869a224</uuid>
Jul 24 16:22:31 user nova-compute[70243]:   <name>instance-00000006</name>
Jul 24 16:22:31 user nova-compute[70243]:   <memory>2097152</memory>
Jul 24 16:22:31 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:22:31 user nova-compute[70243]:   <metadata>
Jul 24 16:22:31 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:22:31 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:22:31 user nova-compute[70243]:       <nova:name>tempest-ServerActionsTestOtherB-server-1291679900</nova:name>
Jul 24 16:22:31 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:22:30</nova:creationTime>
Jul 24 16:22:31 user nova-compute[70243]:       <nova:flavor name="m1.small">
Jul 24 16:22:31 user nova-compute[70243]:         <nova:memory>2048</nova:memory>
Jul 24 16:22:31 user nova-compute[70243]:         <nova:disk>20</nova:disk>
Jul 24 16:22:31 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:22:31 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:22:31 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:22:31 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:22:31 user nova-compute[70243]:       <nova:owner>
Jul 24 16:22:31 user nova-compute[70243]:         <nova:user uuid="9db33a574c334a2d91afc72b21ef15e6">tempest-ServerActionsTestOtherB-485175328-project-member</nova:user>
Jul 24 16:22:31 user nova-compute[70243]:         <nova:project uuid="5385c4cfc8d84d1abd728c11d75c003d">tempest-ServerActionsTestOtherB-485175328</nova:project>
Jul 24 16:22:31 user nova-compute[70243]:       </nova:owner>
Jul 24 16:22:31 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:22:31 user nova-compute[70243]:       <nova:ports>
Jul 24 16:22:31 user nova-compute[70243]:         <nova:port uuid="66249aa8-373c-45b2-940f-74f7e6228bce">
Jul 24 16:22:31 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 16:22:31 user nova-compute[70243]:         </nova:port>
Jul 24 16:22:31 user nova-compute[70243]:       </nova:ports>
Jul 24 16:22:31 user nova-compute[70243]:     </nova:instance>
Jul 24 16:22:31 user nova-compute[70243]:   </metadata>
Jul 24 16:22:31 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:22:31 user nova-compute[70243]:     <system>
Jul 24 16:22:31 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:22:31 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:22:31 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:22:31 user nova-compute[70243]:       <entry name="serial">5f70528b-33db-4257-96fe-e5fad869a224</entry>
Jul 24 16:22:31 user nova-compute[70243]:       <entry name="uuid">5f70528b-33db-4257-96fe-e5fad869a224</entry>
Jul 24 16:22:31 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:22:31 user nova-compute[70243]:     </system>
Jul 24 16:22:31 user nova-compute[70243]:   </sysinfo>
Jul 24 16:22:31 user nova-compute[70243]:   <os>
Jul 24 16:22:31 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:22:31 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:22:31 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:22:31 user nova-compute[70243]:   </os>
Jul 24 16:22:31 user nova-compute[70243]:   <features>
Jul 24 16:22:31 user nova-compute[70243]:     <acpi/>
Jul 24 16:22:31 user nova-compute[70243]:     <apic/>
Jul 24 16:22:31 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:22:31 user nova-compute[70243]:   </features>
Jul 24 16:22:31 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:22:31 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:22:31 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:22:31 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:22:31 user nova-compute[70243]:   </clock>
Jul 24 16:22:31 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:22:31 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:22:31 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:22:31 user nova-compute[70243]:   </cpu>
Jul 24 16:22:31 user nova-compute[70243]:   <devices>
Jul 24 16:22:31 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:22:31 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:22:31 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk"/>
Jul 24 16:22:31 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:22:31 user nova-compute[70243]:     </disk>
Jul 24 16:22:31 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:22:31 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:22:31 user nova-compute[70243]:       <source dev="/dev/sdi"/>
Jul 24 16:22:31 user nova-compute[70243]:       <target dev="vdb" bus="virtio"/>
Jul 24 16:22:31 user nova-compute[70243]:       <serial>5d0447c3-66c4-4105-9a6f-9187ae43f96b</serial>
Jul 24 16:22:31 user nova-compute[70243]:     </disk>
Jul 24 16:22:31 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:22:31 user nova-compute[70243]:       <mac address="fa:16:3e:b0:61:6c"/>
Jul 24 16:22:31 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:22:31 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:22:31 user nova-compute[70243]:       <target dev="tap66249aa8-37"/>
Jul 24 16:22:31 user nova-compute[70243]:     </interface>
Jul 24 16:22:31 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:22:31 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/console.log" append="off"/>
Jul 24 16:22:31 user nova-compute[70243]:     </serial>
Jul 24 16:22:31 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:22:31 user nova-compute[70243]:     <video>
Jul 24 16:22:31 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:22:31 user nova-compute[70243]:     </video>
Jul 24 16:22:31 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:22:31 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:22:31 user nova-compute[70243]:     </rng>
Jul 24 16:22:31 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:22:31 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:22:31 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:22:31 user nova-compute[70243]:     </memballoon>
Jul 24 16:22:31 user nova-compute[70243]:   </devices>
Jul 24 16:22:31 user nova-compute[70243]: </domain>
Jul 24 16:22:31 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1291679900',display_name='tempest-ServerActionsTestOtherB-server-1291679900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1291679900',id=6,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqymb2uus6Bkqa8Jv1s5ZbibCwJHiHaRW+MVWVRPkPu9Fm+8ajStg97Lu5Oh0gjEFACHSPElKL2d/v4nyEqxN0n8bX7piloSV6v2kR0JjimuB49HIj2A6fdu+bprtip6w==',key_name='tempest-keypair-692701',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:18:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5385c4cfc8d84d1abd728c11d75c003d',ramdisk_id='',reservation_id='r-tutxnqyd',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-485175328',owner_user_name='tempest-ServerActionsTestOtherB-485175328-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:22:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9db33a574c334a2d91afc72b21ef15e6',uuid=5f70528b-33db-4257-96fe-e5fad869a224,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1518946588-network", "vif_mac": "fa:16:3e:b0:61:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Converting VIF {"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1518946588-network", "vif_mac": "fa:16:3e:b0:61:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=66249aa8-373c-45b2-940f-74f7e6228bce,network=Network(109feefe-8734-40ee-a8b8-2defa6e83853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66249aa8-37') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG os_vif [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=66249aa8-373c-45b2-940f-74f7e6228bce,network=Network(109feefe-8734-40ee-a8b8-2defa6e83853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66249aa8-37') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66249aa8-37, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap66249aa8-37, col_values=(('external_ids', {'iface-id': '66249aa8-373c-45b2-940f-74f7e6228bce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:61:6c', 'vm-uuid': '5f70528b-33db-4257-96fe-e5fad869a224'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:22:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:31 user nova-compute[70243]: INFO os_vif [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=66249aa8-373c-45b2-940f-74f7e6228bce,network=Network(109feefe-8734-40ee-a8b8-2defa6e83853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66249aa8-37')
Jul 24 16:22:32 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:22:32 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:22:32 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] No VIF found with MAC fa:16:3e:b0:61:6c, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG nova.compute.manager [req-05d7bc55-1262-4b97-8e45-f1830b0cfb1b req-ae6a99f2-84ae-4560-9116-1c994bddd6e2 service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Received event network-vif-plugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-05d7bc55-1262-4b97-8e45-f1830b0cfb1b req-ae6a99f2-84ae-4560-9116-1c994bddd6e2 service nova] Acquiring lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-05d7bc55-1262-4b97-8e45-f1830b0cfb1b req-ae6a99f2-84ae-4560-9116-1c994bddd6e2 service nova] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-05d7bc55-1262-4b97-8e45-f1830b0cfb1b req-ae6a99f2-84ae-4560-9116-1c994bddd6e2 service nova] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG nova.compute.manager [req-05d7bc55-1262-4b97-8e45-f1830b0cfb1b req-ae6a99f2-84ae-4560-9116-1c994bddd6e2 service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] No waiting events found dispatching network-vif-plugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:33 user nova-compute[70243]: WARNING nova.compute.manager [req-05d7bc55-1262-4b97-8e45-f1830b0cfb1b req-ae6a99f2-84ae-4560-9116-1c994bddd6e2 service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Received unexpected event network-vif-plugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce for instance with vm_state active and task_state rebuild_spawning.
Jul 24 16:22:33 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215753.278403, fd314e21-b1a5-425d-a5e0-c1b3303b72d4 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:22:33 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] VM Resumed (Lifecycle Event)
Jul 24 16:22:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:33 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Instance spawned successfully.
Jul 24 16:22:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:22:33 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 24 16:22:33 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215753.2844493, fd314e21-b1a5-425d-a5e0-c1b3303b72d4 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:22:33 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] VM Started (Lifecycle Event)
Jul 24 16:22:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:22:33 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 24 16:22:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG nova.objects.instance [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Trying to apply a migration context that does not seem to be set for this instance {{(pid=70243) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-89181ae9-bdfd-4c7d-b743-dade763adbd2 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.092s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG nova.compute.manager [req-685d1b63-0b54-4f55-b4dc-fb6685a69dd3 req-a4c7f0a4-e626-4acc-b98c-4a6b6d1a1faa service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received event network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-685d1b63-0b54-4f55-b4dc-fb6685a69dd3 req-a4c7f0a4-e626-4acc-b98c-4a6b6d1a1faa service nova] Acquiring lock "5f70528b-33db-4257-96fe-e5fad869a224-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-685d1b63-0b54-4f55-b4dc-fb6685a69dd3 req-a4c7f0a4-e626-4acc-b98c-4a6b6d1a1faa service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-685d1b63-0b54-4f55-b4dc-fb6685a69dd3 req-a4c7f0a4-e626-4acc-b98c-4a6b6d1a1faa service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:33 user nova-compute[70243]: DEBUG nova.compute.manager [req-685d1b63-0b54-4f55-b4dc-fb6685a69dd3 req-a4c7f0a4-e626-4acc-b98c-4a6b6d1a1faa service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] No waiting events found dispatching network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:33 user nova-compute[70243]: WARNING nova.compute.manager [req-685d1b63-0b54-4f55-b4dc-fb6685a69dd3 req-a4c7f0a4-e626-4acc-b98c-4a6b6d1a1faa service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received unexpected event network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce for instance with vm_state active and task_state resize_finish.
Jul 24 16:22:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-c077c50c-df34-4c24-96ed-1dc50b64f82f req-80254036-1dc9-4f4a-a23b-c4829dcb2652 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received event network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:22:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c077c50c-df34-4c24-96ed-1dc50b64f82f req-80254036-1dc9-4f4a-a23b-c4829dcb2652 service nova] Acquiring lock "5f70528b-33db-4257-96fe-e5fad869a224-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c077c50c-df34-4c24-96ed-1dc50b64f82f req-80254036-1dc9-4f4a-a23b-c4829dcb2652 service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c077c50c-df34-4c24-96ed-1dc50b64f82f req-80254036-1dc9-4f4a-a23b-c4829dcb2652 service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-c077c50c-df34-4c24-96ed-1dc50b64f82f req-80254036-1dc9-4f4a-a23b-c4829dcb2652 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] No waiting events found dispatching network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:22:35 user nova-compute[70243]: WARNING nova.compute.manager [req-c077c50c-df34-4c24-96ed-1dc50b64f82f req-80254036-1dc9-4f4a-a23b-c4829dcb2652 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received unexpected event network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce for instance with vm_state active and task_state resize_finish.
Jul 24 16:22:36 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215756.0945537, 5f70528b-33db-4257-96fe-e5fad869a224 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:22:36 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] VM Resumed (Lifecycle Event)
Jul 24 16:22:36 user nova-compute[70243]: DEBUG nova.compute.manager [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:22:36 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Instance running successfully.
Jul 24 16:22:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Failed to set time: agent not configured {{(pid=70243) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 24 16:22:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a7bf7367-ee7a-45b3-8353-cda90e98e3d6 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] finish_migration finished successfully. {{(pid=70243) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 24 16:22:36 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:22:36 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:22:36 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 24 16:22:36 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215756.0962846, 5f70528b-33db-4257-96fe-e5fad869a224 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:22:36 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] VM Started (Lifecycle Event)
Jul 24 16:22:36 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:22:36 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:22:36 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 24 16:22:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:40 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:22:40 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:22:40 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:22:40 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:22:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:40 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:22:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:22:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:22:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:22:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:22:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:22:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:22:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:22:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:22:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:22:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:22:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:44 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:22:44 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:22:44 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=7352MB free_disk=24.33938980102539GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:22:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:22:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:22:44 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Applying migration context for instance 5f70528b-33db-4257-96fe-e5fad869a224 as it has an incoming, in-progress migration 2665c832-2ece-47d5-a25b-f3b87ff0d645. Migration status is finished {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 24 16:22:44 user nova-compute[70243]: INFO nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Updating resource usage from migration 2665c832-2ece-47d5-a25b-f3b87ff0d645
Jul 24 16:22:44 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance de22ea98-b041-4f3f-8986-435c43267a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:22:44 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance de484cb2-7f20-4bf1-927b-c066735bfeca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:22:44 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance a13c243a-2b98-4ef1-b17c-e2e15ba005fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:22:44 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance ad611655-ba4d-4a66-b78e-a82c058f4414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:22:44 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance c2ee17ba-3482-4caf-992e-30b3953d1e91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:22:44 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance fd314e21-b1a5-425d-a5e0-c1b3303b72d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:22:44 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance b0dd6065-3916-4f0e-841e-3df5ded2e2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:22:44 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:22:44 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance edf964e0-bee8-42c8-b4eb-dd490d3fa2ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:22:44 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Migration 2665c832-2ece-47d5-a25b-f3b87ff0d645 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 24 16:22:44 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5f70528b-33db-4257-96fe-e5fad869a224 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:22:44 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:22:44 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:22:45 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:22:45 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:22:45 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:22:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.069s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:22:46 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:22:46 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:22:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-ad611655-ba4d-4a66-b78e-a82c058f4414" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:22:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-ad611655-ba4d-4a66-b78e-a82c058f4414" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:22:46 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:22:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:47 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Updating instance_info_cache with network_info: [{"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:22:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-ad611655-ba4d-4a66-b78e-a82c058f4414" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:22:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:22:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:22:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:22:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:22:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:22:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:22:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:22:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG nova.objects.instance [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lazy-loading 'flavor' on Instance uuid b0dd6065-3916-4f0e-841e-3df5ded2e2ee {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:04 user nova-compute[70243]: INFO nova.compute.manager [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Attaching volume 83ffe933-b556-46eb-b3eb-b77f6c75e323 to /dev/vdb
Jul 24 16:23:04 user nova-compute[70243]: DEBUG os_brick.utils [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[00434918-369f-4452-bdd4-805826c11f3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7e9a0c-0784-4322-b2a7-1fbc4e1da0e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d299cd17-a07f-42b0-9f76-a61e0ac8d323]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[62281e07-e371-4afb-b67f-7061580f1b3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:23:04 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:23:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a80737-5550-416e-b820-2be331a86c13]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG os_brick.utils [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:23:04 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Updating existing volume attachment record: 0d72ca40-5bd1-4a3b-b909-582497951c54 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:23:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFvxVoyb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:23:12 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:23:12 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:23:12 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62c4a24-8028-4337-909e-8e3e940fe485]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:23:12 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[15311ec1-c3e2-4f53-b84c-603ef6cf45a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323] added
Jul 24 16:23:12 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[57be7c7b-e57d-47b5-b585-507365dd2d8b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a681458-cfce-4d10-aae6-215ebf8b2145]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nFvxVoyb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nFvxVoyb" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[65553f9d-2888-4d20-bb50-6961c0168d9b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nFvxVoyb'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bc1284-c5ca-4669-a033-de2567be47d5]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0c7fa4-f2fe-41f7-bcf7-328b939e2791]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:23:12 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:23:12 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a3b4e8-1c8e-4acd-bd96-81da164afbb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323, portal: 172.16.0.220,3260]
Jul 24 16:23:12 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323, portal: 172.16.0.220,3260] successful.
Jul 24 16:23:12 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e74fd19-5728-4726-92da-80bb2ee6ca9f]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[396ca4ec-5418-4e98-997d-5b9ae29ff587]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:23:12 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:23:12 user nova-compute[70243]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:23:12 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] HCTL ('41', '-', '-', 0) found on session 25 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7b5add-a84d-496d-9fcc-27a732013b4c]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Searching for a device in session 25 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:23:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFvxVoyb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:23:13 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:23:13 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '23035646636316430', 'path': '/dev/sdj'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:23:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035646636316430', 'path': '/dev/sdj'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:23:13 user nova-compute[70243]: DEBUG nova.objects.instance [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lazy-loading 'flavor' on Instance uuid b0dd6065-3916-4f0e-841e-3df5ded2e2ee {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:23:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:23:13 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:23:13 user nova-compute[70243]:   <source dev="/dev/sdj"/>
Jul 24 16:23:13 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:23:13 user nova-compute[70243]:   <serial>83ffe933-b556-46eb-b3eb-b77f6c75e323</serial>
Jul 24 16:23:13 user nova-compute[70243]: </disk>
Jul 24 16:23:13 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:23:14 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:23:14 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:23:14 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] No VIF found with MAC fa:16:3e:83:78:ca, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:23:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d52e3930-815d-4151-b932-7e6402b73960 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.901s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "abcd54bc-02d4-4872-8227-43cb93d27491" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "abcd54bc-02d4-4872-8227-43cb93d27491" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:23:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:15 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:23:15 user nova-compute[70243]: INFO nova.compute.claims [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Claim successful on node user
Jul 24 16:23:15 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:23:15 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:23:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:23:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:23:15 user nova-compute[70243]: DEBUG nova.network.neutron [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:23:15 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:23:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG nova.policy [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62f8a994029a48608bfdcb15f14b2067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcf70d1092145a2bda67106833fe84d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:23:16 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Creating image(s)
Jul 24 16:23:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "/opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "/opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "/opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk 1073741824" returned: 0 in 0.064s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.150s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Checking if we can resize image /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG nova.network.neutron [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Successfully created port: b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Cannot resize image /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG nova.objects.instance [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'migration_context' on Instance uuid abcd54bc-02d4-4872-8227-43cb93d27491 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Ensure instance console log exists: /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:17 user nova-compute[70243]: DEBUG nova.network.neutron [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Successfully updated port: b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:23:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "refresh_cache-abcd54bc-02d4-4872-8227-43cb93d27491" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:23:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquired lock "refresh_cache-abcd54bc-02d4-4872-8227-43cb93d27491" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:23:17 user nova-compute[70243]: DEBUG nova.network.neutron [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:23:17 user nova-compute[70243]: DEBUG nova.network.neutron [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.compute.manager [req-d1c95faf-44f7-4b4f-9e71-967b42579a8f req-883625d9-11b6-4dbb-a1aa-83a9910013f4 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Received event network-changed-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.compute.manager [req-d1c95faf-44f7-4b4f-9e71-967b42579a8f req-883625d9-11b6-4dbb-a1aa-83a9910013f4 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Refreshing instance network info cache due to event network-changed-b7b407a6-851a-4096-b6d4-d60d5e1d40d0. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d1c95faf-44f7-4b4f-9e71-967b42579a8f req-883625d9-11b6-4dbb-a1aa-83a9910013f4 service nova] Acquiring lock "refresh_cache-abcd54bc-02d4-4872-8227-43cb93d27491" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.network.neutron [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Updating instance_info_cache with network_info: [{"id": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "address": "fa:16:3e:11:51:64", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b407a6-85", "ovs_interfaceid": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Releasing lock "refresh_cache-abcd54bc-02d4-4872-8227-43cb93d27491" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Instance network_info: |[{"id": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "address": "fa:16:3e:11:51:64", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b407a6-85", "ovs_interfaceid": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d1c95faf-44f7-4b4f-9e71-967b42579a8f req-883625d9-11b6-4dbb-a1aa-83a9910013f4 service nova] Acquired lock "refresh_cache-abcd54bc-02d4-4872-8227-43cb93d27491" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.network.neutron [req-d1c95faf-44f7-4b4f-9e71-967b42579a8f req-883625d9-11b6-4dbb-a1aa-83a9910013f4 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Refreshing network info cache for port b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Start _get_guest_xml network_info=[{"id": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "address": "fa:16:3e:11:51:64", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b407a6-85", "ovs_interfaceid": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:23:18 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:23:18 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:23:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-81833196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-81833196',id=15,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0i2hBPJPt19uO9e4TSXZhl857gb3L3vMLFLZH6nJI1HpAainLWo36bPWYJB/sqsGP2BMKBKQjwJvt+xGzUlD69hcH1UBhw08zHqrJxdyORpjwKrQqIUJvk9SNHZKYJ2A==',key_name='tempest-keypair-146229776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fcf70d1092145a2bda67106833fe84d',ramdisk_id='',reservation_id='r-i86lveuw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-372850833',owner_user_name='tempest-AttachVolumeShelveTestJSON-372850833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62f8a994029a48608bfdcb15f14b2067',uuid=abcd54bc-02d4-4872-8227-43cb93d27491,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "address": "fa:16:3e:11:51:64", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b407a6-85", "ovs_interfaceid": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converting VIF {"id": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "address": "fa:16:3e:11:51:64", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b407a6-85", "ovs_interfaceid": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:51:64,bridge_name='br-int',has_traffic_filtering=True,id=b7b407a6-851a-4096-b6d4-d60d5e1d40d0,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b407a6-85') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.objects.instance [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'pci_devices' on Instance uuid abcd54bc-02d4-4872-8227-43cb93d27491 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:23:18 user nova-compute[70243]:   <uuid>abcd54bc-02d4-4872-8227-43cb93d27491</uuid>
Jul 24 16:23:18 user nova-compute[70243]:   <name>instance-0000000f</name>
Jul 24 16:23:18 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:23:18 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:23:18 user nova-compute[70243]:   <metadata>
Jul 24 16:23:18 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:23:18 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:23:18 user nova-compute[70243]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-81833196</nova:name>
Jul 24 16:23:18 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:23:18</nova:creationTime>
Jul 24 16:23:18 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:23:18 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:23:18 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:23:18 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:23:18 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:23:18 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:23:18 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:23:18 user nova-compute[70243]:       <nova:owner>
Jul 24 16:23:18 user nova-compute[70243]:         <nova:user uuid="62f8a994029a48608bfdcb15f14b2067">tempest-AttachVolumeShelveTestJSON-372850833-project-member</nova:user>
Jul 24 16:23:18 user nova-compute[70243]:         <nova:project uuid="9fcf70d1092145a2bda67106833fe84d">tempest-AttachVolumeShelveTestJSON-372850833</nova:project>
Jul 24 16:23:18 user nova-compute[70243]:       </nova:owner>
Jul 24 16:23:18 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:23:18 user nova-compute[70243]:       <nova:ports>
Jul 24 16:23:18 user nova-compute[70243]:         <nova:port uuid="b7b407a6-851a-4096-b6d4-d60d5e1d40d0">
Jul 24 16:23:18 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 24 16:23:18 user nova-compute[70243]:         </nova:port>
Jul 24 16:23:18 user nova-compute[70243]:       </nova:ports>
Jul 24 16:23:18 user nova-compute[70243]:     </nova:instance>
Jul 24 16:23:18 user nova-compute[70243]:   </metadata>
Jul 24 16:23:18 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:23:18 user nova-compute[70243]:     <system>
Jul 24 16:23:18 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:23:18 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:23:18 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:23:18 user nova-compute[70243]:       <entry name="serial">abcd54bc-02d4-4872-8227-43cb93d27491</entry>
Jul 24 16:23:18 user nova-compute[70243]:       <entry name="uuid">abcd54bc-02d4-4872-8227-43cb93d27491</entry>
Jul 24 16:23:18 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:23:18 user nova-compute[70243]:     </system>
Jul 24 16:23:18 user nova-compute[70243]:   </sysinfo>
Jul 24 16:23:18 user nova-compute[70243]:   <os>
Jul 24 16:23:18 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:23:18 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:23:18 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:23:18 user nova-compute[70243]:   </os>
Jul 24 16:23:18 user nova-compute[70243]:   <features>
Jul 24 16:23:18 user nova-compute[70243]:     <acpi/>
Jul 24 16:23:18 user nova-compute[70243]:     <apic/>
Jul 24 16:23:18 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:23:18 user nova-compute[70243]:   </features>
Jul 24 16:23:18 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:23:18 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:23:18 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:23:18 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:23:18 user nova-compute[70243]:   </clock>
Jul 24 16:23:18 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:23:18 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:23:18 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:23:18 user nova-compute[70243]:   </cpu>
Jul 24 16:23:18 user nova-compute[70243]:   <devices>
Jul 24 16:23:18 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:23:18 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:23:18 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk"/>
Jul 24 16:23:18 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:23:18 user nova-compute[70243]:     </disk>
Jul 24 16:23:18 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:23:18 user nova-compute[70243]:       <mac address="fa:16:3e:11:51:64"/>
Jul 24 16:23:18 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:23:18 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:23:18 user nova-compute[70243]:       <target dev="tapb7b407a6-85"/>
Jul 24 16:23:18 user nova-compute[70243]:     </interface>
Jul 24 16:23:18 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:23:18 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/console.log" append="off"/>
Jul 24 16:23:18 user nova-compute[70243]:     </serial>
Jul 24 16:23:18 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:23:18 user nova-compute[70243]:     <video>
Jul 24 16:23:18 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:23:18 user nova-compute[70243]:     </video>
Jul 24 16:23:18 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:23:18 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:23:18 user nova-compute[70243]:     </rng>
Jul 24 16:23:18 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:23:18 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:23:18 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:23:18 user nova-compute[70243]:     </memballoon>
Jul 24 16:23:18 user nova-compute[70243]:   </devices>
Jul 24 16:23:18 user nova-compute[70243]: </domain>
Jul 24 16:23:18 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:23:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-81833196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-81833196',id=15,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0i2hBPJPt19uO9e4TSXZhl857gb3L3vMLFLZH6nJI1HpAainLWo36bPWYJB/sqsGP2BMKBKQjwJvt+xGzUlD69hcH1UBhw08zHqrJxdyORpjwKrQqIUJvk9SNHZKYJ2A==',key_name='tempest-keypair-146229776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fcf70d1092145a2bda67106833fe84d',ramdisk_id='',reservation_id='r-i86lveuw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-372850833',owner_user_name='tempest-AttachVolumeShelveTestJSON-372850833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62f8a994029a48608bfdcb15f14b2067',uuid=abcd54bc-02d4-4872-8227-43cb93d27491,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "address": "fa:16:3e:11:51:64", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b407a6-85", "ovs_interfaceid": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converting VIF {"id": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "address": "fa:16:3e:11:51:64", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b407a6-85", "ovs_interfaceid": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:51:64,bridge_name='br-int',has_traffic_filtering=True,id=b7b407a6-851a-4096-b6d4-d60d5e1d40d0,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b407a6-85') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG os_vif [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:51:64,bridge_name='br-int',has_traffic_filtering=True,id=b7b407a6-851a-4096-b6d4-d60d5e1d40d0,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b407a6-85') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7b407a6-85, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb7b407a6-85, col_values=(('external_ids', {'iface-id': 'b7b407a6-851a-4096-b6d4-d60d5e1d40d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:51:64', 'vm-uuid': 'abcd54bc-02d4-4872-8227-43cb93d27491'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:18 user nova-compute[70243]: INFO os_vif [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:51:64,bridge_name='br-int',has_traffic_filtering=True,id=b7b407a6-851a-4096-b6d4-d60d5e1d40d0,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b407a6-85')
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] No VIF found with MAC fa:16:3e:11:51:64, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.network.neutron [req-d1c95faf-44f7-4b4f-9e71-967b42579a8f req-883625d9-11b6-4dbb-a1aa-83a9910013f4 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Updated VIF entry in instance network info cache for port b7b407a6-851a-4096-b6d4-d60d5e1d40d0. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG nova.network.neutron [req-d1c95faf-44f7-4b4f-9e71-967b42579a8f req-883625d9-11b6-4dbb-a1aa-83a9910013f4 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Updating instance_info_cache with network_info: [{"id": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "address": "fa:16:3e:11:51:64", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b407a6-85", "ovs_interfaceid": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:23:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d1c95faf-44f7-4b4f-9e71-967b42579a8f req-883625d9-11b6-4dbb-a1aa-83a9910013f4 service nova] Releasing lock "refresh_cache-abcd54bc-02d4-4872-8227-43cb93d27491" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:23:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-a4e9eb77-69b9-4579-834f-661f446e4cd1 req-dd7daeea-76c8-4193-bddd-46f20daa474d service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Received event network-vif-plugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a4e9eb77-69b9-4579-834f-661f446e4cd1 req-dd7daeea-76c8-4193-bddd-46f20daa474d service nova] Acquiring lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a4e9eb77-69b9-4579-834f-661f446e4cd1 req-dd7daeea-76c8-4193-bddd-46f20daa474d service nova] Lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a4e9eb77-69b9-4579-834f-661f446e4cd1 req-dd7daeea-76c8-4193-bddd-46f20daa474d service nova] Lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-a4e9eb77-69b9-4579-834f-661f446e4cd1 req-dd7daeea-76c8-4193-bddd-46f20daa474d service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] No waiting events found dispatching network-vif-plugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:20 user nova-compute[70243]: WARNING nova.compute.manager [req-a4e9eb77-69b9-4579-834f-661f446e4cd1 req-dd7daeea-76c8-4193-bddd-46f20daa474d service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Received unexpected event network-vif-plugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 for instance with vm_state building and task_state spawning.
Jul 24 16:23:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-ca7784e7-ba6d-4334-b274-8cdb9668ecca req-7ce991b4-9b34-4de5-9fe0-1c39ab77e69d service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Received event network-vif-plugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ca7784e7-ba6d-4334-b274-8cdb9668ecca req-7ce991b4-9b34-4de5-9fe0-1c39ab77e69d service nova] Acquiring lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ca7784e7-ba6d-4334-b274-8cdb9668ecca req-7ce991b4-9b34-4de5-9fe0-1c39ab77e69d service nova] Lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ca7784e7-ba6d-4334-b274-8cdb9668ecca req-7ce991b4-9b34-4de5-9fe0-1c39ab77e69d service nova] Lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-ca7784e7-ba6d-4334-b274-8cdb9668ecca req-7ce991b4-9b34-4de5-9fe0-1c39ab77e69d service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] No waiting events found dispatching network-vif-plugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:22 user nova-compute[70243]: WARNING nova.compute.manager [req-ca7784e7-ba6d-4334-b274-8cdb9668ecca req-7ce991b4-9b34-4de5-9fe0-1c39ab77e69d service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Received unexpected event network-vif-plugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 for instance with vm_state building and task_state spawning.
Jul 24 16:23:23 user nova-compute[70243]: DEBUG nova.compute.manager [req-10dcd45e-9653-49aa-ab00-82e9ab2236bb req-ddbda551-460d-4b5d-8f15-f24a23f0b759 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received event network-changed-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG nova.compute.manager [req-10dcd45e-9653-49aa-ab00-82e9ab2236bb req-ddbda551-460d-4b5d-8f15-f24a23f0b759 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Refreshing instance network info cache due to event network-changed-809292ba-1131-47d4-8b1c-b7cef6888d76. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-10dcd45e-9653-49aa-ab00-82e9ab2236bb req-ddbda551-460d-4b5d-8f15-f24a23f0b759 service nova] Acquiring lock "refresh_cache-b0dd6065-3916-4f0e-841e-3df5ded2e2ee" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-10dcd45e-9653-49aa-ab00-82e9ab2236bb req-ddbda551-460d-4b5d-8f15-f24a23f0b759 service nova] Acquired lock "refresh_cache-b0dd6065-3916-4f0e-841e-3df5ded2e2ee" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG nova.network.neutron [req-10dcd45e-9653-49aa-ab00-82e9ab2236bb req-ddbda551-460d-4b5d-8f15-f24a23f0b759 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Refreshing network info cache for port 809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215803.1309903, abcd54bc-02d4-4872-8227-43cb93d27491 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:23:23 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] VM Resumed (Lifecycle Event)
Jul 24 16:23:23 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:23:23 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Instance spawned successfully.
Jul 24 16:23:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:23:23 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:23:23 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215803.145391, abcd54bc-02d4-4872-8227-43cb93d27491 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:23:23 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] VM Started (Lifecycle Event)
Jul 24 16:23:23 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:23:23 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:23:23 user nova-compute[70243]: INFO nova.compute.manager [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Took 7.13 seconds to spawn the instance on the hypervisor.
Jul 24 16:23:23 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:23 user nova-compute[70243]: INFO nova.compute.manager [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Terminating instance
Jul 24 16:23:23 user nova-compute[70243]: DEBUG nova.compute.manager [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:23 user nova-compute[70243]: INFO nova.compute.manager [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Took 8.00 seconds to build instance.
Jul 24 16:23:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b4bbfa8f-9e53-4fa2-ad16-902aaa2a1379 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "abcd54bc-02d4-4872-8227-43cb93d27491" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.128s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:24 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Instance destroyed successfully.
Jul 24 16:23:24 user nova-compute[70243]: DEBUG nova.objects.instance [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lazy-loading 'resources' on Instance uuid d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1530594278',display_name='tempest-VolumesAdminNegativeTest-server-1530594278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1530594278',id=13,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:21:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6973a869545f43e1bd096a5f6eaf921c',ramdisk_id='',reservation_id='r-5p3noewz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2091650987',owner_user_name='tempest-VolumesAdminNegativeTest-2091650987-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:21:22Z,user_data=None,user_id='4e6294a2931e4959be1440678b174828',uuid=d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98ae14d1-ca47-4ba3-9327-5bfecb545a5d", "address": "fa:16:3e:c1:c5:80", "network": {"id": "798ddded-1cb9-4c01-9590-27f071d81a3c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1340440057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6973a869545f43e1bd096a5f6eaf921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ae14d1-ca", "ovs_interfaceid": "98ae14d1-ca47-4ba3-9327-5bfecb545a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Converting VIF {"id": "98ae14d1-ca47-4ba3-9327-5bfecb545a5d", "address": "fa:16:3e:c1:c5:80", "network": {"id": "798ddded-1cb9-4c01-9590-27f071d81a3c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1340440057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6973a869545f43e1bd096a5f6eaf921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ae14d1-ca", "ovs_interfaceid": "98ae14d1-ca47-4ba3-9327-5bfecb545a5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c5:80,bridge_name='br-int',has_traffic_filtering=True,id=98ae14d1-ca47-4ba3-9327-5bfecb545a5d,network=Network(798ddded-1cb9-4c01-9590-27f071d81a3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ae14d1-ca') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG os_vif [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c5:80,bridge_name='br-int',has_traffic_filtering=True,id=98ae14d1-ca47-4ba3-9327-5bfecb545a5d,network=Network(798ddded-1cb9-4c01-9590-27f071d81a3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ae14d1-ca') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98ae14d1-ca, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:23:24 user nova-compute[70243]: INFO os_vif [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c5:80,bridge_name='br-int',has_traffic_filtering=True,id=98ae14d1-ca47-4ba3-9327-5bfecb545a5d,network=Network(798ddded-1cb9-4c01-9590-27f071d81a3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ae14d1-ca')
Jul 24 16:23:24 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Deleting instance files /opt/stack/data/nova/instances/d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32_del
Jul 24 16:23:24 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Deletion of /opt/stack/data/nova/instances/d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32_del complete
Jul 24 16:23:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG nova.network.neutron [req-10dcd45e-9653-49aa-ab00-82e9ab2236bb req-ddbda551-460d-4b5d-8f15-f24a23f0b759 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Updated VIF entry in instance network info cache for port 809292ba-1131-47d4-8b1c-b7cef6888d76. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG nova.network.neutron [req-10dcd45e-9653-49aa-ab00-82e9ab2236bb req-ddbda551-460d-4b5d-8f15-f24a23f0b759 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Updating instance_info_cache with network_info: [{"id": "809292ba-1131-47d4-8b1c-b7cef6888d76", "address": "fa:16:3e:83:78:ca", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809292ba-11", "ovs_interfaceid": "809292ba-1131-47d4-8b1c-b7cef6888d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:23:24 user nova-compute[70243]: INFO nova.compute.manager [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Took 1.11 seconds to destroy the instance on the hypervisor.
Jul 24 16:23:24 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-10dcd45e-9653-49aa-ab00-82e9ab2236bb req-ddbda551-460d-4b5d-8f15-f24a23f0b759 service nova] Releasing lock "refresh_cache-b0dd6065-3916-4f0e-841e-3df5ded2e2ee" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-40e08e26-bd83-4a21-bd48-5c2e81ba9e8c req-ef05210a-996c-4de7-95d3-808956497a4b service nova] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Received event network-vif-unplugged-98ae14d1-ca47-4ba3-9327-5bfecb545a5d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-40e08e26-bd83-4a21-bd48-5c2e81ba9e8c req-ef05210a-996c-4de7-95d3-808956497a4b service nova] Acquiring lock "d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-40e08e26-bd83-4a21-bd48-5c2e81ba9e8c req-ef05210a-996c-4de7-95d3-808956497a4b service nova] Lock "d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-40e08e26-bd83-4a21-bd48-5c2e81ba9e8c req-ef05210a-996c-4de7-95d3-808956497a4b service nova] Lock "d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-40e08e26-bd83-4a21-bd48-5c2e81ba9e8c req-ef05210a-996c-4de7-95d3-808956497a4b service nova] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] No waiting events found dispatching network-vif-unplugged-98ae14d1-ca47-4ba3-9327-5bfecb545a5d {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-40e08e26-bd83-4a21-bd48-5c2e81ba9e8c req-ef05210a-996c-4de7-95d3-808956497a4b service nova] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Received event network-vif-unplugged-98ae14d1-ca47-4ba3-9327-5bfecb545a5d for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-40e08e26-bd83-4a21-bd48-5c2e81ba9e8c req-ef05210a-996c-4de7-95d3-808956497a4b service nova] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Received event network-vif-plugged-98ae14d1-ca47-4ba3-9327-5bfecb545a5d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-40e08e26-bd83-4a21-bd48-5c2e81ba9e8c req-ef05210a-996c-4de7-95d3-808956497a4b service nova] Acquiring lock "d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-40e08e26-bd83-4a21-bd48-5c2e81ba9e8c req-ef05210a-996c-4de7-95d3-808956497a4b service nova] Lock "d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-40e08e26-bd83-4a21-bd48-5c2e81ba9e8c req-ef05210a-996c-4de7-95d3-808956497a4b service nova] Lock "d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-40e08e26-bd83-4a21-bd48-5c2e81ba9e8c req-ef05210a-996c-4de7-95d3-808956497a4b service nova] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] No waiting events found dispatching network-vif-plugged-98ae14d1-ca47-4ba3-9327-5bfecb545a5d {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:24 user nova-compute[70243]: WARNING nova.compute.manager [req-40e08e26-bd83-4a21-bd48-5c2e81ba9e8c req-ef05210a-996c-4de7-95d3-808956497a4b service nova] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Received unexpected event network-vif-plugged-98ae14d1-ca47-4ba3-9327-5bfecb545a5d for instance with vm_state active and task_state deleting.
Jul 24 16:23:25 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:23:25 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Took 0.65 seconds to deallocate network for instance.
Jul 24 16:23:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:25 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:23:25 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:23:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:25 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Deleted allocations for instance d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32
Jul 24 16:23:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-598aa12a-efca-407d-92e0-ae638c2e1af6 tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.477s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-b9a6db93-d945-479b-af51-d7e993123e63 req-bfaabc24-5b45-495f-8bb6-cb1388b2c7fe service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received event network-changed-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-b9a6db93-d945-479b-af51-d7e993123e63 req-bfaabc24-5b45-495f-8bb6-cb1388b2c7fe service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Refreshing instance network info cache due to event network-changed-809292ba-1131-47d4-8b1c-b7cef6888d76. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:23:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b9a6db93-d945-479b-af51-d7e993123e63 req-bfaabc24-5b45-495f-8bb6-cb1388b2c7fe service nova] Acquiring lock "refresh_cache-b0dd6065-3916-4f0e-841e-3df5ded2e2ee" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:23:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b9a6db93-d945-479b-af51-d7e993123e63 req-bfaabc24-5b45-495f-8bb6-cb1388b2c7fe service nova] Acquired lock "refresh_cache-b0dd6065-3916-4f0e-841e-3df5ded2e2ee" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:23:26 user nova-compute[70243]: DEBUG nova.network.neutron [req-b9a6db93-d945-479b-af51-d7e993123e63 req-bfaabc24-5b45-495f-8bb6-cb1388b2c7fe service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Refreshing network info cache for port 809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:23:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-ce27f3d9-77f0-4a85-8d27-7f5abc199591 req-9b0c6d33-26c0-4ec8-b033-02110af484fb service nova] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Received event network-vif-deleted-98ae14d1-ca47-4ba3-9327-5bfecb545a5d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:27 user nova-compute[70243]: DEBUG nova.network.neutron [req-b9a6db93-d945-479b-af51-d7e993123e63 req-bfaabc24-5b45-495f-8bb6-cb1388b2c7fe service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Updated VIF entry in instance network info cache for port 809292ba-1131-47d4-8b1c-b7cef6888d76. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:23:27 user nova-compute[70243]: DEBUG nova.network.neutron [req-b9a6db93-d945-479b-af51-d7e993123e63 req-bfaabc24-5b45-495f-8bb6-cb1388b2c7fe service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Updating instance_info_cache with network_info: [{"id": "809292ba-1131-47d4-8b1c-b7cef6888d76", "address": "fa:16:3e:83:78:ca", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809292ba-11", "ovs_interfaceid": "809292ba-1131-47d4-8b1c-b7cef6888d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:23:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b9a6db93-d945-479b-af51-d7e993123e63 req-bfaabc24-5b45-495f-8bb6-cb1388b2c7fe service nova] Releasing lock "refresh_cache-b0dd6065-3916-4f0e-841e-3df5ded2e2ee" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:23:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:31 user nova-compute[70243]: DEBUG nova.compute.manager [req-9afa7d5e-7a2f-4043-ac8d-3df0f7e4a1e9 req-def1c880-923b-4853-b9a3-95fbdc0250f0 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-changed-dabb3818-16d0-4d10-9912-15dd72754963 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:31 user nova-compute[70243]: DEBUG nova.compute.manager [req-9afa7d5e-7a2f-4043-ac8d-3df0f7e4a1e9 req-def1c880-923b-4853-b9a3-95fbdc0250f0 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Refreshing instance network info cache due to event network-changed-dabb3818-16d0-4d10-9912-15dd72754963. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:23:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9afa7d5e-7a2f-4043-ac8d-3df0f7e4a1e9 req-def1c880-923b-4853-b9a3-95fbdc0250f0 service nova] Acquiring lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:23:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9afa7d5e-7a2f-4043-ac8d-3df0f7e4a1e9 req-def1c880-923b-4853-b9a3-95fbdc0250f0 service nova] Acquired lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:23:31 user nova-compute[70243]: DEBUG nova.network.neutron [req-9afa7d5e-7a2f-4043-ac8d-3df0f7e4a1e9 req-def1c880-923b-4853-b9a3-95fbdc0250f0 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Refreshing network info cache for port dabb3818-16d0-4d10-9912-15dd72754963 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:23:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:32 user nova-compute[70243]: INFO nova.compute.manager [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Rebooting instance
Jul 24 16:23:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "refresh_cache-b0dd6065-3916-4f0e-841e-3df5ded2e2ee" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:23:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquired lock "refresh_cache-b0dd6065-3916-4f0e-841e-3df5ded2e2ee" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:23:32 user nova-compute[70243]: DEBUG nova.network.neutron [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:23:32 user nova-compute[70243]: DEBUG nova.network.neutron [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Updating instance_info_cache with network_info: [{"id": "809292ba-1131-47d4-8b1c-b7cef6888d76", "address": "fa:16:3e:83:78:ca", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809292ba-11", "ovs_interfaceid": "809292ba-1131-47d4-8b1c-b7cef6888d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:23:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Releasing lock "refresh_cache-b0dd6065-3916-4f0e-841e-3df5ded2e2ee" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:23:32 user nova-compute[70243]: DEBUG nova.compute.manager [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:23:32 user nova-compute[70243]: DEBUG nova.network.neutron [req-9afa7d5e-7a2f-4043-ac8d-3df0f7e4a1e9 req-def1c880-923b-4853-b9a3-95fbdc0250f0 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Updated VIF entry in instance network info cache for port dabb3818-16d0-4d10-9912-15dd72754963. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:23:32 user nova-compute[70243]: DEBUG nova.network.neutron [req-9afa7d5e-7a2f-4043-ac8d-3df0f7e4a1e9 req-def1c880-923b-4853-b9a3-95fbdc0250f0 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Updating instance_info_cache with network_info: [{"id": "dabb3818-16d0-4d10-9912-15dd72754963", "address": "fa:16:3e:d6:1b:31", "network": {"id": "f0c2213f-980e-4179-b927-2472447e6418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253590851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdabb3818-16", "ovs_interfaceid": "dabb3818-16d0-4d10-9912-15dd72754963", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "address": "fa:16:3e:ac:a6:57", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d99894-04", "ovs_interfaceid": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c469bd25-6546-47e3-92f6-96674f256be6", "address": "fa:16:3e:e4:76:c9", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc469bd25-65", "ovs_interfaceid": "c469bd25-6546-47e3-92f6-96674f256be6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "address": "fa:16:3e:35:0c:a4", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2077cf2-6c", "ovs_interfaceid": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "address": "fa:16:3e:6f:63:28", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c70c07-ac", "ovs_interfaceid": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "address": "fa:16:3e:2d:f2:1f", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee32acf5-1e", "ovs_interfaceid": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "address": "fa:16:3e:ed:cc:00", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71b975d-1e", "ovs_interfaceid": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9afa7d5e-7a2f-4043-ac8d-3df0f7e4a1e9 req-def1c880-923b-4853-b9a3-95fbdc0250f0 service nova] Releasing lock "refresh_cache-edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG nova.compute.manager [req-a287ac9c-e6f7-48bc-b5bb-0f16b5d00926 req-444e3116-fc39-40c8-802b-671dc25ad6a3 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received event network-vif-unplugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a287ac9c-e6f7-48bc-b5bb-0f16b5d00926 req-444e3116-fc39-40c8-802b-671dc25ad6a3 service nova] Acquiring lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a287ac9c-e6f7-48bc-b5bb-0f16b5d00926 req-444e3116-fc39-40c8-802b-671dc25ad6a3 service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a287ac9c-e6f7-48bc-b5bb-0f16b5d00926 req-444e3116-fc39-40c8-802b-671dc25ad6a3 service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG nova.compute.manager [req-a287ac9c-e6f7-48bc-b5bb-0f16b5d00926 req-444e3116-fc39-40c8-802b-671dc25ad6a3 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] No waiting events found dispatching network-vif-unplugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:33 user nova-compute[70243]: WARNING nova.compute.manager [req-a287ac9c-e6f7-48bc-b5bb-0f16b5d00926 req-444e3116-fc39-40c8-802b-671dc25ad6a3 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received unexpected event network-vif-unplugged-809292ba-1131-47d4-8b1c-b7cef6888d76 for instance with vm_state active and task_state reboot_started_hard.
Jul 24 16:23:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:33 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Instance destroyed successfully.
Jul 24 16:23:33 user nova-compute[70243]: DEBUG nova.objects.instance [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lazy-loading 'resources' on Instance uuid b0dd6065-3916-4f0e-841e-3df5ded2e2ee {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:21:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1754472195',display_name='tempest-TestMinimumBasicScenario-server-1754472195',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1754472195',id=12,image_ref='8228346d-44e7-4ff6-b55b-4929f4f18bca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzGIWh6T2nUwb11FT+HtBESAvQ3hfo4+kEpo2+0LOmZUrfs6OWjVXST2j/4MrpprDkytp9u/w90mIXmIV1/h+Jz0Mg6RkFV18VlGrbzGlqDpU/RgMYi9/VsCvHQTx94cw==',key_name='tempest-TestMinimumBasicScenario-386090327',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:21:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65ea0e23a23640a5b71e3269c6f1115c',ramdisk_id='',reservation_id='r-95m0c446',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8228346d-44e7-4ff6-b55b-4929f4f18bca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2131001827',owner_user_name='tempest-TestMinimumBasicScenario-2131001827-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:23:33Z,user_data=None,user_id='83ec3411adf049b190874e4923f49472',uuid=b0dd6065-3916-4f0e-841e-3df5ded2e2ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "809292ba-1131-47d4-8b1c-b7cef6888d76", "address": "fa:16:3e:83:78:ca", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809292ba-11", "ovs_interfaceid": "809292ba-1131-47d4-8b1c-b7cef6888d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Converting VIF {"id": "809292ba-1131-47d4-8b1c-b7cef6888d76", "address": "fa:16:3e:83:78:ca", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809292ba-11", "ovs_interfaceid": "809292ba-1131-47d4-8b1c-b7cef6888d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=809292ba-1131-47d4-8b1c-b7cef6888d76,network=Network(8320b285-1c9b-4a9a-980a-5a37682cfde2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809292ba-11') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG os_vif [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=809292ba-1131-47d4-8b1c-b7cef6888d76,network=Network(8320b285-1c9b-4a9a-980a-5a37682cfde2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809292ba-11') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap809292ba-11, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:33 user nova-compute[70243]: INFO os_vif [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=809292ba-1131-47d4-8b1c-b7cef6888d76,network=Network(8320b285-1c9b-4a9a-980a-5a37682cfde2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809292ba-11')
Jul 24 16:23:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFvxVoyb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:23:33 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:23:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbef797a-7ae2-4288-9d80-5254e52bd488]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:23:33 user nova-compute[70243]: No targets found.
Jul 24 16:23:33 user nova-compute[70243]: iSNS:
Jul 24 16:23:33 user nova-compute[70243]: No targets found.
Jul 24 16:23:33 user nova-compute[70243]: STATIC:
Jul 24 16:23:33 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b
Jul 24 16:23:33 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:33 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:33 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5
Jul 24 16:23:33 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:33 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:33 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323
Jul 24 16:23:33 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:33 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:33 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b
Jul 24 16:23:33 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:33 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:33 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73
Jul 24 16:23:33 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:33 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:33 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b
Jul 24 16:23:33 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:33 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:33 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c
Jul 24 16:23:33 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:33 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:33 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30
Jul 24 16:23:33 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:33 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:33 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b
Jul 24 16:23:33 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:33 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:33 user nova-compute[70243]: FIRMWARE:
Jul 24 16:23:33 user nova-compute[70243]: No targets found.
Jul 24 16:23:33 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:23:33 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:23:33 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d167ae99-d2b0-4684-98e3-aa3fe0623295]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2acc79d-a8b3-46c3-9b9c-c3e036fd9f96]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:23:34 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:23:34 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc7b71c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323'): ({'sdj'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Removing single pathed devices sdj {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b89cc2-3640-43e0-b275-b60efef39612]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22b9a57-bc8f-45c8-9de9-128c968688a7]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Flushing IO for device /dev/sdj {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.033s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87212ca-f98c-4df2-8c31-034cd3525a55]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.039s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[975cc810-c3f5-4839-911b-df0467d07b6f]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] SCSI volumes sdj have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7e7c1c-c5e2-4aef-8503-94859568985e]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[78339858-e170-485b-82e3-aac712d119ca]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323, portal: 172.16.0.220,3260]
Jul 24 16:23:34 user nova-compute[70243]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323, portal: 172.16.0.220,3260] successful.
Jul 24 16:23:34 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75267af-0ba3-4cd3-98ff-c05f9d2805d8]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.455s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] <== disconnect_volume: return (456ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Start _get_guest_xml network_info=[{"id": "809292ba-1131-47d4-8b1c-b7cef6888d76", "address": "fa:16:3e:83:78:ca", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809292ba-11", "ovs_interfaceid": "809292ba-1131-47d4-8b1c-b7cef6888d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8228346d-44e7-4ff6-b55b-4929f4f18bca,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '8228346d-44e7-4ff6-b55b-4929f4f18bca'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFvxVoyb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'b0dd6065-3916-4f0e-841e-3df5ded2e2ee', 'attached_at': '', 'detached_at': '', 'volume_id': '83ffe933-b556-46eb-b3eb-b77f6c75e323', 'serial': '83ffe933-b556-46eb-b3eb-b77f6c75e323'}, 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '0d72ca40-5bd1-4a3b-b909-582497951c54', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:23:34 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:23:34 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:23:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8228346d-44e7-4ff6-b55b-4929f4f18bca,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG nova.objects.instance [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lazy-loading 'vcpu_model' on Instance uuid b0dd6065-3916-4f0e-841e-3df5ded2e2ee {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFvxVoyb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:23:34 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:23:34 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:23:34 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[63321fc1-c0fb-4ce7-8f69-e90ba155f514]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:23:34 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8febb17b-1efb-49eb-be54-9cda0bfe6f0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323] added
Jul 24 16:23:34 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[17245f13-3225-441f-ba1a-7f23c78f92c9]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc60f5dd-7fbe-4184-81ae-75279d3da6c9]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nFvxVoyb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nFvxVoyb" returned: 0 in 0.035s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10124a2-b883-4d7a-86de-21e6caa26b7d]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nFvxVoyb'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d7d8c1-2470-47a6-bf37-00770241d047]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ff6acf-96be-4056-9c2e-010961139589]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:34 user nova-compute[70243]: INFO nova.compute.manager [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Terminating instance
Jul 24 16:23:34 user nova-compute[70243]: DEBUG nova.compute.manager [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --login" returned: 0 in 0.113s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5031bc-a585-49df-8a54-15c6f0c6f97d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323, portal: 172.16.0.220,3260]
Jul 24 16:23:34 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323, portal: 172.16.0.220,3260] successful.
Jul 24 16:23:34 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcebc3f-5534-4652-af04-852f7196aefb]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.054s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d6e0d5-fb4d-430c-93ac-0f72479b1e65]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:23:34 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:23:34 user nova-compute[70243]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:23:34 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.442s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] HCTL ('41', '-', '-', 0) found on session 26 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5329ccf0-98dc-42bb-9719-5419fe4491b0]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Searching for a device in session 26 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFvxVoyb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:23:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-e34fa2f7-9316-4e6d-8816-b1de0b82c701 req-70b1a221-7b94-40f1-8540-de0e2804a860 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-unplugged-dabb3818-16d0-4d10-9912-15dd72754963 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e34fa2f7-9316-4e6d-8816-b1de0b82c701 req-70b1a221-7b94-40f1-8540-de0e2804a860 service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e34fa2f7-9316-4e6d-8816-b1de0b82c701 req-70b1a221-7b94-40f1-8540-de0e2804a860 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e34fa2f7-9316-4e6d-8816-b1de0b82c701 req-70b1a221-7b94-40f1-8540-de0e2804a860 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-e34fa2f7-9316-4e6d-8816-b1de0b82c701 req-70b1a221-7b94-40f1-8540-de0e2804a860 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-unplugged-dabb3818-16d0-4d10-9912-15dd72754963 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-e34fa2f7-9316-4e6d-8816-b1de0b82c701 req-70b1a221-7b94-40f1-8540-de0e2804a860 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-unplugged-dabb3818-16d0-4d10-9912-15dd72754963 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-13a219b3-717a-4c8b-8200-a5badf16e5e7 req-f1c53eb5-240c-4891-8349-df0730525a57 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-unplugged-15d99894-04b8-415b-a03a-ccc794f9d8dc {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-13a219b3-717a-4c8b-8200-a5badf16e5e7 req-f1c53eb5-240c-4891-8349-df0730525a57 service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-13a219b3-717a-4c8b-8200-a5badf16e5e7 req-f1c53eb5-240c-4891-8349-df0730525a57 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-13a219b3-717a-4c8b-8200-a5badf16e5e7 req-f1c53eb5-240c-4891-8349-df0730525a57 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-13a219b3-717a-4c8b-8200-a5badf16e5e7 req-f1c53eb5-240c-4891-8349-df0730525a57 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-unplugged-15d99894-04b8-415b-a03a-ccc794f9d8dc {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-13a219b3-717a-4c8b-8200-a5badf16e5e7 req-f1c53eb5-240c-4891-8349-df0730525a57 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-unplugged-15d99894-04b8-415b-a03a-ccc794f9d8dc for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-1823acd9-7b3c-4469-85b5-69d0b93aca20 req-13a692d1-cbc1-4ad8-b66f-9501ce3668b8 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received event network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1823acd9-7b3c-4469-85b5-69d0b93aca20 req-13a692d1-cbc1-4ad8-b66f-9501ce3668b8 service nova] Acquiring lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1823acd9-7b3c-4469-85b5-69d0b93aca20 req-13a692d1-cbc1-4ad8-b66f-9501ce3668b8 service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1823acd9-7b3c-4469-85b5-69d0b93aca20 req-13a692d1-cbc1-4ad8-b66f-9501ce3668b8 service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-1823acd9-7b3c-4469-85b5-69d0b93aca20 req-13a692d1-cbc1-4ad8-b66f-9501ce3668b8 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] No waiting events found dispatching network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:35 user nova-compute[70243]: WARNING nova.compute.manager [req-1823acd9-7b3c-4469-85b5-69d0b93aca20 req-13a692d1-cbc1-4ad8-b66f-9501ce3668b8 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received unexpected event network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 for instance with vm_state active and task_state reboot_started_hard.
Jul 24 16:23:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-1823acd9-7b3c-4469-85b5-69d0b93aca20 req-13a692d1-cbc1-4ad8-b66f-9501ce3668b8 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received event network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1823acd9-7b3c-4469-85b5-69d0b93aca20 req-13a692d1-cbc1-4ad8-b66f-9501ce3668b8 service nova] Acquiring lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1823acd9-7b3c-4469-85b5-69d0b93aca20 req-13a692d1-cbc1-4ad8-b66f-9501ce3668b8 service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1823acd9-7b3c-4469-85b5-69d0b93aca20 req-13a692d1-cbc1-4ad8-b66f-9501ce3668b8 service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-1823acd9-7b3c-4469-85b5-69d0b93aca20 req-13a692d1-cbc1-4ad8-b66f-9501ce3668b8 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] No waiting events found dispatching network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:35 user nova-compute[70243]: WARNING nova.compute.manager [req-1823acd9-7b3c-4469-85b5-69d0b93aca20 req-13a692d1-cbc1-4ad8-b66f-9501ce3668b8 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received unexpected event network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 for instance with vm_state active and task_state reboot_started_hard.
Jul 24 16:23:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-1823acd9-7b3c-4469-85b5-69d0b93aca20 req-13a692d1-cbc1-4ad8-b66f-9501ce3668b8 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received event network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1823acd9-7b3c-4469-85b5-69d0b93aca20 req-13a692d1-cbc1-4ad8-b66f-9501ce3668b8 service nova] Acquiring lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1823acd9-7b3c-4469-85b5-69d0b93aca20 req-13a692d1-cbc1-4ad8-b66f-9501ce3668b8 service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1823acd9-7b3c-4469-85b5-69d0b93aca20 req-13a692d1-cbc1-4ad8-b66f-9501ce3668b8 service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-1823acd9-7b3c-4469-85b5-69d0b93aca20 req-13a692d1-cbc1-4ad8-b66f-9501ce3668b8 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] No waiting events found dispatching network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:35 user nova-compute[70243]: WARNING nova.compute.manager [req-1823acd9-7b3c-4469-85b5-69d0b93aca20 req-13a692d1-cbc1-4ad8-b66f-9501ce3668b8 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received unexpected event network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 for instance with vm_state active and task_state reboot_started_hard.
Jul 24 16:23:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.498s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] <== connect_volume: return (1500ms) {'type': 'block', 'scsi_wwn': '23035646636316430', 'path': '/dev/sdj'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:23:35 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035646636316430', 'path': '/dev/sdj'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:21:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1754472195',display_name='tempest-TestMinimumBasicScenario-server-1754472195',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1754472195',id=12,image_ref='8228346d-44e7-4ff6-b55b-4929f4f18bca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzGIWh6T2nUwb11FT+HtBESAvQ3hfo4+kEpo2+0LOmZUrfs6OWjVXST2j/4MrpprDkytp9u/w90mIXmIV1/h+Jz0Mg6RkFV18VlGrbzGlqDpU/RgMYi9/VsCvHQTx94cw==',key_name='tempest-TestMinimumBasicScenario-386090327',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:21:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65ea0e23a23640a5b71e3269c6f1115c',ramdisk_id='',reservation_id='r-95m0c446',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8228346d-44e7-4ff6-b55b-4929f4f18bca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2131001827',owner_user_name='tempest-TestMinimumBasicScenario-2131001827-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:23:33Z,user_data=None,user_id='83ec3411adf049b190874e4923f49472',uuid=b0dd6065-3916-4f0e-841e-3df5ded2e2ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "809292ba-1131-47d4-8b1c-b7cef6888d76", "address": "fa:16:3e:83:78:ca", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809292ba-11", "ovs_interfaceid": "809292ba-1131-47d4-8b1c-b7cef6888d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Converting VIF {"id": "809292ba-1131-47d4-8b1c-b7cef6888d76", "address": "fa:16:3e:83:78:ca", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809292ba-11", "ovs_interfaceid": "809292ba-1131-47d4-8b1c-b7cef6888d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=809292ba-1131-47d4-8b1c-b7cef6888d76,network=Network(8320b285-1c9b-4a9a-980a-5a37682cfde2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809292ba-11') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.objects.instance [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lazy-loading 'pci_devices' on Instance uuid b0dd6065-3916-4f0e-841e-3df5ded2e2ee {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:23:36 user nova-compute[70243]:   <uuid>b0dd6065-3916-4f0e-841e-3df5ded2e2ee</uuid>
Jul 24 16:23:36 user nova-compute[70243]:   <name>instance-0000000c</name>
Jul 24 16:23:36 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:23:36 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:23:36 user nova-compute[70243]:   <metadata>
Jul 24 16:23:36 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:23:36 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:23:36 user nova-compute[70243]:       <nova:name>tempest-TestMinimumBasicScenario-server-1754472195</nova:name>
Jul 24 16:23:36 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:23:34</nova:creationTime>
Jul 24 16:23:36 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:23:36 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:23:36 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:23:36 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:23:36 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:23:36 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:23:36 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:23:36 user nova-compute[70243]:       <nova:owner>
Jul 24 16:23:36 user nova-compute[70243]:         <nova:user uuid="83ec3411adf049b190874e4923f49472">tempest-TestMinimumBasicScenario-2131001827-project-member</nova:user>
Jul 24 16:23:36 user nova-compute[70243]:         <nova:project uuid="65ea0e23a23640a5b71e3269c6f1115c">tempest-TestMinimumBasicScenario-2131001827</nova:project>
Jul 24 16:23:36 user nova-compute[70243]:       </nova:owner>
Jul 24 16:23:36 user nova-compute[70243]:       <nova:root type="image" uuid="8228346d-44e7-4ff6-b55b-4929f4f18bca"/>
Jul 24 16:23:36 user nova-compute[70243]:       <nova:ports>
Jul 24 16:23:36 user nova-compute[70243]:         <nova:port uuid="809292ba-1131-47d4-8b1c-b7cef6888d76">
Jul 24 16:23:36 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 16:23:36 user nova-compute[70243]:         </nova:port>
Jul 24 16:23:36 user nova-compute[70243]:       </nova:ports>
Jul 24 16:23:36 user nova-compute[70243]:     </nova:instance>
Jul 24 16:23:36 user nova-compute[70243]:   </metadata>
Jul 24 16:23:36 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:23:36 user nova-compute[70243]:     <system>
Jul 24 16:23:36 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:23:36 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:23:36 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:23:36 user nova-compute[70243]:       <entry name="serial">b0dd6065-3916-4f0e-841e-3df5ded2e2ee</entry>
Jul 24 16:23:36 user nova-compute[70243]:       <entry name="uuid">b0dd6065-3916-4f0e-841e-3df5ded2e2ee</entry>
Jul 24 16:23:36 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:23:36 user nova-compute[70243]:     </system>
Jul 24 16:23:36 user nova-compute[70243]:   </sysinfo>
Jul 24 16:23:36 user nova-compute[70243]:   <os>
Jul 24 16:23:36 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:23:36 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:23:36 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:23:36 user nova-compute[70243]:   </os>
Jul 24 16:23:36 user nova-compute[70243]:   <features>
Jul 24 16:23:36 user nova-compute[70243]:     <acpi/>
Jul 24 16:23:36 user nova-compute[70243]:     <apic/>
Jul 24 16:23:36 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:23:36 user nova-compute[70243]:   </features>
Jul 24 16:23:36 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:23:36 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:23:36 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:23:36 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:23:36 user nova-compute[70243]:   </clock>
Jul 24 16:23:36 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:23:36 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:23:36 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:23:36 user nova-compute[70243]:   </cpu>
Jul 24 16:23:36 user nova-compute[70243]:   <devices>
Jul 24 16:23:36 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:23:36 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:23:36 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk"/>
Jul 24 16:23:36 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:23:36 user nova-compute[70243]:     </disk>
Jul 24 16:23:36 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:23:36 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:23:36 user nova-compute[70243]:       <source dev="/dev/sdj"/>
Jul 24 16:23:36 user nova-compute[70243]:       <target dev="vdb" bus="virtio"/>
Jul 24 16:23:36 user nova-compute[70243]:       <serial>83ffe933-b556-46eb-b3eb-b77f6c75e323</serial>
Jul 24 16:23:36 user nova-compute[70243]:     </disk>
Jul 24 16:23:36 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:23:36 user nova-compute[70243]:       <mac address="fa:16:3e:83:78:ca"/>
Jul 24 16:23:36 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:23:36 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:23:36 user nova-compute[70243]:       <target dev="tap809292ba-11"/>
Jul 24 16:23:36 user nova-compute[70243]:     </interface>
Jul 24 16:23:36 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:23:36 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/console.log" append="off"/>
Jul 24 16:23:36 user nova-compute[70243]:     </serial>
Jul 24 16:23:36 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:23:36 user nova-compute[70243]:     <video>
Jul 24 16:23:36 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:23:36 user nova-compute[70243]:     </video>
Jul 24 16:23:36 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:23:36 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:23:36 user nova-compute[70243]:     </rng>
Jul 24 16:23:36 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:23:36 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:23:36 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:23:36 user nova-compute[70243]:     </memballoon>
Jul 24 16:23:36 user nova-compute[70243]:   </devices>
Jul 24 16:23:36 user nova-compute[70243]: </domain>
Jul 24 16:23:36 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.objects.instance [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lazy-loading 'trusted_certs' on Instance uuid b0dd6065-3916-4f0e-841e-3df5ded2e2ee {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd58bbfe467ea6c97ad2003501c730cf628bb7e3 --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:36 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Instance destroyed successfully.
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.objects.instance [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lazy-loading 'resources' on Instance uuid edf964e0-bee8-42c8-b4eb-dd490d3fa2ab {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-488468712',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-488468712',id=14,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PUuPlsoV8RAEroCr7yqwqWCbzL6gt5zhn8mBhOM1I200TRSrsoWL78JDc5i5DfcY+plTXx5ph8drPnUVxltX5H2XI9hczCgCzgFO1tUHzOc8Y+UBeKfw9JDlNegfFzA==',key_name='tempest-keypair-608430385',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:22:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1580d59d0e041ec980753d98a90158a',ramdisk_id='',reservation_id='r-bng46r0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1365347111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1365347111-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:22:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a20e83d9f14ba69a4e552a1ac7b985',uuid=edf964e0-bee8-42c8-b4eb-dd490d3fa2ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dabb3818-16d0-4d10-9912-15dd72754963", "address": "fa:16:3e:d6:1b:31", "network": {"id": "f0c2213f-980e-4179-b927-2472447e6418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253590851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdabb3818-16", "ovs_interfaceid": "dabb3818-16d0-4d10-9912-15dd72754963", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converting VIF {"id": "dabb3818-16d0-4d10-9912-15dd72754963", "address": "fa:16:3e:d6:1b:31", "network": {"id": "f0c2213f-980e-4179-b927-2472447e6418", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1253590851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdabb3818-16", "ovs_interfaceid": "dabb3818-16d0-4d10-9912-15dd72754963", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:1b:31,bridge_name='br-int',has_traffic_filtering=True,id=dabb3818-16d0-4d10-9912-15dd72754963,network=Network(f0c2213f-980e-4179-b927-2472447e6418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdabb3818-16') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG os_vif [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:1b:31,bridge_name='br-int',has_traffic_filtering=True,id=dabb3818-16d0-4d10-9912-15dd72754963,network=Network(f0c2213f-980e-4179-b927-2472447e6418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdabb3818-16') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdabb3818-16, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd58bbfe467ea6c97ad2003501c730cf628bb7e3 --force-share --output=json" returned: 0 in 0.297s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:36 user nova-compute[70243]: INFO os_vif [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:1b:31,bridge_name='br-int',has_traffic_filtering=True,id=dabb3818-16d0-4d10-9912-15dd72754963,network=Network(f0c2213f-980e-4179-b927-2472447e6418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdabb3818-16')
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-488468712',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-488468712',id=14,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PUuPlsoV8RAEroCr7yqwqWCbzL6gt5zhn8mBhOM1I200TRSrsoWL78JDc5i5DfcY+plTXx5ph8drPnUVxltX5H2XI9hczCgCzgFO1tUHzOc8Y+UBeKfw9JDlNegfFzA==',key_name='tempest-keypair-608430385',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:22:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1580d59d0e041ec980753d98a90158a',ramdisk_id='',reservation_id='r-bng46r0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1365347111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1365347111-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:22:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a20e83d9f14ba69a4e552a1ac7b985',uuid=edf964e0-bee8-42c8-b4eb-dd490d3fa2ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "address": "fa:16:3e:ac:a6:57", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d99894-04", "ovs_interfaceid": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converting VIF {"id": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "address": "fa:16:3e:ac:a6:57", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d99894-04", "ovs_interfaceid": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:a6:57,bridge_name='br-int',has_traffic_filtering=True,id=15d99894-04b8-415b-a03a-ccc794f9d8dc,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15d99894-04') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG os_vif [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:a6:57,bridge_name='br-int',has_traffic_filtering=True,id=15d99894-04b8-415b-a03a-ccc794f9d8dc,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15d99894-04') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15d99894-04, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Cannot resize image /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.objects.instance [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lazy-loading 'migration_context' on Instance uuid b0dd6065-3916-4f0e-841e-3df5ded2e2ee {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:21:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1754472195',display_name='tempest-TestMinimumBasicScenario-server-1754472195',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1754472195',id=12,image_ref='8228346d-44e7-4ff6-b55b-4929f4f18bca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzGIWh6T2nUwb11FT+HtBESAvQ3hfo4+kEpo2+0LOmZUrfs6OWjVXST2j/4MrpprDkytp9u/w90mIXmIV1/h+Jz0Mg6RkFV18VlGrbzGlqDpU/RgMYi9/VsCvHQTx94cw==',key_name='tempest-TestMinimumBasicScenario-386090327',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:21:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='65ea0e23a23640a5b71e3269c6f1115c',ramdisk_id='',reservation_id='r-95m0c446',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8228346d-44e7-4ff6-b55b-4929f4f18bca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2131001827',owner_user_name='tempest-TestMinimumBasicScenario-2131001827-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:23:33Z,user_data=None,user_id='83ec3411adf049b190874e4923f49472',uuid=b0dd6065-3916-4f0e-841e-3df5ded2e2ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "809292ba-1131-47d4-8b1c-b7cef6888d76", "address": "fa:16:3e:83:78:ca", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809292ba-11", "ovs_interfaceid": "809292ba-1131-47d4-8b1c-b7cef6888d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Converting VIF {"id": "809292ba-1131-47d4-8b1c-b7cef6888d76", "address": "fa:16:3e:83:78:ca", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809292ba-11", "ovs_interfaceid": "809292ba-1131-47d4-8b1c-b7cef6888d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=809292ba-1131-47d4-8b1c-b7cef6888d76,network=Network(8320b285-1c9b-4a9a-980a-5a37682cfde2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809292ba-11') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG os_vif [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=809292ba-1131-47d4-8b1c-b7cef6888d76,network=Network(8320b285-1c9b-4a9a-980a-5a37682cfde2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809292ba-11') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:23:36 user nova-compute[70243]: INFO os_vif [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:a6:57,bridge_name='br-int',has_traffic_filtering=True,id=15d99894-04b8-415b-a03a-ccc794f9d8dc,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15d99894-04')
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-488468712',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-488468712',id=14,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PUuPlsoV8RAEroCr7yqwqWCbzL6gt5zhn8mBhOM1I200TRSrsoWL78JDc5i5DfcY+plTXx5ph8drPnUVxltX5H2XI9hczCgCzgFO1tUHzOc8Y+UBeKfw9JDlNegfFzA==',key_name='tempest-keypair-608430385',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:22:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1580d59d0e041ec980753d98a90158a',ramdisk_id='',reservation_id='r-bng46r0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1365347111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1365347111-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:22:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a20e83d9f14ba69a4e552a1ac7b985',uuid=edf964e0-bee8-42c8-b4eb-dd490d3fa2ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c469bd25-6546-47e3-92f6-96674f256be6", "address": "fa:16:3e:e4:76:c9", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc469bd25-65", "ovs_interfaceid": "c469bd25-6546-47e3-92f6-96674f256be6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converting VIF {"id": "c469bd25-6546-47e3-92f6-96674f256be6", "address": "fa:16:3e:e4:76:c9", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc469bd25-65", "ovs_interfaceid": "c469bd25-6546-47e3-92f6-96674f256be6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:76:c9,bridge_name='br-int',has_traffic_filtering=True,id=c469bd25-6546-47e3-92f6-96674f256be6,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc469bd25-65') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:23:36 user nova-compute[70243]: DEBUG os_vif [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:76:c9,bridge_name='br-int',has_traffic_filtering=True,id=c469bd25-6546-47e3-92f6-96674f256be6,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc469bd25-65') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc469bd25-65, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap809292ba-11, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap809292ba-11, col_values=(('external_ids', {'iface-id': '809292ba-1131-47d4-8b1c-b7cef6888d76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:78:ca', 'vm-uuid': 'b0dd6065-3916-4f0e-841e-3df5ded2e2ee'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:37 user nova-compute[70243]: INFO os_vif [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:76:c9,bridge_name='br-int',has_traffic_filtering=True,id=c469bd25-6546-47e3-92f6-96674f256be6,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc469bd25-65')
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-488468712',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-488468712',id=14,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PUuPlsoV8RAEroCr7yqwqWCbzL6gt5zhn8mBhOM1I200TRSrsoWL78JDc5i5DfcY+plTXx5ph8drPnUVxltX5H2XI9hczCgCzgFO1tUHzOc8Y+UBeKfw9JDlNegfFzA==',key_name='tempest-keypair-608430385',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:22:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1580d59d0e041ec980753d98a90158a',ramdisk_id='',reservation_id='r-bng46r0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1365347111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1365347111-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:22:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a20e83d9f14ba69a4e552a1ac7b985',uuid=edf964e0-bee8-42c8-b4eb-dd490d3fa2ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "address": "fa:16:3e:35:0c:a4", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2077cf2-6c", "ovs_interfaceid": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converting VIF {"id": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "address": "fa:16:3e:35:0c:a4", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2077cf2-6c", "ovs_interfaceid": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:0c:a4,bridge_name='br-int',has_traffic_filtering=True,id=a2077cf2-6cf5-47e2-b50e-22625dd1c118,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2077cf2-6c') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_vif [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:0c:a4,bridge_name='br-int',has_traffic_filtering=True,id=a2077cf2-6cf5-47e2-b50e-22625dd1c118,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2077cf2-6c') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:37 user nova-compute[70243]: INFO os_vif [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=809292ba-1131-47d4-8b1c-b7cef6888d76,network=Network(8320b285-1c9b-4a9a-980a-5a37682cfde2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809292ba-11')
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2077cf2-6c, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:37 user nova-compute[70243]: INFO os_vif [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:0c:a4,bridge_name='br-int',has_traffic_filtering=True,id=a2077cf2-6cf5-47e2-b50e-22625dd1c118,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2077cf2-6c')
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-488468712',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-488468712',id=14,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PUuPlsoV8RAEroCr7yqwqWCbzL6gt5zhn8mBhOM1I200TRSrsoWL78JDc5i5DfcY+plTXx5ph8drPnUVxltX5H2XI9hczCgCzgFO1tUHzOc8Y+UBeKfw9JDlNegfFzA==',key_name='tempest-keypair-608430385',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:22:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1580d59d0e041ec980753d98a90158a',ramdisk_id='',reservation_id='r-bng46r0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1365347111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1365347111-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:22:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a20e83d9f14ba69a4e552a1ac7b985',uuid=edf964e0-bee8-42c8-b4eb-dd490d3fa2ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "address": "fa:16:3e:6f:63:28", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c70c07-ac", "ovs_interfaceid": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converting VIF {"id": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "address": "fa:16:3e:6f:63:28", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c70c07-ac", "ovs_interfaceid": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:63:28,bridge_name='br-int',has_traffic_filtering=True,id=44c70c07-ac30-4af3-b1a2-5f886d4ca1c1,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c70c07-ac') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_vif [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:63:28,bridge_name='br-int',has_traffic_filtering=True,id=44c70c07-ac30-4af3-b1a2-5f886d4ca1c1,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c70c07-ac') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44c70c07-ac, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:37 user nova-compute[70243]: INFO os_vif [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:63:28,bridge_name='br-int',has_traffic_filtering=True,id=44c70c07-ac30-4af3-b1a2-5f886d4ca1c1,network=Network(956e3b99-d9e7-49a8-b80c-eebe543bb137),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c70c07-ac')
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-488468712',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-488468712',id=14,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PUuPlsoV8RAEroCr7yqwqWCbzL6gt5zhn8mBhOM1I200TRSrsoWL78JDc5i5DfcY+plTXx5ph8drPnUVxltX5H2XI9hczCgCzgFO1tUHzOc8Y+UBeKfw9JDlNegfFzA==',key_name='tempest-keypair-608430385',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:22:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1580d59d0e041ec980753d98a90158a',ramdisk_id='',reservation_id='r-bng46r0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1365347111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1365347111-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:22:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a20e83d9f14ba69a4e552a1ac7b985',uuid=edf964e0-bee8-42c8-b4eb-dd490d3fa2ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "address": "fa:16:3e:2d:f2:1f", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee32acf5-1e", "ovs_interfaceid": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converting VIF {"id": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "address": "fa:16:3e:2d:f2:1f", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee32acf5-1e", "ovs_interfaceid": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:1f,bridge_name='br-int',has_traffic_filtering=True,id=ee32acf5-1ead-4f29-b7a0-77a16d10778e,network=Network(3a15cd1c-bddd-4029-8b69-efb6444b93bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee32acf5-1e') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_vif [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:1f,bridge_name='br-int',has_traffic_filtering=True,id=ee32acf5-1ead-4f29-b7a0-77a16d10778e,network=Network(3a15cd1c-bddd-4029-8b69-efb6444b93bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee32acf5-1e') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee32acf5-1e, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-c5069b0e-c4bf-4646-9b48-fb99426ad5b6 req-ead3aed3-74cd-42a4-be42-924ebee5d726 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-plugged-dabb3818-16d0-4d10-9912-15dd72754963 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c5069b0e-c4bf-4646-9b48-fb99426ad5b6 req-ead3aed3-74cd-42a4-be42-924ebee5d726 service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c5069b0e-c4bf-4646-9b48-fb99426ad5b6 req-ead3aed3-74cd-42a4-be42-924ebee5d726 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c5069b0e-c4bf-4646-9b48-fb99426ad5b6 req-ead3aed3-74cd-42a4-be42-924ebee5d726 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-c5069b0e-c4bf-4646-9b48-fb99426ad5b6 req-ead3aed3-74cd-42a4-be42-924ebee5d726 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-plugged-dabb3818-16d0-4d10-9912-15dd72754963 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:37 user nova-compute[70243]: WARNING nova.compute.manager [req-c5069b0e-c4bf-4646-9b48-fb99426ad5b6 req-ead3aed3-74cd-42a4-be42-924ebee5d726 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received unexpected event network-vif-plugged-dabb3818-16d0-4d10-9912-15dd72754963 for instance with vm_state active and task_state deleting.
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-c5069b0e-c4bf-4646-9b48-fb99426ad5b6 req-ead3aed3-74cd-42a4-be42-924ebee5d726 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-unplugged-e71b975d-1eaa-46f2-b6a7-01771b71b484 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c5069b0e-c4bf-4646-9b48-fb99426ad5b6 req-ead3aed3-74cd-42a4-be42-924ebee5d726 service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c5069b0e-c4bf-4646-9b48-fb99426ad5b6 req-ead3aed3-74cd-42a4-be42-924ebee5d726 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c5069b0e-c4bf-4646-9b48-fb99426ad5b6 req-ead3aed3-74cd-42a4-be42-924ebee5d726 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-c5069b0e-c4bf-4646-9b48-fb99426ad5b6 req-ead3aed3-74cd-42a4-be42-924ebee5d726 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-unplugged-e71b975d-1eaa-46f2-b6a7-01771b71b484 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-c5069b0e-c4bf-4646-9b48-fb99426ad5b6 req-ead3aed3-74cd-42a4-be42-924ebee5d726 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-unplugged-e71b975d-1eaa-46f2-b6a7-01771b71b484 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-c5069b0e-c4bf-4646-9b48-fb99426ad5b6 req-ead3aed3-74cd-42a4-be42-924ebee5d726 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-plugged-e71b975d-1eaa-46f2-b6a7-01771b71b484 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c5069b0e-c4bf-4646-9b48-fb99426ad5b6 req-ead3aed3-74cd-42a4-be42-924ebee5d726 service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c5069b0e-c4bf-4646-9b48-fb99426ad5b6 req-ead3aed3-74cd-42a4-be42-924ebee5d726 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c5069b0e-c4bf-4646-9b48-fb99426ad5b6 req-ead3aed3-74cd-42a4-be42-924ebee5d726 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-c5069b0e-c4bf-4646-9b48-fb99426ad5b6 req-ead3aed3-74cd-42a4-be42-924ebee5d726 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-plugged-e71b975d-1eaa-46f2-b6a7-01771b71b484 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:37 user nova-compute[70243]: WARNING nova.compute.manager [req-c5069b0e-c4bf-4646-9b48-fb99426ad5b6 req-ead3aed3-74cd-42a4-be42-924ebee5d726 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received unexpected event network-vif-plugged-e71b975d-1eaa-46f2-b6a7-01771b71b484 for instance with vm_state active and task_state deleting.
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:37 user nova-compute[70243]: INFO os_vif [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:1f,bridge_name='br-int',has_traffic_filtering=True,id=ee32acf5-1ead-4f29-b7a0-77a16d10778e,network=Network(3a15cd1c-bddd-4029-8b69-efb6444b93bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee32acf5-1e')
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-488468712',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-488468712',id=14,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PUuPlsoV8RAEroCr7yqwqWCbzL6gt5zhn8mBhOM1I200TRSrsoWL78JDc5i5DfcY+plTXx5ph8drPnUVxltX5H2XI9hczCgCzgFO1tUHzOc8Y+UBeKfw9JDlNegfFzA==',key_name='tempest-keypair-608430385',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:22:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1580d59d0e041ec980753d98a90158a',ramdisk_id='',reservation_id='r-bng46r0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1365347111',owner_user_name='tempest-TaggedBootDevicesTest_v242-1365347111-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:22:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2a20e83d9f14ba69a4e552a1ac7b985',uuid=edf964e0-bee8-42c8-b4eb-dd490d3fa2ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "address": "fa:16:3e:ed:cc:00", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71b975d-1e", "ovs_interfaceid": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converting VIF {"id": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "address": "fa:16:3e:ed:cc:00", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71b975d-1e", "ovs_interfaceid": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:cc:00,bridge_name='br-int',has_traffic_filtering=True,id=e71b975d-1eaa-46f2-b6a7-01771b71b484,network=Network(3a15cd1c-bddd-4029-8b69-efb6444b93bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape71b975d-1e') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_vif [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:cc:00,bridge_name='br-int',has_traffic_filtering=True,id=e71b975d-1eaa-46f2-b6a7-01771b71b484,network=Network(3a15cd1c-bddd-4029-8b69-efb6444b93bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape71b975d-1e') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape71b975d-1e, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:37 user nova-compute[70243]: INFO os_vif [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:cc:00,bridge_name='br-int',has_traffic_filtering=True,id=e71b975d-1eaa-46f2-b6a7-01771b71b484,network=Network(3a15cd1c-bddd-4029-8b69-efb6444b93bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape71b975d-1e')
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsiWyznj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:23:37 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-plugged-15d99894-04b8-415b-a03a-ccc794f9d8dc {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-plugged-15d99894-04b8-415b-a03a-ccc794f9d8dc {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:37 user nova-compute[70243]: WARNING nova.compute.manager [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received unexpected event network-vif-plugged-15d99894-04b8-415b-a03a-ccc794f9d8dc for instance with vm_state active and task_state deleting.
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-unplugged-c469bd25-6546-47e3-92f6-96674f256be6 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-unplugged-c469bd25-6546-47e3-92f6-96674f256be6 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-unplugged-c469bd25-6546-47e3-92f6-96674f256be6 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-plugged-c469bd25-6546-47e3-92f6-96674f256be6 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-plugged-c469bd25-6546-47e3-92f6-96674f256be6 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:37 user nova-compute[70243]: WARNING nova.compute.manager [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received unexpected event network-vif-plugged-c469bd25-6546-47e3-92f6-96674f256be6 for instance with vm_state active and task_state deleting.
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-unplugged-a2077cf2-6cf5-47e2-b50e-22625dd1c118 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-unplugged-a2077cf2-6cf5-47e2-b50e-22625dd1c118 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-unplugged-a2077cf2-6cf5-47e2-b50e-22625dd1c118 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-plugged-a2077cf2-6cf5-47e2-b50e-22625dd1c118 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-plugged-a2077cf2-6cf5-47e2-b50e-22625dd1c118 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:37 user nova-compute[70243]: WARNING nova.compute.manager [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received unexpected event network-vif-plugged-a2077cf2-6cf5-47e2-b50e-22625dd1c118 for instance with vm_state active and task_state deleting.
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-unplugged-ee32acf5-1ead-4f29-b7a0-77a16d10778e {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-unplugged-ee32acf5-1ead-4f29-b7a0-77a16d10778e {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a2177f2f-8b13-4d4d-af39-902d7529e4ce req-37bcddab-1b7a-4242-b951-429767c16887 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-unplugged-ee32acf5-1ead-4f29-b7a0-77a16d10778e for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5035cfde-cf0d-49b0-8d2e-306bd46359d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:23:37 user nova-compute[70243]: No targets found.
Jul 24 16:23:37 user nova-compute[70243]: iSNS:
Jul 24 16:23:37 user nova-compute[70243]: No targets found.
Jul 24 16:23:37 user nova-compute[70243]: STATIC:
Jul 24 16:23:37 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b
Jul 24 16:23:37 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:37 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:37 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5
Jul 24 16:23:37 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:37 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:37 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323
Jul 24 16:23:37 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:37 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:37 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b
Jul 24 16:23:37 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:37 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:37 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73
Jul 24 16:23:37 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:37 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:37 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b
Jul 24 16:23:37 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:37 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:37 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c
Jul 24 16:23:37 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:37 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:37 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30
Jul 24 16:23:37 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:37 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:37 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b
Jul 24 16:23:37 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:37 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:37 user nova-compute[70243]: FIRMWARE:
Jul 24 16:23:37 user nova-compute[70243]: No targets found.
Jul 24 16:23:37 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:23:37 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:23:37 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb9e51b-6211-4d2c-9a12-c31304154bf1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2d8501-0486-4536-af6f-b60e3233fe31]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:23:37 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:23:37 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc192dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30'): ({'sdd'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Removing single pathed devices sdd {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.099s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[391b8b5c-8316-40e7-b00c-03f956a7010c]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[90df1ca4-ec04-4015-b5a2-5d3cc2c105a6]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Flushing IO for device /dev/sdd {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2721c0a6-773b-4001-ab90-1ef35b8f9689]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[16498e41-b9a4-403e-b417-341831734d98]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] SCSI volumes sdd have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a430a3-e82f-471d-95c2-c356b9332870]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received event network-vif-unplugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] Acquiring lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] No waiting events found dispatching network-vif-unplugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:37 user nova-compute[70243]: WARNING nova.compute.manager [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received unexpected event network-vif-unplugged-809292ba-1131-47d4-8b1c-b7cef6888d76 for instance with vm_state active and task_state reboot_started_hard.
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received event network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] Acquiring lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] No waiting events found dispatching network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:37 user nova-compute[70243]: WARNING nova.compute.manager [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received unexpected event network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 for instance with vm_state active and task_state reboot_started_hard.
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-unplugged-44c70c07-ac30-4af3-b1a2-5f886d4ca1c1 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-unplugged-44c70c07-ac30-4af3-b1a2-5f886d4ca1c1 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-unplugged-44c70c07-ac30-4af3-b1a2-5f886d4ca1c1 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-plugged-44c70c07-ac30-4af3-b1a2-5f886d4ca1c1 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-plugged-44c70c07-ac30-4af3-b1a2-5f886d4ca1c1 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:37 user nova-compute[70243]: WARNING nova.compute.manager [req-a1b66961-d6d3-4656-a409-5815773647fc req-f889e687-2842-4b54-8f2c-b255b114a900 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received unexpected event network-vif-plugged-44c70c07-ac30-4af3-b1a2-5f886d4ca1c1 for instance with vm_state active and task_state deleting.
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1a07a7-df75-4289-adb9-eb4c2a942731]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30, portal: 172.16.0.220,3260]
Jul 24 16:23:37 user nova-compute[70243]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30, portal: 172.16.0.220,3260] successful.
Jul 24 16:23:37 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c9f323-641d-40da-ad5f-876db0d03c30 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.069s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5719d09-f920-44e2-9f39-8b79deb1566e]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.566s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] <== disconnect_volume: return (567ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOLFATIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:23:37 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3b22f3-6e77-4640-8713-68324c0d35ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:23:37 user nova-compute[70243]: No targets found.
Jul 24 16:23:37 user nova-compute[70243]: iSNS:
Jul 24 16:23:37 user nova-compute[70243]: No targets found.
Jul 24 16:23:37 user nova-compute[70243]: STATIC:
Jul 24 16:23:37 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b
Jul 24 16:23:37 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:37 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:37 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5
Jul 24 16:23:37 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:37 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:37 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323
Jul 24 16:23:37 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:37 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:37 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b
Jul 24 16:23:37 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:37 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:37 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73
Jul 24 16:23:37 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:37 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:37 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b
Jul 24 16:23:37 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:37 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:37 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c
Jul 24 16:23:37 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:37 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:37 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b
Jul 24 16:23:37 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:37 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:37 user nova-compute[70243]: FIRMWARE:
Jul 24 16:23:37 user nova-compute[70243]: No targets found.
Jul 24 16:23:37 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:23:37 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:23:37 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f92d14-c7cd-4aa8-9f40-8cc01c678734]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.060s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa6bfcd-5bd0-4166-a241-9515f7aa3d19]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:23:37 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:23:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:23:37 user nova-compute[70243]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:23:37 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc167250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b'): ({'sde'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Removing single pathed devices sde {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b0862d-7ff0-4702-852d-39039339ab8e]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[639ff2cc-073c-4977-8906-5a65774f7395]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Flushing IO for device /dev/sde {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54afb9a-592c-497e-bc34-265e03e9f89f]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.066s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[33881c2a-7883-4ed5-8b58-6ee092335327]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] SCSI volumes sde have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b98c596-499b-4add-9d04-684273f36e8e]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[004728f7-f783-4074-a82c-a0fdbf221a97]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b, portal: 172.16.0.220,3260]
Jul 24 16:23:38 user nova-compute[70243]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b, portal: 172.16.0.220,3260] successful.
Jul 24 16:23:38 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7373fa4-1362-4914-9741-3ae96ce33f3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[440fe4fc-4327-48a9-a0a8-7485a29a25ab]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.462s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] <== disconnect_volume: return (463ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjUIfiFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:23:38 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bd446b-05aa-401a-9346-cb830c42b005]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:23:38 user nova-compute[70243]: No targets found.
Jul 24 16:23:38 user nova-compute[70243]: iSNS:
Jul 24 16:23:38 user nova-compute[70243]: No targets found.
Jul 24 16:23:38 user nova-compute[70243]: STATIC:
Jul 24 16:23:38 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b
Jul 24 16:23:38 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:38 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:38 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5
Jul 24 16:23:38 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:38 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:38 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323
Jul 24 16:23:38 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:38 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:38 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b
Jul 24 16:23:38 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:38 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:38 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73
Jul 24 16:23:38 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:38 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:38 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c
Jul 24 16:23:38 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:38 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:38 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b
Jul 24 16:23:38 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:38 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:38 user nova-compute[70243]: FIRMWARE:
Jul 24 16:23:38 user nova-compute[70243]: No targets found.
Jul 24 16:23:38 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:23:38 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:23:38 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[481e8cdc-4b53-45e9-bf0c-4df8f0ffbd86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95882a9-a93f-408f-8e31-57708ea5d713]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:23:38 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:23:38 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:23:38 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:23:38 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:23:38 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:23:38 user nova-compute[70243]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:23:38 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:23:38 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:23:38 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:23:38 user nova-compute[70243]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 (non-flash)
Jul 24 16:23:38 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:23:38 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:23:38 user nova-compute[70243]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:23:38 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc175c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5'): ({'sdg'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Removing single pathed devices sdg {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b799ea50-78fe-42b8-bb6b-909839aa0fbf]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bcca0a-1b9b-45ce-9d32-8538a23ac684]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Flushing IO for device /dev/sdg {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee862530-99c1-443d-a1be-5471622c39aa]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62e2ea2-843c-440e-837c-9bcbd473a8ee]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] SCSI volumes sdg have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a77896-0b4f-47dd-80cd-4ab059cc0537]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa885cc-e2a3-4fdb-8132-919cc84568fb]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5, portal: 172.16.0.220,3260]
Jul 24 16:23:38 user nova-compute[70243]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5, portal: 172.16.0.220,3260] successful.
Jul 24 16:23:38 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d496c16a-c676-4702-a76c-cd73626058c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbc49c7-10ef-4d66-b588-02c2b7b4a944]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] <== disconnect_volume: return (390ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:23:38 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Deleting instance files /opt/stack/data/nova/instances/edf964e0-bee8-42c8-b4eb-dd490d3fa2ab_del
Jul 24 16:23:38 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Deletion of /opt/stack/data/nova/instances/edf964e0-bee8-42c8-b4eb-dd490d3fa2ab_del complete
Jul 24 16:23:38 user nova-compute[70243]: INFO nova.compute.manager [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Took 4.11 seconds to destroy the instance on the hypervisor.
Jul 24 16:23:38 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:23:38 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:23:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:39 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690215804.330651, d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:23:39 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] VM Stopped (Lifecycle Event)
Jul 24 16:23:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:39 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ec09f7ea-3aad-4460-9ca2-fe1f62bb1cdb None None] [instance: d2b87b0b-c6c6-4ec9-ae9d-72159b7a6c32] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:23:39 user nova-compute[70243]: DEBUG nova.compute.manager [req-b2a5aac8-2f47-4f64-afb1-34ace6baccb6 req-fd21edda-574f-472e-8758-a775c6dbc00d service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-plugged-ee32acf5-1ead-4f29-b7a0-77a16d10778e {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b2a5aac8-2f47-4f64-afb1-34ace6baccb6 req-fd21edda-574f-472e-8758-a775c6dbc00d service nova] Acquiring lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b2a5aac8-2f47-4f64-afb1-34ace6baccb6 req-fd21edda-574f-472e-8758-a775c6dbc00d service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b2a5aac8-2f47-4f64-afb1-34ace6baccb6 req-fd21edda-574f-472e-8758-a775c6dbc00d service nova] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:39 user nova-compute[70243]: DEBUG nova.compute.manager [req-b2a5aac8-2f47-4f64-afb1-34ace6baccb6 req-fd21edda-574f-472e-8758-a775c6dbc00d service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] No waiting events found dispatching network-vif-plugged-ee32acf5-1ead-4f29-b7a0-77a16d10778e {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:39 user nova-compute[70243]: WARNING nova.compute.manager [req-b2a5aac8-2f47-4f64-afb1-34ace6baccb6 req-fd21edda-574f-472e-8758-a775c6dbc00d service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received unexpected event network-vif-plugged-ee32acf5-1ead-4f29-b7a0-77a16d10778e for instance with vm_state active and task_state deleting.
Jul 24 16:23:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:39 user nova-compute[70243]: DEBUG nova.compute.manager [req-73c568ad-6f0f-42fe-87b5-ebf14953d2f1 req-1a61dccf-fc18-4fa0-a852-ddee45abe017 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received event network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-73c568ad-6f0f-42fe-87b5-ebf14953d2f1 req-1a61dccf-fc18-4fa0-a852-ddee45abe017 service nova] Acquiring lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-73c568ad-6f0f-42fe-87b5-ebf14953d2f1 req-1a61dccf-fc18-4fa0-a852-ddee45abe017 service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-73c568ad-6f0f-42fe-87b5-ebf14953d2f1 req-1a61dccf-fc18-4fa0-a852-ddee45abe017 service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:39 user nova-compute[70243]: DEBUG nova.compute.manager [req-73c568ad-6f0f-42fe-87b5-ebf14953d2f1 req-1a61dccf-fc18-4fa0-a852-ddee45abe017 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] No waiting events found dispatching network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:39 user nova-compute[70243]: WARNING nova.compute.manager [req-73c568ad-6f0f-42fe-87b5-ebf14953d2f1 req-1a61dccf-fc18-4fa0-a852-ddee45abe017 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received unexpected event network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 for instance with vm_state active and task_state reboot_started_hard.
Jul 24 16:23:40 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:23:40 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:23:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Removed pending event for b0dd6065-3916-4f0e-841e-3df5ded2e2ee due to event {{(pid=70243) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 16:23:40 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215820.872608, b0dd6065-3916-4f0e-841e-3df5ded2e2ee => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:23:40 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] VM Resumed (Lifecycle Event)
Jul 24 16:23:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:23:40 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Instance rebooted successfully.
Jul 24 16:23:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:23:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:23:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:23:40 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jul 24 16:23:40 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215820.8743484, b0dd6065-3916-4f0e-841e-3df5ded2e2ee => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:23:40 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] VM Started (Lifecycle Event)
Jul 24 16:23:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:23:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-27a3f410-e644-4c6f-b124-cbedcea45686 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.877s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:23:41 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:23:41 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:23:41 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70243) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 16:23:41 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:23:41 user nova-compute[70243]: DEBUG nova.compute.manager [req-51c22550-a859-4b63-b95c-e06589b2ae9f req-b0349874-1afc-4e79-b011-11ab06195919 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received event network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-51c22550-a859-4b63-b95c-e06589b2ae9f req-b0349874-1afc-4e79-b011-11ab06195919 service nova] Acquiring lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-51c22550-a859-4b63-b95c-e06589b2ae9f req-b0349874-1afc-4e79-b011-11ab06195919 service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-51c22550-a859-4b63-b95c-e06589b2ae9f req-b0349874-1afc-4e79-b011-11ab06195919 service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:41 user nova-compute[70243]: DEBUG nova.compute.manager [req-51c22550-a859-4b63-b95c-e06589b2ae9f req-b0349874-1afc-4e79-b011-11ab06195919 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] No waiting events found dispatching network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:41 user nova-compute[70243]: WARNING nova.compute.manager [req-51c22550-a859-4b63-b95c-e06589b2ae9f req-b0349874-1afc-4e79-b011-11ab06195919 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received unexpected event network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 for instance with vm_state active and task_state None.
Jul 24 16:23:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:42 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:23:42 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:23:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:42 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:23:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Acquiring lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:23:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:42 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:23:42 user nova-compute[70243]: INFO nova.compute.claims [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Claim successful on node user
Jul 24 16:23:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:23:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:43 user nova-compute[70243]: INFO nova.compute.manager [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Terminating instance
Jul 24 16:23:43 user nova-compute[70243]: DEBUG nova.compute.manager [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.810s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG nova.compute.manager [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG nova.compute.manager [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG nova.network.neutron [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:23:43 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:23:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG nova.compute.manager [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG nova.policy [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05e972674e79471db0805b73b7d3d93f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc232fc3856a4edb8adc0c47cb15cc66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG nova.compute.manager [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:23:43 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Creating image(s)
Jul 24 16:23:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Acquiring lock "/opt/stack/data/nova/instances/66147ca4-6c90-4ed8-b6f4-6437d0e8c38b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Lock "/opt/stack/data/nova/instances/66147ca4-6c90-4ed8-b6f4-6437d0e8c38b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Lock "/opt/stack/data/nova/instances/66147ca4-6c90-4ed8-b6f4-6437d0e8c38b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG nova.compute.manager [req-96b505ba-39bf-445e-8bd4-99bf8e69dfc8 req-9928ba29-d768-40cc-a1d4-fcb44d4f6f94 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-deleted-dabb3818-16d0-4d10-9912-15dd72754963 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:43 user nova-compute[70243]: INFO nova.compute.manager [req-96b505ba-39bf-445e-8bd4-99bf8e69dfc8 req-9928ba29-d768-40cc-a1d4-fcb44d4f6f94 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Neutron deleted interface dabb3818-16d0-4d10-9912-15dd72754963; detaching it from the instance and deleting it from the info cache
Jul 24 16:23:43 user nova-compute[70243]: DEBUG nova.network.neutron [req-96b505ba-39bf-445e-8bd4-99bf8e69dfc8 req-9928ba29-d768-40cc-a1d4-fcb44d4f6f94 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Updating instance_info_cache with network_info: [{"id": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "address": "fa:16:3e:ac:a6:57", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d99894-04", "ovs_interfaceid": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c469bd25-6546-47e3-92f6-96674f256be6", "address": "fa:16:3e:e4:76:c9", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc469bd25-65", "ovs_interfaceid": "c469bd25-6546-47e3-92f6-96674f256be6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "address": "fa:16:3e:35:0c:a4", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2077cf2-6c", "ovs_interfaceid": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "address": "fa:16:3e:6f:63:28", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c70c07-ac", "ovs_interfaceid": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "address": "fa:16:3e:2d:f2:1f", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee32acf5-1e", "ovs_interfaceid": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "address": "fa:16:3e:ed:cc:00", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71b975d-1e", "ovs_interfaceid": "e71b975d-1eaa-46f2-b6a7-01771b71b484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:23:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-96b505ba-39bf-445e-8bd4-99bf8e69dfc8 req-9928ba29-d768-40cc-a1d4-fcb44d4f6f94 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Detach interface failed, port_id=dabb3818-16d0-4d10-9912-15dd72754963, reason: Instance edf964e0-bee8-42c8-b4eb-dd490d3fa2ab could not be found. {{(pid=70243) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-96b505ba-39bf-445e-8bd4-99bf8e69dfc8 req-9928ba29-d768-40cc-a1d4-fcb44d4f6f94 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-deleted-e71b975d-1eaa-46f2-b6a7-01771b71b484 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:44 user nova-compute[70243]: INFO nova.compute.manager [req-96b505ba-39bf-445e-8bd4-99bf8e69dfc8 req-9928ba29-d768-40cc-a1d4-fcb44d4f6f94 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Neutron deleted interface e71b975d-1eaa-46f2-b6a7-01771b71b484; detaching it from the instance and deleting it from the info cache
Jul 24 16:23:44 user nova-compute[70243]: DEBUG nova.network.neutron [req-96b505ba-39bf-445e-8bd4-99bf8e69dfc8 req-9928ba29-d768-40cc-a1d4-fcb44d4f6f94 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Updating instance_info_cache with network_info: [{"id": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "address": "fa:16:3e:ac:a6:57", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d99894-04", "ovs_interfaceid": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c469bd25-6546-47e3-92f6-96674f256be6", "address": "fa:16:3e:e4:76:c9", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc469bd25-65", "ovs_interfaceid": "c469bd25-6546-47e3-92f6-96674f256be6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "address": "fa:16:3e:35:0c:a4", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2077cf2-6c", "ovs_interfaceid": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "address": "fa:16:3e:6f:63:28", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c70c07-ac", "ovs_interfaceid": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "address": "fa:16:3e:2d:f2:1f", "network": {"id": "3a15cd1c-bddd-4029-8b69-efb6444b93bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-477934743", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee32acf5-1e", "ovs_interfaceid": "ee32acf5-1ead-4f29-b7a0-77a16d10778e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-96b505ba-39bf-445e-8bd4-99bf8e69dfc8 req-9928ba29-d768-40cc-a1d4-fcb44d4f6f94 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Detach interface failed, port_id=e71b975d-1eaa-46f2-b6a7-01771b71b484, reason: Instance edf964e0-bee8-42c8-b4eb-dd490d3fa2ab could not be found. {{(pid=70243) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-96b505ba-39bf-445e-8bd4-99bf8e69dfc8 req-9928ba29-d768-40cc-a1d4-fcb44d4f6f94 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-deleted-ee32acf5-1ead-4f29-b7a0-77a16d10778e {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:44 user nova-compute[70243]: INFO nova.compute.manager [req-96b505ba-39bf-445e-8bd4-99bf8e69dfc8 req-9928ba29-d768-40cc-a1d4-fcb44d4f6f94 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Neutron deleted interface ee32acf5-1ead-4f29-b7a0-77a16d10778e; detaching it from the instance and deleting it from the info cache
Jul 24 16:23:44 user nova-compute[70243]: DEBUG nova.network.neutron [req-96b505ba-39bf-445e-8bd4-99bf8e69dfc8 req-9928ba29-d768-40cc-a1d4-fcb44d4f6f94 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Updating instance_info_cache with network_info: [{"id": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "address": "fa:16:3e:ac:a6:57", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d99894-04", "ovs_interfaceid": "15d99894-04b8-415b-a03a-ccc794f9d8dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c469bd25-6546-47e3-92f6-96674f256be6", "address": "fa:16:3e:e4:76:c9", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc469bd25-65", "ovs_interfaceid": "c469bd25-6546-47e3-92f6-96674f256be6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "address": "fa:16:3e:35:0c:a4", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2077cf2-6c", "ovs_interfaceid": "a2077cf2-6cf5-47e2-b50e-22625dd1c118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "address": "fa:16:3e:6f:63:28", "network": {"id": "956e3b99-d9e7-49a8-b80c-eebe543bb137", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348621995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1580d59d0e041ec980753d98a90158a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c70c07-ac", "ovs_interfaceid": "44c70c07-ac30-4af3-b1a2-5f886d4ca1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-96b505ba-39bf-445e-8bd4-99bf8e69dfc8 req-9928ba29-d768-40cc-a1d4-fcb44d4f6f94 service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Detach interface failed, port_id=ee32acf5-1ead-4f29-b7a0-77a16d10778e, reason: Instance edf964e0-bee8-42c8-b4eb-dd490d3fa2ab could not be found. {{(pid=70243) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.212s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.157s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/66147ca4-6c90-4ed8-b6f4-6437d0e8c38b/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/66147ca4-6c90-4ed8-b6f4-6437d0e8c38b/disk 1073741824" returned: 0 in 0.071s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:44 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Instance destroyed successfully.
Jul 24 16:23:44 user nova-compute[70243]: DEBUG nova.objects.instance [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lazy-loading 'resources' on Instance uuid fd314e21-b1a5-425d-a5e0-c1b3303b72d4 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T16:19:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1975041839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1050817232',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJugPMjzC3sjisDM8EAfC1nB8cVCVLT9x+8UIOeaWrQRyN8J62vtUyTY9fsadBD/m66uRYjMwVz+mSleYDM8PIyy3oS1j2G/C6AKWNTLgTzZDawO9o6JDWYdg27VAeNPCw==',key_name='tempest-keypair-987230631',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:22:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec24d98248104f5f898cf6f79207435b',ramdisk_id='',reservation_id='r-xz0z2ofe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1173962228',owner_user_name='tempest-ServerActionsV293TestJSON-1173962228-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:22:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93b6ed534c2c44d08a71f3050e212644',uuid=fd314e21-b1a5-425d-a5e0-c1b3303b72d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "address": "fa:16:3e:92:b1:e8", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc58b9-95", "ovs_interfaceid": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Converting VIF {"id": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "address": "fa:16:3e:92:b1:e8", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cc58b9-95", "ovs_interfaceid": "51cc58b9-958f-41dd-bf1d-596ca7c6d5ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:b1:e8,bridge_name='br-int',has_traffic_filtering=True,id=51cc58b9-958f-41dd-bf1d-596ca7c6d5ce,network=Network(3ed67d60-f22b-4d39-9563-c680c176858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cc58b9-95') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG os_vif [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:b1:e8,bridge_name='br-int',has_traffic_filtering=True,id=51cc58b9-958f-41dd-bf1d-596ca7c6d5ce,network=Network(3ed67d60-f22b-4d39-9563-c680c176858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cc58b9-95') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51cc58b9-95, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.188s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66147ca4-6c90-4ed8-b6f4-6437d0e8c38b/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66147ca4-6c90-4ed8-b6f4-6437d0e8c38b/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:23:44 user nova-compute[70243]: INFO os_vif [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:b1:e8,bridge_name='br-int',has_traffic_filtering=True,id=51cc58b9-958f-41dd-bf1d-596ca7c6d5ce,network=Network(3ed67d60-f22b-4d39-9563-c680c176858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cc58b9-95')
Jul 24 16:23:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'futGLMdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:23:44 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:23:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0381fa2b-a276-49d7-8c45-87bb2048e7d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:23:44 user nova-compute[70243]: No targets found.
Jul 24 16:23:44 user nova-compute[70243]: iSNS:
Jul 24 16:23:44 user nova-compute[70243]: No targets found.
Jul 24 16:23:44 user nova-compute[70243]: STATIC:
Jul 24 16:23:44 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b
Jul 24 16:23:44 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:44 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:44 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323
Jul 24 16:23:44 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:44 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:44 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b
Jul 24 16:23:44 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:44 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:44 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73
Jul 24 16:23:44 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:44 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:44 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c
Jul 24 16:23:44 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:44 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:44 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b
Jul 24 16:23:44 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:44 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:44 user nova-compute[70243]: FIRMWARE:
Jul 24 16:23:44 user nova-compute[70243]: No targets found.
Jul 24 16:23:44 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:23:44 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:23:44 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[da624378-42c3-48f5-82e9-7217b4585141]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG nova.network.neutron [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Successfully created port: ebb9c545-4b4b-4765-848b-e81ff8cd8bed {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb047ca-f394-4a3b-a4e2-c00d28cdb822]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:23:44 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:23:44 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:23:44 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:23:44 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:23:44 user nova-compute[70243]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:23:44 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:23:44 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:23:44 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:23:44 user nova-compute[70243]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 (non-flash)
Jul 24 16:23:44 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:23:44 user nova-compute[70243]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:23:44 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc14beb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73'): ({'sdh'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Removing single pathed devices sdh {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66147ca4-6c90-4ed8-b6f4-6437d0e8c38b/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Cannot resize image /opt/stack/data/nova/instances/66147ca4-6c90-4ed8-b6f4-6437d0e8c38b/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG nova.objects.instance [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Lazy-loading 'migration_context' on Instance uuid 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[551049ae-7cb8-408c-9393-64d30ffbb466]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Ensure instance console log exists: /opt/stack/data/nova/instances/66147ca4-6c90-4ed8-b6f4-6437d0e8c38b/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b88cd68-6399-4c8e-a945-3ebd643d04cb]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Flushing IO for device /dev/sdh {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5d6ba8-0658-464c-8f31-de6032e5493b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:23:45 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Took 6.22 seconds to deallocate network for instance.
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.061s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f55d306-a221-404d-9db3-6f833a4faa51]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] SCSI volumes sdh have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a48ff6-271a-4791-ad92-77e4706d68bd]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3376c3d3-221b-4a9d-b038-ced186955485]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73, portal: 172.16.0.220,3260]
Jul 24 16:23:45 user nova-compute[70243]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73, portal: 172.16.0.220,3260] successful.
Jul 24 16:23:45 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75d2beea-53f6-4026-a9fa-a819238dbf73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c184a73-2fa3-467f-b97c-60616b52a6e8]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.573s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] <== disconnect_volume: return (574ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:23:45 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Deleting instance files /opt/stack/data/nova/instances/fd314e21-b1a5-425d-a5e0-c1b3303b72d4_del
Jul 24 16:23:45 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Deletion of /opt/stack/data/nova/instances/fd314e21-b1a5-425d-a5e0-c1b3303b72d4_del complete
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:45 user nova-compute[70243]: INFO nova.compute.manager [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Took 1.87 seconds to destroy the instance on the hypervisor.
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG nova.network.neutron [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Successfully updated port: ebb9c545-4b4b-4765-848b-e81ff8cd8bed {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Acquiring lock "refresh_cache-66147ca4-6c90-4ed8-b6f4-6437d0e8c38b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Acquired lock "refresh_cache-66147ca4-6c90-4ed8-b6f4-6437d0e8c38b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG nova.network.neutron [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG nova.compute.manager [req-9bd68dee-0de8-4f32-9f46-9cb55e9b86c4 req-d63d9aa1-6e50-46de-b2ae-b0fdfbd6271d service nova] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Received event network-changed-ebb9c545-4b4b-4765-848b-e81ff8cd8bed {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG nova.compute.manager [req-9bd68dee-0de8-4f32-9f46-9cb55e9b86c4 req-d63d9aa1-6e50-46de-b2ae-b0fdfbd6271d service nova] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Refreshing instance network info cache due to event network-changed-ebb9c545-4b4b-4765-848b-e81ff8cd8bed. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9bd68dee-0de8-4f32-9f46-9cb55e9b86c4 req-d63d9aa1-6e50-46de-b2ae-b0fdfbd6271d service nova] Acquiring lock "refresh_cache-66147ca4-6c90-4ed8-b6f4-6437d0e8c38b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG nova.network.neutron [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.manager [req-727aa577-423f-4a63-acf3-f182014dc18a req-92f1d309-a054-43ae-9cd5-299b515fea7f service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-deleted-a2077cf2-6cf5-47e2-b50e-22625dd1c118 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.manager [req-727aa577-423f-4a63-acf3-f182014dc18a req-92f1d309-a054-43ae-9cd5-299b515fea7f service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Received event network-vif-unplugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-727aa577-423f-4a63-acf3-f182014dc18a req-92f1d309-a054-43ae-9cd5-299b515fea7f service nova] Acquiring lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-727aa577-423f-4a63-acf3-f182014dc18a req-92f1d309-a054-43ae-9cd5-299b515fea7f service nova] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-727aa577-423f-4a63-acf3-f182014dc18a req-92f1d309-a054-43ae-9cd5-299b515fea7f service nova] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.manager [req-727aa577-423f-4a63-acf3-f182014dc18a req-92f1d309-a054-43ae-9cd5-299b515fea7f service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] No waiting events found dispatching network-vif-unplugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.manager [req-727aa577-423f-4a63-acf3-f182014dc18a req-92f1d309-a054-43ae-9cd5-299b515fea7f service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Received event network-vif-unplugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.manager [req-727aa577-423f-4a63-acf3-f182014dc18a req-92f1d309-a054-43ae-9cd5-299b515fea7f service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Received event network-vif-plugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-727aa577-423f-4a63-acf3-f182014dc18a req-92f1d309-a054-43ae-9cd5-299b515fea7f service nova] Acquiring lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-727aa577-423f-4a63-acf3-f182014dc18a req-92f1d309-a054-43ae-9cd5-299b515fea7f service nova] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-727aa577-423f-4a63-acf3-f182014dc18a req-92f1d309-a054-43ae-9cd5-299b515fea7f service nova] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.manager [req-727aa577-423f-4a63-acf3-f182014dc18a req-92f1d309-a054-43ae-9cd5-299b515fea7f service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] No waiting events found dispatching network-vif-plugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:46 user nova-compute[70243]: WARNING nova.compute.manager [req-727aa577-423f-4a63-acf3-f182014dc18a req-92f1d309-a054-43ae-9cd5-299b515fea7f service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Received unexpected event network-vif-plugged-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce for instance with vm_state active and task_state deleting.
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.manager [req-727aa577-423f-4a63-acf3-f182014dc18a req-92f1d309-a054-43ae-9cd5-299b515fea7f service nova] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Received event network-vif-deleted-44c70c07-ac30-4af3-b1a2-5f886d4ca1c1 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:23:46 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:23:46 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=7249MB free_disk=24.322734832763672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:46 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Took 1.25 seconds to deallocate network for instance.
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Applying migration context for instance 5f70528b-33db-4257-96fe-e5fad869a224 as it has an incoming, in-progress migration 2665c832-2ece-47d5-a25b-f3b87ff0d645. Migration status is finished {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 24 16:23:46 user nova-compute[70243]: INFO nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Updating resource usage from migration 2665c832-2ece-47d5-a25b-f3b87ff0d645
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance de22ea98-b041-4f3f-8986-435c43267a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance de484cb2-7f20-4bf1-927b-c066735bfeca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance a13c243a-2b98-4ef1-b17c-e2e15ba005fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance ad611655-ba4d-4a66-b78e-a82c058f4414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance c2ee17ba-3482-4caf-992e-30b3953d1e91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance fd314e21-b1a5-425d-a5e0-c1b3303b72d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance b0dd6065-3916-4f0e-841e-3df5ded2e2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance edf964e0-bee8-42c8-b4eb-dd490d3fa2ab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Migration 2665c832-2ece-47d5-a25b-f3b87ff0d645 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5f70528b-33db-4257-96fe-e5fad869a224 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance abcd54bc-02d4-4872-8227-43cb93d27491 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.network.neutron [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Updating instance_info_cache with network_info: [{"id": "ebb9c545-4b4b-4765-848b-e81ff8cd8bed", "address": "fa:16:3e:e2:95:9b", "network": {"id": "b0c05f1d-624c-49c4-98a2-20542fd327de", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1473655018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc232fc3856a4edb8adc0c47cb15cc66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb9c545-4b", "ovs_interfaceid": "ebb9c545-4b4b-4765-848b-e81ff8cd8bed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Releasing lock "refresh_cache-66147ca4-6c90-4ed8-b6f4-6437d0e8c38b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.compute.manager [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Instance network_info: |[{"id": "ebb9c545-4b4b-4765-848b-e81ff8cd8bed", "address": "fa:16:3e:e2:95:9b", "network": {"id": "b0c05f1d-624c-49c4-98a2-20542fd327de", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1473655018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc232fc3856a4edb8adc0c47cb15cc66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb9c545-4b", "ovs_interfaceid": "ebb9c545-4b4b-4765-848b-e81ff8cd8bed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9bd68dee-0de8-4f32-9f46-9cb55e9b86c4 req-d63d9aa1-6e50-46de-b2ae-b0fdfbd6271d service nova] Acquired lock "refresh_cache-66147ca4-6c90-4ed8-b6f4-6437d0e8c38b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.network.neutron [req-9bd68dee-0de8-4f32-9f46-9cb55e9b86c4 req-d63d9aa1-6e50-46de-b2ae-b0fdfbd6271d service nova] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Refreshing network info cache for port ebb9c545-4b4b-4765-848b-e81ff8cd8bed {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Start _get_guest_xml network_info=[{"id": "ebb9c545-4b4b-4765-848b-e81ff8cd8bed", "address": "fa:16:3e:e2:95:9b", "network": {"id": "b0c05f1d-624c-49c4-98a2-20542fd327de", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1473655018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc232fc3856a4edb8adc0c47cb15cc66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb9c545-4b", "ovs_interfaceid": "ebb9c545-4b4b-4765-848b-e81ff8cd8bed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:23:46 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:23:46 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:23:46 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1766332538',display_name='tempest-VolumesActionsTest-instance-1766332538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1766332538',id=16,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc232fc3856a4edb8adc0c47cb15cc66',ramdisk_id='',reservation_id='r-5z3f7kxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1813125667',owner_user_name='tempest-VolumesActionsTest-1813125667-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:23:44Z,user_data=None,user_id='05e972674e79471db0805b73b7d3d93f',uuid=66147ca4-6c90-4ed8-b6f4-6437d0e8c38b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebb9c545-4b4b-4765-848b-e81ff8cd8bed", "address": "fa:16:3e:e2:95:9b", "network": {"id": "b0c05f1d-624c-49c4-98a2-20542fd327de", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1473655018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc232fc3856a4edb8adc0c47cb15cc66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb9c545-4b", "ovs_interfaceid": "ebb9c545-4b4b-4765-848b-e81ff8cd8bed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Converting VIF {"id": "ebb9c545-4b4b-4765-848b-e81ff8cd8bed", "address": "fa:16:3e:e2:95:9b", "network": {"id": "b0c05f1d-624c-49c4-98a2-20542fd327de", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1473655018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc232fc3856a4edb8adc0c47cb15cc66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb9c545-4b", "ovs_interfaceid": "ebb9c545-4b4b-4765-848b-e81ff8cd8bed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:95:9b,bridge_name='br-int',has_traffic_filtering=True,id=ebb9c545-4b4b-4765-848b-e81ff8cd8bed,network=Network(b0c05f1d-624c-49c4-98a2-20542fd327de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb9c545-4b') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG nova.objects.instance [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Lazy-loading 'pci_devices' on Instance uuid 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:23:47 user nova-compute[70243]:   <uuid>66147ca4-6c90-4ed8-b6f4-6437d0e8c38b</uuid>
Jul 24 16:23:47 user nova-compute[70243]:   <name>instance-00000010</name>
Jul 24 16:23:47 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:23:47 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:23:47 user nova-compute[70243]:   <metadata>
Jul 24 16:23:47 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:23:47 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:23:47 user nova-compute[70243]:       <nova:name>tempest-VolumesActionsTest-instance-1766332538</nova:name>
Jul 24 16:23:47 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:23:46</nova:creationTime>
Jul 24 16:23:47 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:23:47 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:23:47 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:23:47 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:23:47 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:23:47 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:23:47 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:23:47 user nova-compute[70243]:       <nova:owner>
Jul 24 16:23:47 user nova-compute[70243]:         <nova:user uuid="05e972674e79471db0805b73b7d3d93f">tempest-VolumesActionsTest-1813125667-project-member</nova:user>
Jul 24 16:23:47 user nova-compute[70243]:         <nova:project uuid="bc232fc3856a4edb8adc0c47cb15cc66">tempest-VolumesActionsTest-1813125667</nova:project>
Jul 24 16:23:47 user nova-compute[70243]:       </nova:owner>
Jul 24 16:23:47 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:23:47 user nova-compute[70243]:       <nova:ports>
Jul 24 16:23:47 user nova-compute[70243]:         <nova:port uuid="ebb9c545-4b4b-4765-848b-e81ff8cd8bed">
Jul 24 16:23:47 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 24 16:23:47 user nova-compute[70243]:         </nova:port>
Jul 24 16:23:47 user nova-compute[70243]:       </nova:ports>
Jul 24 16:23:47 user nova-compute[70243]:     </nova:instance>
Jul 24 16:23:47 user nova-compute[70243]:   </metadata>
Jul 24 16:23:47 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:23:47 user nova-compute[70243]:     <system>
Jul 24 16:23:47 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:23:47 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:23:47 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:23:47 user nova-compute[70243]:       <entry name="serial">66147ca4-6c90-4ed8-b6f4-6437d0e8c38b</entry>
Jul 24 16:23:47 user nova-compute[70243]:       <entry name="uuid">66147ca4-6c90-4ed8-b6f4-6437d0e8c38b</entry>
Jul 24 16:23:47 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:23:47 user nova-compute[70243]:     </system>
Jul 24 16:23:47 user nova-compute[70243]:   </sysinfo>
Jul 24 16:23:47 user nova-compute[70243]:   <os>
Jul 24 16:23:47 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:23:47 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:23:47 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:23:47 user nova-compute[70243]:   </os>
Jul 24 16:23:47 user nova-compute[70243]:   <features>
Jul 24 16:23:47 user nova-compute[70243]:     <acpi/>
Jul 24 16:23:47 user nova-compute[70243]:     <apic/>
Jul 24 16:23:47 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:23:47 user nova-compute[70243]:   </features>
Jul 24 16:23:47 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:23:47 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:23:47 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:23:47 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:23:47 user nova-compute[70243]:   </clock>
Jul 24 16:23:47 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:23:47 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:23:47 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:23:47 user nova-compute[70243]:   </cpu>
Jul 24 16:23:47 user nova-compute[70243]:   <devices>
Jul 24 16:23:47 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:23:47 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:23:47 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/66147ca4-6c90-4ed8-b6f4-6437d0e8c38b/disk"/>
Jul 24 16:23:47 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:23:47 user nova-compute[70243]:     </disk>
Jul 24 16:23:47 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:23:47 user nova-compute[70243]:       <mac address="fa:16:3e:e2:95:9b"/>
Jul 24 16:23:47 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:23:47 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:23:47 user nova-compute[70243]:       <target dev="tapebb9c545-4b"/>
Jul 24 16:23:47 user nova-compute[70243]:     </interface>
Jul 24 16:23:47 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:23:47 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/66147ca4-6c90-4ed8-b6f4-6437d0e8c38b/console.log" append="off"/>
Jul 24 16:23:47 user nova-compute[70243]:     </serial>
Jul 24 16:23:47 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:23:47 user nova-compute[70243]:     <video>
Jul 24 16:23:47 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:23:47 user nova-compute[70243]:     </video>
Jul 24 16:23:47 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:23:47 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:23:47 user nova-compute[70243]:     </rng>
Jul 24 16:23:47 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:23:47 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:23:47 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:23:47 user nova-compute[70243]:     </memballoon>
Jul 24 16:23:47 user nova-compute[70243]:   </devices>
Jul 24 16:23:47 user nova-compute[70243]: </domain>
Jul 24 16:23:47 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1766332538',display_name='tempest-VolumesActionsTest-instance-1766332538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1766332538',id=16,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc232fc3856a4edb8adc0c47cb15cc66',ramdisk_id='',reservation_id='r-5z3f7kxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1813125667',owner_user_name='tempest-VolumesActionsTest-1813125667-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:23:44Z,user_data=None,user_id='05e972674e79471db0805b73b7d3d93f',uuid=66147ca4-6c90-4ed8-b6f4-6437d0e8c38b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebb9c545-4b4b-4765-848b-e81ff8cd8bed", "address": "fa:16:3e:e2:95:9b", "network": {"id": "b0c05f1d-624c-49c4-98a2-20542fd327de", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1473655018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc232fc3856a4edb8adc0c47cb15cc66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb9c545-4b", "ovs_interfaceid": "ebb9c545-4b4b-4765-848b-e81ff8cd8bed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Converting VIF {"id": "ebb9c545-4b4b-4765-848b-e81ff8cd8bed", "address": "fa:16:3e:e2:95:9b", "network": {"id": "b0c05f1d-624c-49c4-98a2-20542fd327de", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1473655018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc232fc3856a4edb8adc0c47cb15cc66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb9c545-4b", "ovs_interfaceid": "ebb9c545-4b4b-4765-848b-e81ff8cd8bed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:95:9b,bridge_name='br-int',has_traffic_filtering=True,id=ebb9c545-4b4b-4765-848b-e81ff8cd8bed,network=Network(b0c05f1d-624c-49c4-98a2-20542fd327de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb9c545-4b') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG os_vif [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:95:9b,bridge_name='br-int',has_traffic_filtering=True,id=ebb9c545-4b4b-4765-848b-e81ff8cd8bed,network=Network(b0c05f1d-624c-49c4-98a2-20542fd327de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb9c545-4b') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebb9c545-4b, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapebb9c545-4b, col_values=(('external_ids', {'iface-id': 'ebb9c545-4b4b-4765-848b-e81ff8cd8bed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:95:9b', 'vm-uuid': '66147ca4-6c90-4ed8-b6f4-6437d0e8c38b'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:47 user nova-compute[70243]: INFO os_vif [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:95:9b,bridge_name='br-int',has_traffic_filtering=True,id=ebb9c545-4b4b-4765-848b-e81ff8cd8bed,network=Network(b0c05f1d-624c-49c4-98a2-20542fd327de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb9c545-4b')
Jul 24 16:23:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] No VIF found with MAC fa:16:3e:e2:95:9b, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG nova.network.neutron [req-9bd68dee-0de8-4f32-9f46-9cb55e9b86c4 req-d63d9aa1-6e50-46de-b2ae-b0fdfbd6271d service nova] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Updated VIF entry in instance network info cache for port ebb9c545-4b4b-4765-848b-e81ff8cd8bed. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG nova.network.neutron [req-9bd68dee-0de8-4f32-9f46-9cb55e9b86c4 req-d63d9aa1-6e50-46de-b2ae-b0fdfbd6271d service nova] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Updating instance_info_cache with network_info: [{"id": "ebb9c545-4b4b-4765-848b-e81ff8cd8bed", "address": "fa:16:3e:e2:95:9b", "network": {"id": "b0c05f1d-624c-49c4-98a2-20542fd327de", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1473655018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc232fc3856a4edb8adc0c47cb15cc66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb9c545-4b", "ovs_interfaceid": "ebb9c545-4b4b-4765-848b-e81ff8cd8bed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9bd68dee-0de8-4f32-9f46-9cb55e9b86c4 req-d63d9aa1-6e50-46de-b2ae-b0fdfbd6271d service nova] Releasing lock "refresh_cache-66147ca4-6c90-4ed8-b6f4-6437d0e8c38b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.842s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Cleaning up deleted instances {{(pid=70243) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] There are 0 instances to clean {{(pid=70243) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 16:23:47 user nova-compute[70243]: INFO nova.compute.manager [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Took 0.88 seconds to detach 1 volumes for instance.
Jul 24 16:23:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Deleting volume: 75d2beea-53f6-4026-a9fa-a819238dbf73 {{(pid=70243) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:47 user nova-compute[70243]: INFO nova.compute.manager [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Took 2.74 seconds to detach 3 volumes for instance.
Jul 24 16:23:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:48 user nova-compute[70243]: DEBUG nova.compute.manager [req-0665c638-d024-4fa2-8c38-0ca5a996d45d req-c3ca830c-5e84-45c8-b615-92bae0761e3e service nova] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Received event network-vif-deleted-51cc58b9-958f-41dd-bf1d-596ca7c6d5ce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:48 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:23:48 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:23:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.264s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:48 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Deleted allocations for instance fd314e21-b1a5-425d-a5e0-c1b3303b72d4
Jul 24 16:23:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-31e13897-7da6-4780-812c-ea805e0d5a12 tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "fd314e21-b1a5-425d-a5e0-c1b3303b72d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.714s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:48 user nova-compute[70243]: INFO nova.compute.manager [None req-55e2d9fd-31f7-4d71-8844-3abfcf603a69 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Unrescuing
Jul 24 16:23:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-55e2d9fd-31f7-4d71-8844-3abfcf603a69 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquiring lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:23:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-55e2d9fd-31f7-4d71-8844-3abfcf603a69 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquired lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:23:48 user nova-compute[70243]: DEBUG nova.network.neutron [None req-55e2d9fd-31f7-4d71-8844-3abfcf603a69 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:23:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:48 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:23:48 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:23:48 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:23:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:48 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:23:48 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:23:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.530s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:23:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:23:48 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:23:48 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Deleted allocations for instance edf964e0-bee8-42c8-b4eb-dd490d3fa2ab
Jul 24 16:23:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-99f455f2-1c11-40f7-8cad-46dfd91377a5 tempest-TaggedBootDevicesTest_v242-1365347111 tempest-TaggedBootDevicesTest_v242-1365347111-project-member] Lock "edf964e0-bee8-42c8-b4eb-dd490d3fa2ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.122s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:49 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Updating instance_info_cache with network_info: [{"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:23:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:23:49 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:23:49 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:23:49 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:23:49 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:23:49 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:23:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:49 user nova-compute[70243]: DEBUG nova.compute.manager [req-a1c40753-aac0-4a98-b8c0-7d057fe59a87 req-c7f81fd0-ec1d-43e3-a1bc-7723268dafae service nova] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Received event network-vif-plugged-ebb9c545-4b4b-4765-848b-e81ff8cd8bed {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a1c40753-aac0-4a98-b8c0-7d057fe59a87 req-c7f81fd0-ec1d-43e3-a1bc-7723268dafae service nova] Acquiring lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a1c40753-aac0-4a98-b8c0-7d057fe59a87 req-c7f81fd0-ec1d-43e3-a1bc-7723268dafae service nova] Lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a1c40753-aac0-4a98-b8c0-7d057fe59a87 req-c7f81fd0-ec1d-43e3-a1bc-7723268dafae service nova] Lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:49 user nova-compute[70243]: DEBUG nova.compute.manager [req-a1c40753-aac0-4a98-b8c0-7d057fe59a87 req-c7f81fd0-ec1d-43e3-a1bc-7723268dafae service nova] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] No waiting events found dispatching network-vif-plugged-ebb9c545-4b4b-4765-848b-e81ff8cd8bed {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:49 user nova-compute[70243]: WARNING nova.compute.manager [req-a1c40753-aac0-4a98-b8c0-7d057fe59a87 req-c7f81fd0-ec1d-43e3-a1bc-7723268dafae service nova] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Received unexpected event network-vif-plugged-ebb9c545-4b4b-4765-848b-e81ff8cd8bed for instance with vm_state building and task_state spawning.
Jul 24 16:23:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "ad611655-ba4d-4a66-b78e-a82c058f4414" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:49 user nova-compute[70243]: INFO nova.compute.manager [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Detaching volume d2139cf8-69f4-4150-a7c5-221311a1ac1c
Jul 24 16:23:49 user nova-compute[70243]: DEBUG nova.network.neutron [None req-55e2d9fd-31f7-4d71-8844-3abfcf603a69 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Updating instance_info_cache with network_info: [{"id": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "address": "fa:16:3e:92:8d:42", "network": {"id": "69c0285e-5c28-41c5-893d-9d92e9626cb2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808448879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c70a6d9bf46466da48267f2fc2e02d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2943f763-29", "ovs_interfaceid": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:23:49 user nova-compute[70243]: INFO nova.virt.block_device [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Attempting to driver detach volume d2139cf8-69f4-4150-a7c5-221311a1ac1c from mountpoint /dev/vdb
Jul 24 16:23:49 user nova-compute[70243]: DEBUG nova.compute.manager [req-04ba1def-fa3d-4624-a9cc-5a8d328e87c6 req-269dd861-88f6-4402-bb2e-4a546e7f2902 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received event network-changed-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:49 user nova-compute[70243]: DEBUG nova.compute.manager [req-04ba1def-fa3d-4624-a9cc-5a8d328e87c6 req-269dd861-88f6-4402-bb2e-4a546e7f2902 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Refreshing instance network info cache due to event network-changed-2943f763-290c-46a8-90cf-f0e6b59a2be4. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:23:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-04ba1def-fa3d-4624-a9cc-5a8d328e87c6 req-269dd861-88f6-4402-bb2e-4a546e7f2902 service nova] Acquiring lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Attempting to detach device vdb from instance ad611655-ba4d-4a66-b78e-a82c058f4414 from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:23:50 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:23:50 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:23:50 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:23:50 user nova-compute[70243]:   <serial>d2139cf8-69f4-4150-a7c5-221311a1ac1c</serial>
Jul 24 16:23:50 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 16:23:50 user nova-compute[70243]: </disk>
Jul 24 16:23:50 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:23:50 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Successfully detached device vdb from instance ad611655-ba4d-4a66-b78e-a82c058f4414 from the persistent domain config.
Jul 24 16:23:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ad611655-ba4d-4a66-b78e-a82c058f4414 from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:23:50 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:23:50 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:23:50 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:23:50 user nova-compute[70243]:   <serial>d2139cf8-69f4-4150-a7c5-221311a1ac1c</serial>
Jul 24 16:23:50 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 16:23:50 user nova-compute[70243]: </disk>
Jul 24 16:23:50 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-55e2d9fd-31f7-4d71-8844-3abfcf603a69 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Releasing lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG nova.objects.instance [None req-55e2d9fd-31f7-4d71-8844-3abfcf603a69 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lazy-loading 'flavor' on Instance uuid a13c243a-2b98-4ef1-b17c-e2e15ba005fd {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-04ba1def-fa3d-4624-a9cc-5a8d328e87c6 req-269dd861-88f6-4402-bb2e-4a546e7f2902 service nova] Acquired lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG nova.network.neutron [req-04ba1def-fa3d-4624-a9cc-5a8d328e87c6 req-269dd861-88f6-4402-bb2e-4a546e7f2902 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Refreshing network info cache for port 2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG nova.compute.manager [req-50fbc689-d996-4792-8eba-ca54f207ee9c req-6e11706d-7ad8-4279-9dda-70e1b45af59d service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received event network-vif-unplugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-50fbc689-d996-4792-8eba-ca54f207ee9c req-6e11706d-7ad8-4279-9dda-70e1b45af59d service nova] Acquiring lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-50fbc689-d996-4792-8eba-ca54f207ee9c req-6e11706d-7ad8-4279-9dda-70e1b45af59d service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-50fbc689-d996-4792-8eba-ca54f207ee9c req-6e11706d-7ad8-4279-9dda-70e1b45af59d service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG nova.compute.manager [req-50fbc689-d996-4792-8eba-ca54f207ee9c req-6e11706d-7ad8-4279-9dda-70e1b45af59d service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] No waiting events found dispatching network-vif-unplugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:50 user nova-compute[70243]: WARNING nova.compute.manager [req-50fbc689-d996-4792-8eba-ca54f207ee9c req-6e11706d-7ad8-4279-9dda-70e1b45af59d service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received unexpected event network-vif-unplugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 for instance with vm_state rescued and task_state unrescuing.
Jul 24 16:23:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690215830.5683568, ad611655-ba4d-4a66-b78e-a82c058f4414 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:23:50 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Successfully detached device vdb from instance ad611655-ba4d-4a66-b78e-a82c058f4414 from the live domain config.
Jul 24 16:23:50 user nova-compute[70243]: DEBUG nova.network.neutron [req-04ba1def-fa3d-4624-a9cc-5a8d328e87c6 req-269dd861-88f6-4402-bb2e-4a546e7f2902 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Updated VIF entry in instance network info cache for port 2943f763-290c-46a8-90cf-f0e6b59a2be4. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG nova.network.neutron [req-04ba1def-fa3d-4624-a9cc-5a8d328e87c6 req-269dd861-88f6-4402-bb2e-4a546e7f2902 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Updating instance_info_cache with network_info: [{"id": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "address": "fa:16:3e:92:8d:42", "network": {"id": "69c0285e-5c28-41c5-893d-9d92e9626cb2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808448879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c70a6d9bf46466da48267f2fc2e02d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2943f763-29", "ovs_interfaceid": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'raMPwoih', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:23:50 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:23:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-04ba1def-fa3d-4624-a9cc-5a8d328e87c6 req-269dd861-88f6-4402-bb2e-4a546e7f2902 service nova] Releasing lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1c543e-27bb-4faa-b115-8a2a4e14b7f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:23:50 user nova-compute[70243]: No targets found.
Jul 24 16:23:50 user nova-compute[70243]: iSNS:
Jul 24 16:23:50 user nova-compute[70243]: No targets found.
Jul 24 16:23:50 user nova-compute[70243]: STATIC:
Jul 24 16:23:50 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b
Jul 24 16:23:50 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:50 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:50 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323
Jul 24 16:23:50 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:50 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:50 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b
Jul 24 16:23:50 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:50 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:50 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c
Jul 24 16:23:50 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:50 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:50 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b
Jul 24 16:23:50 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:23:50 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:23:50 user nova-compute[70243]: FIRMWARE:
Jul 24 16:23:50 user nova-compute[70243]: No targets found.
Jul 24 16:23:50 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:23:50 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:23:50 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5793eaa7-a0ee-4df8-acc4-7ea9cc4c48dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[18854eee-deee-48b2-8a7a-42371a76164c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:23:50 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:23:50 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:23:50 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:23:50 user nova-compute[70243]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:23:50 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:23:50 user nova-compute[70243]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c (non-flash)
Jul 24 16:23:50 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:23:50 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:23:50 user nova-compute[70243]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:23:50 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc137400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c'): ({'sdb'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Removing single pathed devices sdb {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5367d2a7-ffa4-4a5e-879b-60372ebaeb8a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[412980f2-5118-4e46-aedd-702e1d662d67]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Flushing IO for device /dev/sdb {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcfe6db-9fd0-48c0-8ead-82a373c010f2]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.066s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe847dd5-99f4-46e1-a068-38c0b13ba6c8]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8d9b2d-25b4-4b9d-bc7f-377193734df7]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:50 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Instance destroyed successfully.
Jul 24 16:23:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dd0f42-f2c8-40d8-9b1f-fe53ac93651d]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c, portal: 172.16.0.220,3260]
Jul 24 16:23:51 user nova-compute[70243]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c, portal: 172.16.0.220,3260] successful.
Jul 24 16:23:51 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2139cf8-69f4-4150-a7c5-221311a1ac1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed392b4-cd8e-4896-9c95-ef77acf90d1e]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] <== disconnect_volume: return (451ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG nova.compute.manager [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:23:51 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Instance spawned successfully.
Jul 24 16:23:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215831.0849144, 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:23:51 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] VM Resumed (Lifecycle Event)
Jul 24 16:23:51 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:23:51 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:23:51 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215831.0853148, 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:23:51 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] VM Started (Lifecycle Event)
Jul 24 16:23:51 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:23:51 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:23:51 user nova-compute[70243]: INFO nova.compute.manager [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Took 7.34 seconds to spawn the instance on the hypervisor.
Jul 24 16:23:51 user nova-compute[70243]: DEBUG nova.compute.manager [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:23:51 user nova-compute[70243]: INFO nova.compute.manager [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Took 8.60 seconds to build instance.
Jul 24 16:23:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fef4c185-4b46-4bf3-9929-0c8ee5c9c954 tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.756s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690215816.5253127, edf964e0-bee8-42c8-b4eb-dd490d3fa2ab => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:23:51 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] VM Stopped (Lifecycle Event)
Jul 24 16:23:51 user nova-compute[70243]: DEBUG nova.compute.manager [None req-0561fc18-ff13-44f8-be12-c54d6e545897 None None] [instance: edf964e0-bee8-42c8-b4eb-dd490d3fa2ab] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG nova.compute.manager [req-58235e7c-4565-417f-8d45-e7a8d6551d43 req-69855f8a-8bca-4af1-a668-f17935fb121d service nova] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Received event network-vif-plugged-ebb9c545-4b4b-4765-848b-e81ff8cd8bed {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-58235e7c-4565-417f-8d45-e7a8d6551d43 req-69855f8a-8bca-4af1-a668-f17935fb121d service nova] Acquiring lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-58235e7c-4565-417f-8d45-e7a8d6551d43 req-69855f8a-8bca-4af1-a668-f17935fb121d service nova] Lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-58235e7c-4565-417f-8d45-e7a8d6551d43 req-69855f8a-8bca-4af1-a668-f17935fb121d service nova] Lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG nova.compute.manager [req-58235e7c-4565-417f-8d45-e7a8d6551d43 req-69855f8a-8bca-4af1-a668-f17935fb121d service nova] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] No waiting events found dispatching network-vif-plugged-ebb9c545-4b4b-4765-848b-e81ff8cd8bed {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:51 user nova-compute[70243]: WARNING nova.compute.manager [req-58235e7c-4565-417f-8d45-e7a8d6551d43 req-69855f8a-8bca-4af1-a668-f17935fb121d service nova] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Received unexpected event network-vif-plugged-ebb9c545-4b4b-4765-848b-e81ff8cd8bed for instance with vm_state active and task_state None.
Jul 24 16:23:51 user nova-compute[70243]: DEBUG nova.objects.instance [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'flavor' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:23:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-daba7026-ad53-4605-a715-716b0751b66e tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.083s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG nova.compute.manager [req-0d149abe-933d-4e44-a7db-3e0438b9d7e5 req-c8e23874-1486-4a3a-892d-647170c975e5 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received event network-changed-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG nova.compute.manager [req-0d149abe-933d-4e44-a7db-3e0438b9d7e5 req-c8e23874-1486-4a3a-892d-647170c975e5 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Refreshing instance network info cache due to event network-changed-2943f763-290c-46a8-90cf-f0e6b59a2be4. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0d149abe-933d-4e44-a7db-3e0438b9d7e5 req-c8e23874-1486-4a3a-892d-647170c975e5 service nova] Acquiring lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0d149abe-933d-4e44-a7db-3e0438b9d7e5 req-c8e23874-1486-4a3a-892d-647170c975e5 service nova] Acquired lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG nova.network.neutron [req-0d149abe-933d-4e44-a7db-3e0438b9d7e5 req-c8e23874-1486-4a3a-892d-647170c975e5 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Refreshing network info cache for port 2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ff7e7fb3-6dc4-4083-8667-91db42a1c66a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "ad611655-ba4d-4a66-b78e-a82c058f4414" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ff7e7fb3-6dc4-4083-8667-91db42a1c66a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ff7e7fb3-6dc4-4083-8667-91db42a1c66a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ff7e7fb3-6dc4-4083-8667-91db42a1c66a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=70243) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3341}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG nova.objects.instance [None req-ff7e7fb3-6dc4-4083-8667-91db42a1c66a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'flavor' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG nova.compute.manager [req-5f19a985-4552-4bc6-a8c6-2f548b6cc495 req-cd7f081e-5b45-4f76-90a3-d8d5832afc9d service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received event network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5f19a985-4552-4bc6-a8c6-2f548b6cc495 req-cd7f081e-5b45-4f76-90a3-d8d5832afc9d service nova] Acquiring lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5f19a985-4552-4bc6-a8c6-2f548b6cc495 req-cd7f081e-5b45-4f76-90a3-d8d5832afc9d service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5f19a985-4552-4bc6-a8c6-2f548b6cc495 req-cd7f081e-5b45-4f76-90a3-d8d5832afc9d service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG nova.compute.manager [req-5f19a985-4552-4bc6-a8c6-2f548b6cc495 req-cd7f081e-5b45-4f76-90a3-d8d5832afc9d service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] No waiting events found dispatching network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:52 user nova-compute[70243]: WARNING nova.compute.manager [req-5f19a985-4552-4bc6-a8c6-2f548b6cc495 req-cd7f081e-5b45-4f76-90a3-d8d5832afc9d service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received unexpected event network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 for instance with vm_state rescued and task_state unrescuing.
Jul 24 16:23:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:53 user nova-compute[70243]: DEBUG nova.network.neutron [req-0d149abe-933d-4e44-a7db-3e0438b9d7e5 req-c8e23874-1486-4a3a-892d-647170c975e5 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Updated VIF entry in instance network info cache for port 2943f763-290c-46a8-90cf-f0e6b59a2be4. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:23:53 user nova-compute[70243]: DEBUG nova.network.neutron [req-0d149abe-933d-4e44-a7db-3e0438b9d7e5 req-c8e23874-1486-4a3a-892d-647170c975e5 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Updating instance_info_cache with network_info: [{"id": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "address": "fa:16:3e:92:8d:42", "network": {"id": "69c0285e-5c28-41c5-893d-9d92e9626cb2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808448879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c70a6d9bf46466da48267f2fc2e02d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2943f763-29", "ovs_interfaceid": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:23:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0d149abe-933d-4e44-a7db-3e0438b9d7e5 req-c8e23874-1486-4a3a-892d-647170c975e5 service nova] Releasing lock "refresh_cache-a13c243a-2b98-4ef1-b17c-e2e15ba005fd" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:23:53 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Instance destroyed successfully.
Jul 24 16:23:53 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ff7e7fb3-6dc4-4083-8667-91db42a1c66a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:23:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ff7e7fb3-6dc4-4083-8667-91db42a1c66a tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.157s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:54 user nova-compute[70243]: DEBUG nova.compute.manager [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received event network-vif-unplugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] Acquiring lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:54 user nova-compute[70243]: DEBUG nova.compute.manager [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] No waiting events found dispatching network-vif-unplugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:54 user nova-compute[70243]: WARNING nova.compute.manager [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received unexpected event network-vif-unplugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 for instance with vm_state stopped and task_state None.
Jul 24 16:23:54 user nova-compute[70243]: DEBUG nova.compute.manager [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received event network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] Acquiring lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:54 user nova-compute[70243]: DEBUG nova.compute.manager [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] No waiting events found dispatching network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:54 user nova-compute[70243]: WARNING nova.compute.manager [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received unexpected event network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 for instance with vm_state stopped and task_state None.
Jul 24 16:23:54 user nova-compute[70243]: DEBUG nova.compute.manager [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received event network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] Acquiring lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:54 user nova-compute[70243]: DEBUG nova.compute.manager [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] No waiting events found dispatching network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:54 user nova-compute[70243]: WARNING nova.compute.manager [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received unexpected event network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 for instance with vm_state rescued and task_state unrescuing.
Jul 24 16:23:54 user nova-compute[70243]: DEBUG nova.compute.manager [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received event network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:23:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] Acquiring lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:23:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:23:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:23:54 user nova-compute[70243]: DEBUG nova.compute.manager [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] No waiting events found dispatching network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:23:54 user nova-compute[70243]: WARNING nova.compute.manager [req-fba62b9a-33fa-465e-86a0-efdcb1a6fb03 req-605897e4-45e1-4ac9-96f9-cb5a64c42493 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received unexpected event network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 for instance with vm_state rescued and task_state unrescuing.
Jul 24 16:23:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Removed pending event for a13c243a-2b98-4ef1-b17c-e2e15ba005fd due to event {{(pid=70243) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 16:23:55 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215835.4550014, a13c243a-2b98-4ef1-b17c-e2e15ba005fd => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:23:55 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] VM Resumed (Lifecycle Event)
Jul 24 16:23:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-55e2d9fd-31f7-4d71-8844-3abfcf603a69 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:23:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:23:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:23:55 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 24 16:23:55 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215835.456493, a13c243a-2b98-4ef1-b17c-e2e15ba005fd => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:23:55 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] VM Started (Lifecycle Event)
Jul 24 16:23:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:23:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:23:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:23:59 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690215824.4821694, fd314e21-b1a5-425d-a5e0-c1b3303b72d4 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:23:59 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] VM Stopped (Lifecycle Event)
Jul 24 16:23:59 user nova-compute[70243]: DEBUG nova.compute.manager [None req-461f3ed0-897a-4331-a604-d58068fe4da8 None None] [instance: fd314e21-b1a5-425d-a5e0-c1b3303b72d4] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:23:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Port 66249aa8-373c-45b2-940f-74f7e6228bce binding to destination host user is already ACTIVE {{(pid=70243) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 24 16:24:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:24:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquired lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:24:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:24:01 user nova-compute[70243]: DEBUG nova.network.neutron [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Updating instance_info_cache with network_info: [{"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:24:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Releasing lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:24:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Creating tmpfile /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/tmpoeh7jsww to verify with other compute node that the instance is on the same shared storage. {{(pid=70243) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Jul 24 16:24:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:01 user nova-compute[70243]: DEBUG nova.compute.manager [req-0b6a6200-c291-435c-990f-2f682ff9f72a req-2bf08b07-ef74-476c-82a0-38c69b19d1f2 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received event network-vif-unplugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:24:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0b6a6200-c291-435c-990f-2f682ff9f72a req-2bf08b07-ef74-476c-82a0-38c69b19d1f2 service nova] Acquiring lock "5f70528b-33db-4257-96fe-e5fad869a224-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0b6a6200-c291-435c-990f-2f682ff9f72a req-2bf08b07-ef74-476c-82a0-38c69b19d1f2 service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0b6a6200-c291-435c-990f-2f682ff9f72a req-2bf08b07-ef74-476c-82a0-38c69b19d1f2 service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:01 user nova-compute[70243]: DEBUG nova.compute.manager [req-0b6a6200-c291-435c-990f-2f682ff9f72a req-2bf08b07-ef74-476c-82a0-38c69b19d1f2 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] No waiting events found dispatching network-vif-unplugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:24:01 user nova-compute[70243]: WARNING nova.compute.manager [req-0b6a6200-c291-435c-990f-2f682ff9f72a req-2bf08b07-ef74-476c-82a0-38c69b19d1f2 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received unexpected event network-vif-unplugged-66249aa8-373c-45b2-940f-74f7e6228bce for instance with vm_state resized and task_state resize_reverting.
Jul 24 16:24:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:02 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Instance destroyed successfully.
Jul 24 16:24:02 user nova-compute[70243]: DEBUG nova.objects.instance [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lazy-loading 'resources' on Instance uuid 5f70528b-33db-4257-96fe-e5fad869a224 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1291679900',display_name='tempest-ServerActionsTestOtherB-server-1291679900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1291679900',id=6,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqymb2uus6Bkqa8Jv1s5ZbibCwJHiHaRW+MVWVRPkPu9Fm+8ajStg97Lu5Oh0gjEFACHSPElKL2d/v4nyEqxN0n8bX7piloSV6v2kR0JjimuB49HIj2A6fdu+bprtip6w==',key_name='tempest-keypair-692701',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:22:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5385c4cfc8d84d1abd728c11d75c003d',ramdisk_id='',reservation_id='r-tutxnqyd',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-485175328',owner_user_name='tempest-ServerActionsTestOtherB-485175328-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:22:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9db33a574c334a2d91afc72b21ef15e6',uuid=5f70528b-33db-4257-96fe-e5fad869a224,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Converting VIF {"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=66249aa8-373c-45b2-940f-74f7e6228bce,network=Network(109feefe-8734-40ee-a8b8-2defa6e83853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66249aa8-37') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG os_vif [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=66249aa8-373c-45b2-940f-74f7e6228bce,network=Network(109feefe-8734-40ee-a8b8-2defa6e83853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66249aa8-37') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66249aa8-37, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:02 user nova-compute[70243]: INFO os_vif [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=66249aa8-373c-45b2-940f-74f7e6228bce,network=Network(109feefe-8734-40ee-a8b8-2defa6e83853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66249aa8-37')
Jul 24 16:24:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OARbsQWM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:24:02 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:24:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3238291-7c91-45d9-856b-1c82acc1a937]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:24:02 user nova-compute[70243]: No targets found.
Jul 24 16:24:02 user nova-compute[70243]: iSNS:
Jul 24 16:24:02 user nova-compute[70243]: No targets found.
Jul 24 16:24:02 user nova-compute[70243]: STATIC:
Jul 24 16:24:02 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b
Jul 24 16:24:02 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:24:02 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:24:02 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323
Jul 24 16:24:02 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:24:02 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:24:02 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b
Jul 24 16:24:02 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:24:02 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:24:02 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b
Jul 24 16:24:02 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:24:02 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:24:02 user nova-compute[70243]: FIRMWARE:
Jul 24 16:24:02 user nova-compute[70243]: No targets found.
Jul 24 16:24:02 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:24:02 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:24:02 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a5fc41-8b3e-4790-b23a-7e66cbc45744]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1653ef88-ea77-4b13-931e-f2a25207c1d7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:24:02 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:24:02 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:24:02 user nova-compute[70243]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:24:02 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:24:02 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:24:02 user nova-compute[70243]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:24:02 user nova-compute[70243]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:24:02 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc13d900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b'): ({'sdi'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Removing single pathed devices sdi {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9d9cbf-a5d8-4c63-86f5-d95b62db30c3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f30cae0-ffce-406f-a539-3c3dc346ec10]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Flushing IO for device /dev/sdi {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc126ce0-5391-45b7-9e78-859ba29e48fc]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.059s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1af6e2a-c911-4c8d-9c09-b4580cf9272a]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] SCSI volumes sdi have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfdaf7d-a0f2-446f-8fb8-4b695646340f]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe10d376-5075-4170-b4a9-ea662e12b341]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260]
Jul 24 16:24:02 user nova-compute[70243]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260] successful.
Jul 24 16:24:02 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf150dc4-5ed3-4443-86d5-0928e4dc59cd]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] <== disconnect_volume: return (352ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:24:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:24:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:03 user nova-compute[70243]: DEBUG nova.objects.instance [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lazy-loading 'migration_context' on Instance uuid 5f70528b-33db-4257-96fe-e5fad869a224 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:24:03 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:24:03 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:24:03 user nova-compute[70243]: DEBUG nova.compute.manager [req-4c879b1a-40f2-40b1-bf33-4091381acddb req-339429fe-e053-4c2e-ae53-fb81210476fc service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received event network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:24:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4c879b1a-40f2-40b1-bf33-4091381acddb req-339429fe-e053-4c2e-ae53-fb81210476fc service nova] Acquiring lock "5f70528b-33db-4257-96fe-e5fad869a224-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4c879b1a-40f2-40b1-bf33-4091381acddb req-339429fe-e053-4c2e-ae53-fb81210476fc service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4c879b1a-40f2-40b1-bf33-4091381acddb req-339429fe-e053-4c2e-ae53-fb81210476fc service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:03 user nova-compute[70243]: DEBUG nova.compute.manager [req-4c879b1a-40f2-40b1-bf33-4091381acddb req-339429fe-e053-4c2e-ae53-fb81210476fc service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] No waiting events found dispatching network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:24:03 user nova-compute[70243]: WARNING nova.compute.manager [req-4c879b1a-40f2-40b1-bf33-4091381acddb req-339429fe-e053-4c2e-ae53-fb81210476fc service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received unexpected event network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce for instance with vm_state resized and task_state resize_reverting.
Jul 24 16:24:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.413s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:04 user nova-compute[70243]: INFO nova.compute.manager [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Swapping old allocation on dict_keys(['428d8cd7-181b-4d2d-ad06-02c79cc6b5e0']) held by migration 2665c832-2ece-47d5-a25b-f3b87ff0d645 for instance
Jul 24 16:24:04 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Overwriting current allocation {'allocations': {'428d8cd7-181b-4d2d-ad06-02c79cc6b5e0': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 20}}, 'project_id': '5385c4cfc8d84d1abd728c11d75c003d', 'user_id': '9db33a574c334a2d91afc72b21ef15e6', 'consumer_generation': 1} on consumer 5f70528b-33db-4257-96fe-e5fad869a224 {{(pid=70243) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Jul 24 16:24:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:24:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquired lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:24:04 user nova-compute[70243]: DEBUG nova.network.neutron [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:24:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:04 user nova-compute[70243]: DEBUG nova.network.neutron [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Updating instance_info_cache with network_info: [{"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:24:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Releasing lock "refresh_cache-5f70528b-33db-4257-96fe-e5fad869a224" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:24:04 user nova-compute[70243]: DEBUG os_brick.utils [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:24:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b36501f-2c5e-41f8-995a-308d6312e7ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d504e6-f5a3-4b5c-b8ef-29704da8fdb2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c9b62a-112a-4315-be80-2b660a26c4f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4712ff-0733-4ab9-9c47-077930374280]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:24:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:24:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:24:05 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:24:05 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b4acfb-ae9c-40be-a141-a79909ff56bd]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:24:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:24:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:24:05 user nova-compute[70243]: DEBUG os_brick.utils [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:24:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:08 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690215833.4538496, ad611655-ba4d-4a66-b78e-a82c058f4414 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:24:08 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] VM Stopped (Lifecycle Event)
Jul 24 16:24:08 user nova-compute[70243]: DEBUG nova.compute.manager [None req-7676c56f-d2c4-40f9-834a-e8ed38085b22 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:24:08 user nova-compute[70243]: DEBUG nova.compute.manager [None req-7676c56f-d2c4-40f9-834a-e8ed38085b22 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:24:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:24:10 user nova-compute[70243]: WARNING nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Jul 24 16:24:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Triggering sync for uuid de22ea98-b041-4f3f-8986-435c43267a2e {{(pid=70243) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Triggering sync for uuid de484cb2-7f20-4bf1-927b-c066735bfeca {{(pid=70243) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Triggering sync for uuid a13c243a-2b98-4ef1-b17c-e2e15ba005fd {{(pid=70243) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Triggering sync for uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Triggering sync for uuid 5f70528b-33db-4257-96fe-e5fad869a224 {{(pid=70243) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Triggering sync for uuid c2ee17ba-3482-4caf-992e-30b3953d1e91 {{(pid=70243) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Triggering sync for uuid b0dd6065-3916-4f0e-841e-3df5ded2e2ee {{(pid=70243) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Triggering sync for uuid abcd54bc-02d4-4872-8227-43cb93d27491 {{(pid=70243) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Triggering sync for uuid 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b {{(pid=70243) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "de22ea98-b041-4f3f-8986-435c43267a2e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "de22ea98-b041-4f3f-8986-435c43267a2e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "de484cb2-7f20-4bf1-927b-c066735bfeca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "de484cb2-7f20-4bf1-927b-c066735bfeca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "ad611655-ba4d-4a66-b78e-a82c058f4414" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "5f70528b-33db-4257-96fe-e5fad869a224" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "5f70528b-33db-4257-96fe-e5fad869a224" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:10 user nova-compute[70243]: INFO nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "5f70528b-33db-4257-96fe-e5fad869a224" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "c2ee17ba-3482-4caf-992e-30b3953d1e91" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "c2ee17ba-3482-4caf-992e-30b3953d1e91" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "abcd54bc-02d4-4872-8227-43cb93d27491" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "abcd54bc-02d4-4872-8227-43cb93d27491" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "de22ea98-b041-4f3f-8986-435c43267a2e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "de484cb2-7f20-4bf1-927b-c066735bfeca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "c2ee17ba-3482-4caf-992e-30b3953d1e91" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "abcd54bc-02d4-4872-8227-43cb93d27491" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Starting finish_revert_migration {{(pid=70243) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Start _get_guest_xml network_info=[{"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OARbsQWM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5f70528b-33db-4257-96fe-e5fad869a224', 'attached_at': '2023-07-24T16:24:11.000000', 'detached_at': '', 'volume_id': '5d0447c3-66c4-4105-9a6f-9187ae43f96b', 'serial': '5d0447c3-66c4-4105-9a6f-9187ae43f96b'}, 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '4c24104d-31fd-45f9-b7f5-20bd93f018c3', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:24:11 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:24:11 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:24:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG nova.objects.instance [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5f70528b-33db-4257-96fe-e5fad869a224 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OARbsQWM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:24:11 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:24:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:24:11 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:24:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:24:11 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca275a3-9c9b-4da2-b92a-10c06aac13c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:24:11 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b0cadd-68de-471e-858f-3bb84bd7326a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b] added
Jul 24 16:24:11 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf116d62-d64b-4849-bd60-08c8698b12cc]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[949cbd4d-5590-447c-af33-98708d8a7ebd]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OARbsQWM {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OARbsQWM" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4824f85a-83a2-4e24-bef1-7565f69a6a64]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OARbsQWM'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[81374a3e-81eb-4e71-a0c1-d948884cf435]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d62d096-5bdb-4631-b3f0-928079c967ab]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:24:11 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:24:11 user nova-compute[70243]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:24:11 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:24:11 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:24:11 user nova-compute[70243]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:24:11 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0993df-693d-46d1-a891-bc5594f847f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260]
Jul 24 16:24:11 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260] successful.
Jul 24 16:24:11 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[33460d2d-db10-4601-803b-138f50549d08]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d02544-9c2f-4516-acb6-4115a5818010]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:24:11 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:24:11 user nova-compute[70243]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:24:11 user nova-compute[70243]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:24:11 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:24:11 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:24:11 user nova-compute[70243]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:24:11 user nova-compute[70243]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:24:11 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:24:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b4e181-feeb-45fb-9475-439f2daeb9e3]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:12 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:24:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OARbsQWM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:24:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:13 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:24:13 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23736366534623431', 'path': '/dev/sdb'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:24:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736366534623431', 'path': '/dev/sdb'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:24:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1291679900',display_name='tempest-ServerActionsTestOtherB-server-1291679900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1291679900',id=6,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqymb2uus6Bkqa8Jv1s5ZbibCwJHiHaRW+MVWVRPkPu9Fm+8ajStg97Lu5Oh0gjEFACHSPElKL2d/v4nyEqxN0n8bX7piloSV6v2kR0JjimuB49HIj2A6fdu+bprtip6w==',key_name='tempest-keypair-692701',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:22:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5385c4cfc8d84d1abd728c11d75c003d',ramdisk_id='',reservation_id='r-tutxnqyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-485175328',owner_user_name='tempest-ServerActionsTestOtherB-485175328-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:24:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9db33a574c334a2d91afc72b21ef15e6',uuid=5f70528b-33db-4257-96fe-e5fad869a224,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:24:13 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Converting VIF {"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:24:13 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=66249aa8-373c-45b2-940f-74f7e6228bce,network=Network(109feefe-8734-40ee-a8b8-2defa6e83853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66249aa8-37') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:24:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:24:13 user nova-compute[70243]:   <uuid>5f70528b-33db-4257-96fe-e5fad869a224</uuid>
Jul 24 16:24:13 user nova-compute[70243]:   <name>instance-00000006</name>
Jul 24 16:24:13 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:24:13 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:24:13 user nova-compute[70243]:   <metadata>
Jul 24 16:24:13 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:24:13 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:24:13 user nova-compute[70243]:       <nova:name>tempest-ServerActionsTestOtherB-server-1291679900</nova:name>
Jul 24 16:24:13 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:24:11</nova:creationTime>
Jul 24 16:24:13 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:24:13 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:24:13 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:24:13 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:24:13 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:24:13 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:24:13 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:24:13 user nova-compute[70243]:       <nova:owner>
Jul 24 16:24:13 user nova-compute[70243]:         <nova:user uuid="9db33a574c334a2d91afc72b21ef15e6">tempest-ServerActionsTestOtherB-485175328-project-member</nova:user>
Jul 24 16:24:13 user nova-compute[70243]:         <nova:project uuid="5385c4cfc8d84d1abd728c11d75c003d">tempest-ServerActionsTestOtherB-485175328</nova:project>
Jul 24 16:24:13 user nova-compute[70243]:       </nova:owner>
Jul 24 16:24:13 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:24:13 user nova-compute[70243]:       <nova:ports>
Jul 24 16:24:13 user nova-compute[70243]:         <nova:port uuid="66249aa8-373c-45b2-940f-74f7e6228bce">
Jul 24 16:24:13 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 16:24:13 user nova-compute[70243]:         </nova:port>
Jul 24 16:24:13 user nova-compute[70243]:       </nova:ports>
Jul 24 16:24:13 user nova-compute[70243]:     </nova:instance>
Jul 24 16:24:13 user nova-compute[70243]:   </metadata>
Jul 24 16:24:13 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:24:13 user nova-compute[70243]:     <system>
Jul 24 16:24:13 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:24:13 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:24:13 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:24:13 user nova-compute[70243]:       <entry name="serial">5f70528b-33db-4257-96fe-e5fad869a224</entry>
Jul 24 16:24:13 user nova-compute[70243]:       <entry name="uuid">5f70528b-33db-4257-96fe-e5fad869a224</entry>
Jul 24 16:24:13 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:24:13 user nova-compute[70243]:     </system>
Jul 24 16:24:13 user nova-compute[70243]:   </sysinfo>
Jul 24 16:24:13 user nova-compute[70243]:   <os>
Jul 24 16:24:13 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:24:13 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:24:13 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:24:13 user nova-compute[70243]:   </os>
Jul 24 16:24:13 user nova-compute[70243]:   <features>
Jul 24 16:24:13 user nova-compute[70243]:     <acpi/>
Jul 24 16:24:13 user nova-compute[70243]:     <apic/>
Jul 24 16:24:13 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:24:13 user nova-compute[70243]:   </features>
Jul 24 16:24:13 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:24:13 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:24:13 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:24:13 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:24:13 user nova-compute[70243]:   </clock>
Jul 24 16:24:13 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:24:13 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:24:13 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:24:13 user nova-compute[70243]:   </cpu>
Jul 24 16:24:13 user nova-compute[70243]:   <devices>
Jul 24 16:24:13 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:24:13 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:24:13 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk"/>
Jul 24 16:24:13 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:24:13 user nova-compute[70243]:     </disk>
Jul 24 16:24:13 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:24:13 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:24:13 user nova-compute[70243]:       <source dev="/dev/sdb"/>
Jul 24 16:24:13 user nova-compute[70243]:       <target dev="vdb" bus="virtio"/>
Jul 24 16:24:13 user nova-compute[70243]:       <serial>5d0447c3-66c4-4105-9a6f-9187ae43f96b</serial>
Jul 24 16:24:13 user nova-compute[70243]:     </disk>
Jul 24 16:24:13 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:24:13 user nova-compute[70243]:       <mac address="fa:16:3e:b0:61:6c"/>
Jul 24 16:24:13 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:24:13 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:24:13 user nova-compute[70243]:       <target dev="tap66249aa8-37"/>
Jul 24 16:24:13 user nova-compute[70243]:     </interface>
Jul 24 16:24:13 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:24:13 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/console.log" append="off"/>
Jul 24 16:24:13 user nova-compute[70243]:     </serial>
Jul 24 16:24:13 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:24:13 user nova-compute[70243]:     <video>
Jul 24 16:24:13 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:24:13 user nova-compute[70243]:     </video>
Jul 24 16:24:13 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:24:13 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:24:13 user nova-compute[70243]:     </rng>
Jul 24 16:24:13 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:24:13 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:24:13 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:24:13 user nova-compute[70243]:     </memballoon>
Jul 24 16:24:13 user nova-compute[70243]:   </devices>
Jul 24 16:24:13 user nova-compute[70243]: </domain>
Jul 24 16:24:13 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:24:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1291679900',display_name='tempest-ServerActionsTestOtherB-server-1291679900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1291679900',id=6,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqymb2uus6Bkqa8Jv1s5ZbibCwJHiHaRW+MVWVRPkPu9Fm+8ajStg97Lu5Oh0gjEFACHSPElKL2d/v4nyEqxN0n8bX7piloSV6v2kR0JjimuB49HIj2A6fdu+bprtip6w==',key_name='tempest-keypair-692701',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:22:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5385c4cfc8d84d1abd728c11d75c003d',ramdisk_id='',reservation_id='r-tutxnqyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-485175328',owner_user_name='tempest-ServerActionsTestOtherB-485175328-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:24:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9db33a574c334a2d91afc72b21ef15e6',uuid=5f70528b-33db-4257-96fe-e5fad869a224,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:24:13 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Converting VIF {"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:24:13 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=66249aa8-373c-45b2-940f-74f7e6228bce,network=Network(109feefe-8734-40ee-a8b8-2defa6e83853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66249aa8-37') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:24:13 user nova-compute[70243]: DEBUG os_vif [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=66249aa8-373c-45b2-940f-74f7e6228bce,network=Network(109feefe-8734-40ee-a8b8-2defa6e83853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66249aa8-37') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:24:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:24:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:24:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66249aa8-37, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:24:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap66249aa8-37, col_values=(('external_ids', {'iface-id': '66249aa8-373c-45b2-940f-74f7e6228bce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:61:6c', 'vm-uuid': '5f70528b-33db-4257-96fe-e5fad869a224'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:24:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:24:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:13 user nova-compute[70243]: INFO os_vif [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=66249aa8-373c-45b2-940f-74f7e6228bce,network=Network(109feefe-8734-40ee-a8b8-2defa6e83853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66249aa8-37')
Jul 24 16:24:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:14 user nova-compute[70243]: DEBUG nova.compute.manager [req-7c27c5b8-271e-4979-a3af-bfd08d17c31d req-1206f624-2613-4067-a16a-2ce46f3d9499 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received event network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:24:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7c27c5b8-271e-4979-a3af-bfd08d17c31d req-1206f624-2613-4067-a16a-2ce46f3d9499 service nova] Acquiring lock "5f70528b-33db-4257-96fe-e5fad869a224-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7c27c5b8-271e-4979-a3af-bfd08d17c31d req-1206f624-2613-4067-a16a-2ce46f3d9499 service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7c27c5b8-271e-4979-a3af-bfd08d17c31d req-1206f624-2613-4067-a16a-2ce46f3d9499 service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:14 user nova-compute[70243]: DEBUG nova.compute.manager [req-7c27c5b8-271e-4979-a3af-bfd08d17c31d req-1206f624-2613-4067-a16a-2ce46f3d9499 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] No waiting events found dispatching network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:24:14 user nova-compute[70243]: WARNING nova.compute.manager [req-7c27c5b8-271e-4979-a3af-bfd08d17c31d req-1206f624-2613-4067-a16a-2ce46f3d9499 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received unexpected event network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce for instance with vm_state resized and task_state resize_reverting.
Jul 24 16:24:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Removed pending event for 5f70528b-33db-4257-96fe-e5fad869a224 due to event {{(pid=70243) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 16:24:16 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215856.815926, 5f70528b-33db-4257-96fe-e5fad869a224 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:24:16 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] VM Resumed (Lifecycle Event)
Jul 24 16:24:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:24:16 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Instance running successfully.
Jul 24 16:24:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] finish_revert_migration finished successfully. {{(pid=70243) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Jul 24 16:24:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:24:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:24:16 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 24 16:24:16 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215856.8177402, 5f70528b-33db-4257-96fe-e5fad869a224 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:24:16 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] VM Started (Lifecycle Event)
Jul 24 16:24:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:24:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:24:16 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 24 16:24:16 user nova-compute[70243]: INFO nova.compute.manager [None req-83a1d994-38ea-4fc8-8687-cf344d9b4963 tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Updating instance to original state: 'active'
Jul 24 16:24:17 user nova-compute[70243]: DEBUG nova.compute.manager [req-feb9dc8a-8d3e-4961-8bd0-2a4275dba493 req-627c7379-df9f-4d04-92af-ccda40095e10 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received event network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:24:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-feb9dc8a-8d3e-4961-8bd0-2a4275dba493 req-627c7379-df9f-4d04-92af-ccda40095e10 service nova] Acquiring lock "5f70528b-33db-4257-96fe-e5fad869a224-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-feb9dc8a-8d3e-4961-8bd0-2a4275dba493 req-627c7379-df9f-4d04-92af-ccda40095e10 service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-feb9dc8a-8d3e-4961-8bd0-2a4275dba493 req-627c7379-df9f-4d04-92af-ccda40095e10 service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:17 user nova-compute[70243]: DEBUG nova.compute.manager [req-feb9dc8a-8d3e-4961-8bd0-2a4275dba493 req-627c7379-df9f-4d04-92af-ccda40095e10 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] No waiting events found dispatching network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:24:17 user nova-compute[70243]: WARNING nova.compute.manager [req-feb9dc8a-8d3e-4961-8bd0-2a4275dba493 req-627c7379-df9f-4d04-92af-ccda40095e10 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received unexpected event network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce for instance with vm_state resized and task_state resize_reverting.
Jul 24 16:24:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "c2ee17ba-3482-4caf-992e-30b3953d1e91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "c2ee17ba-3482-4caf-992e-30b3953d1e91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "c2ee17ba-3482-4caf-992e-30b3953d1e91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "c2ee17ba-3482-4caf-992e-30b3953d1e91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "c2ee17ba-3482-4caf-992e-30b3953d1e91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:19 user nova-compute[70243]: INFO nova.compute.manager [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Terminating instance
Jul 24 16:24:19 user nova-compute[70243]: DEBUG nova.compute.manager [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:24:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-bce2a79b-266b-40b5-83dd-d1b5d8a23efc req-a7564ddf-d336-4d87-81a8-a14a5759d96f service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Received event network-vif-unplugged-da8433ea-b1c3-497e-b77c-fe0e87674dac {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:24:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-bce2a79b-266b-40b5-83dd-d1b5d8a23efc req-a7564ddf-d336-4d87-81a8-a14a5759d96f service nova] Acquiring lock "c2ee17ba-3482-4caf-992e-30b3953d1e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-bce2a79b-266b-40b5-83dd-d1b5d8a23efc req-a7564ddf-d336-4d87-81a8-a14a5759d96f service nova] Lock "c2ee17ba-3482-4caf-992e-30b3953d1e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-bce2a79b-266b-40b5-83dd-d1b5d8a23efc req-a7564ddf-d336-4d87-81a8-a14a5759d96f service nova] Lock "c2ee17ba-3482-4caf-992e-30b3953d1e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-bce2a79b-266b-40b5-83dd-d1b5d8a23efc req-a7564ddf-d336-4d87-81a8-a14a5759d96f service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] No waiting events found dispatching network-vif-unplugged-da8433ea-b1c3-497e-b77c-fe0e87674dac {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:24:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-bce2a79b-266b-40b5-83dd-d1b5d8a23efc req-a7564ddf-d336-4d87-81a8-a14a5759d96f service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Received event network-vif-unplugged-da8433ea-b1c3-497e-b77c-fe0e87674dac for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:24:20 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Instance destroyed successfully.
Jul 24 16:24:20 user nova-compute[70243]: DEBUG nova.objects.instance [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lazy-loading 'resources' on Instance uuid c2ee17ba-3482-4caf-992e-30b3953d1e91 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:24:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:18:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1193531302',display_name='tempest-VolumesAdminNegativeTest-server-1193531302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1193531302',id=8,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqLydVX6AhOLep2FAIets1EybmqCpNpMS0yXEatcKbemtKcga1/ReYoz9a9HygS1aFXaMUzBIqOBwAQBOzJZUYnsOA33wo17IWb8+V7jGA4GBnWnzhyQDo/xGIePao8fQ==',key_name='tempest-keypair-493675553',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:18:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6973a869545f43e1bd096a5f6eaf921c',ramdisk_id='',reservation_id='r-ctp5sl28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2091650987',owner_user_name='tempest-VolumesAdminNegativeTest-2091650987-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:18:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e6294a2931e4959be1440678b174828',uuid=c2ee17ba-3482-4caf-992e-30b3953d1e91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da8433ea-b1c3-497e-b77c-fe0e87674dac", "address": "fa:16:3e:43:e2:d2", "network": {"id": "798ddded-1cb9-4c01-9590-27f071d81a3c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1340440057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6973a869545f43e1bd096a5f6eaf921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda8433ea-b1", "ovs_interfaceid": "da8433ea-b1c3-497e-b77c-fe0e87674dac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:24:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Converting VIF {"id": "da8433ea-b1c3-497e-b77c-fe0e87674dac", "address": "fa:16:3e:43:e2:d2", "network": {"id": "798ddded-1cb9-4c01-9590-27f071d81a3c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1340440057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6973a869545f43e1bd096a5f6eaf921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda8433ea-b1", "ovs_interfaceid": "da8433ea-b1c3-497e-b77c-fe0e87674dac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:24:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:e2:d2,bridge_name='br-int',has_traffic_filtering=True,id=da8433ea-b1c3-497e-b77c-fe0e87674dac,network=Network(798ddded-1cb9-4c01-9590-27f071d81a3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda8433ea-b1') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:24:20 user nova-compute[70243]: DEBUG os_vif [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:e2:d2,bridge_name='br-int',has_traffic_filtering=True,id=da8433ea-b1c3-497e-b77c-fe0e87674dac,network=Network(798ddded-1cb9-4c01-9590-27f071d81a3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda8433ea-b1') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:24:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda8433ea-b1, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:24:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:24:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:20 user nova-compute[70243]: INFO os_vif [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:e2:d2,bridge_name='br-int',has_traffic_filtering=True,id=da8433ea-b1c3-497e-b77c-fe0e87674dac,network=Network(798ddded-1cb9-4c01-9590-27f071d81a3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda8433ea-b1')
Jul 24 16:24:20 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Deleting instance files /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91_del
Jul 24 16:24:20 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Deletion of /opt/stack/data/nova/instances/c2ee17ba-3482-4caf-992e-30b3953d1e91_del complete
Jul 24 16:24:20 user nova-compute[70243]: INFO nova.compute.manager [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Took 0.96 seconds to destroy the instance on the hypervisor.
Jul 24 16:24:20 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:24:20 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:24:20 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:24:21 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:24:21 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Took 1.03 seconds to deallocate network for instance.
Jul 24 16:24:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:22 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Refreshing inventories for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 16:24:22 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Updating ProviderTree inventory for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 16:24:22 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Updating inventory in ProviderTree for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 16:24:22 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Refreshing aggregate associations for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0, aggregates: None {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 16:24:22 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Refreshing trait associations for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0, traits: HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 16:24:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-dd859b87-ab22-4aa7-a691-95103bf0ee84 req-31aa20f9-c244-4eaa-b9d5-5297f0d16ae2 service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Received event network-vif-plugged-da8433ea-b1c3-497e-b77c-fe0e87674dac {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:24:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dd859b87-ab22-4aa7-a691-95103bf0ee84 req-31aa20f9-c244-4eaa-b9d5-5297f0d16ae2 service nova] Acquiring lock "c2ee17ba-3482-4caf-992e-30b3953d1e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dd859b87-ab22-4aa7-a691-95103bf0ee84 req-31aa20f9-c244-4eaa-b9d5-5297f0d16ae2 service nova] Lock "c2ee17ba-3482-4caf-992e-30b3953d1e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dd859b87-ab22-4aa7-a691-95103bf0ee84 req-31aa20f9-c244-4eaa-b9d5-5297f0d16ae2 service nova] Lock "c2ee17ba-3482-4caf-992e-30b3953d1e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-dd859b87-ab22-4aa7-a691-95103bf0ee84 req-31aa20f9-c244-4eaa-b9d5-5297f0d16ae2 service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] No waiting events found dispatching network-vif-plugged-da8433ea-b1c3-497e-b77c-fe0e87674dac {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:24:22 user nova-compute[70243]: WARNING nova.compute.manager [req-dd859b87-ab22-4aa7-a691-95103bf0ee84 req-31aa20f9-c244-4eaa-b9d5-5297f0d16ae2 service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Received unexpected event network-vif-plugged-da8433ea-b1c3-497e-b77c-fe0e87674dac for instance with vm_state deleted and task_state None.
Jul 24 16:24:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-dd859b87-ab22-4aa7-a691-95103bf0ee84 req-31aa20f9-c244-4eaa-b9d5-5297f0d16ae2 service nova] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Received event network-vif-deleted-da8433ea-b1c3-497e-b77c-fe0e87674dac {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:24:22 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:24:22 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:24:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.735s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:22 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Deleted allocations for instance c2ee17ba-3482-4caf-992e-30b3953d1e91
Jul 24 16:24:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3cedd56c-4725-424e-b6a8-2dae2260282b tempest-VolumesAdminNegativeTest-2091650987 tempest-VolumesAdminNegativeTest-2091650987-project-member] Lock "c2ee17ba-3482-4caf-992e-30b3953d1e91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.987s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "de484cb2-7f20-4bf1-927b-c066735bfeca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "de484cb2-7f20-4bf1-927b-c066735bfeca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "de484cb2-7f20-4bf1-927b-c066735bfeca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "de484cb2-7f20-4bf1-927b-c066735bfeca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "de484cb2-7f20-4bf1-927b-c066735bfeca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:35 user nova-compute[70243]: INFO nova.compute.manager [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Terminating instance
Jul 24 16:24:35 user nova-compute[70243]: DEBUG nova.compute.manager [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-3fc1aefc-faa6-40d5-ad8e-fabfb0db0f53 req-a8269a4b-fe83-4240-8553-8b282e35bded service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Received event network-vif-unplugged-e3519574-a5e5-48f3-9e0c-852d0e9e3505 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3fc1aefc-faa6-40d5-ad8e-fabfb0db0f53 req-a8269a4b-fe83-4240-8553-8b282e35bded service nova] Acquiring lock "de484cb2-7f20-4bf1-927b-c066735bfeca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3fc1aefc-faa6-40d5-ad8e-fabfb0db0f53 req-a8269a4b-fe83-4240-8553-8b282e35bded service nova] Lock "de484cb2-7f20-4bf1-927b-c066735bfeca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3fc1aefc-faa6-40d5-ad8e-fabfb0db0f53 req-a8269a4b-fe83-4240-8553-8b282e35bded service nova] Lock "de484cb2-7f20-4bf1-927b-c066735bfeca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-3fc1aefc-faa6-40d5-ad8e-fabfb0db0f53 req-a8269a4b-fe83-4240-8553-8b282e35bded service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] No waiting events found dispatching network-vif-unplugged-e3519574-a5e5-48f3-9e0c-852d0e9e3505 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-3fc1aefc-faa6-40d5-ad8e-fabfb0db0f53 req-a8269a4b-fe83-4240-8553-8b282e35bded service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Received event network-vif-unplugged-e3519574-a5e5-48f3-9e0c-852d0e9e3505 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690215860.6647353, c2ee17ba-3482-4caf-992e-30b3953d1e91 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:24:35 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] VM Stopped (Lifecycle Event)
Jul 24 16:24:35 user nova-compute[70243]: DEBUG nova.compute.manager [None req-3cb50ff7-8760-419e-9085-513066290bc2 None None] [instance: c2ee17ba-3482-4caf-992e-30b3953d1e91] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:35 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Instance destroyed successfully.
Jul 24 16:24:35 user nova-compute[70243]: DEBUG nova.objects.instance [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lazy-loading 'resources' on Instance uuid de484cb2-7f20-4bf1-927b-c066735bfeca {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1886654388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1886654388',id=3,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3fJVVBtKxrt2LD8LOh8QFcWuhNGbHNO3uDwNu28+nEDy7SWSLtikmY1xaqrqeTUpy4fYlAfegrXHnjy0xHrVH2MKaijfKhsymbrBuHSH5kmz77Lc8TXnMfDKezsXqDdQ==',key_name='tempest-keypair-1916786482',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:18:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec24d98248104f5f898cf6f79207435b',ramdisk_id='',reservation_id='r-natg13nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1173962228',owner_user_name='tempest-ServerActionsV293TestJSON-1173962228-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:18:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93b6ed534c2c44d08a71f3050e212644',uuid=de484cb2-7f20-4bf1-927b-c066735bfeca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "address": "fa:16:3e:8b:ac:95", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3519574-a5", "ovs_interfaceid": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Converting VIF {"id": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "address": "fa:16:3e:8b:ac:95", "network": {"id": "3ed67d60-f22b-4d39-9563-c680c176858b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-319968348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec24d98248104f5f898cf6f79207435b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3519574-a5", "ovs_interfaceid": "e3519574-a5e5-48f3-9e0c-852d0e9e3505", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:ac:95,bridge_name='br-int',has_traffic_filtering=True,id=e3519574-a5e5-48f3-9e0c-852d0e9e3505,network=Network(3ed67d60-f22b-4d39-9563-c680c176858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3519574-a5') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG os_vif [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:ac:95,bridge_name='br-int',has_traffic_filtering=True,id=e3519574-a5e5-48f3-9e0c-852d0e9e3505,network=Network(3ed67d60-f22b-4d39-9563-c680c176858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3519574-a5') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3519574-a5, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:24:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:35 user nova-compute[70243]: INFO os_vif [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:ac:95,bridge_name='br-int',has_traffic_filtering=True,id=e3519574-a5e5-48f3-9e0c-852d0e9e3505,network=Network(3ed67d60-f22b-4d39-9563-c680c176858b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3519574-a5')
Jul 24 16:24:35 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Deleting instance files /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca_del
Jul 24 16:24:35 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Deletion of /opt/stack/data/nova/instances/de484cb2-7f20-4bf1-927b-c066735bfeca_del complete
Jul 24 16:24:36 user nova-compute[70243]: INFO nova.compute.manager [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 24 16:24:36 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:24:36 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:24:36 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:24:37 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:24:37 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Took 1.08 seconds to deallocate network for instance.
Jul 24 16:24:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-19a14218-f4df-4c6d-9498-f7617cf4cd91 req-fa1ee613-4a32-440d-a518-44578b92336b service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Received event network-vif-deleted-e3519574-a5e5-48f3-9e0c-852d0e9e3505 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:24:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:37 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:24:37 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:24:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:37 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Deleted allocations for instance de484cb2-7f20-4bf1-927b-c066735bfeca
Jul 24 16:24:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-88be642c-9f64-4180-92bd-95d0e819f573 req-8f7a1482-76bf-40f0-bf3a-3f0301b79a14 service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Received event network-vif-plugged-e3519574-a5e5-48f3-9e0c-852d0e9e3505 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:24:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-88be642c-9f64-4180-92bd-95d0e819f573 req-8f7a1482-76bf-40f0-bf3a-3f0301b79a14 service nova] Acquiring lock "de484cb2-7f20-4bf1-927b-c066735bfeca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-88be642c-9f64-4180-92bd-95d0e819f573 req-8f7a1482-76bf-40f0-bf3a-3f0301b79a14 service nova] Lock "de484cb2-7f20-4bf1-927b-c066735bfeca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-88be642c-9f64-4180-92bd-95d0e819f573 req-8f7a1482-76bf-40f0-bf3a-3f0301b79a14 service nova] Lock "de484cb2-7f20-4bf1-927b-c066735bfeca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-88be642c-9f64-4180-92bd-95d0e819f573 req-8f7a1482-76bf-40f0-bf3a-3f0301b79a14 service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] No waiting events found dispatching network-vif-plugged-e3519574-a5e5-48f3-9e0c-852d0e9e3505 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:24:37 user nova-compute[70243]: WARNING nova.compute.manager [req-88be642c-9f64-4180-92bd-95d0e819f573 req-8f7a1482-76bf-40f0-bf3a-3f0301b79a14 service nova] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Received unexpected event network-vif-plugged-e3519574-a5e5-48f3-9e0c-852d0e9e3505 for instance with vm_state deleted and task_state None.
Jul 24 16:24:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4ed98f11-e173-4309-b7d1-434bf15b66ac tempest-ServerActionsV293TestJSON-1173962228 tempest-ServerActionsV293TestJSON-1173962228-project-member] Lock "de484cb2-7f20-4bf1-927b-c066735bfeca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.497s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:40 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:24:40 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:24:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:42 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:24:42 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:24:44 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:24:44 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:24:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:44 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:24:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:24:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:24:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:24:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66147ca4-6c90-4ed8-b6f4-6437d0e8c38b/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66147ca4-6c90-4ed8-b6f4-6437d0e8c38b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66147ca4-6c90-4ed8-b6f4-6437d0e8c38b/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66147ca4-6c90-4ed8-b6f4-6437d0e8c38b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:46 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:24:46 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:24:46 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:24:46 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=7606MB free_disk=24.356754302978516GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:24:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:47 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance de22ea98-b041-4f3f-8986-435c43267a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:24:47 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance a13c243a-2b98-4ef1-b17c-e2e15ba005fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:24:47 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance ad611655-ba4d-4a66-b78e-a82c058f4414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:24:47 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance b0dd6065-3916-4f0e-841e-3df5ded2e2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:24:47 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5f70528b-33db-4257-96fe-e5fad869a224 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:24:47 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance abcd54bc-02d4-4872-8227-43cb93d27491 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:24:47 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:24:47 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:24:47 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:24:47 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:24:47 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:24:47 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:24:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:48 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:24:48 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:24:48 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Didn't find any instances for network info cache update. {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 16:24:48 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:24:48 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:24:48 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:24:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "de22ea98-b041-4f3f-8986-435c43267a2e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "de22ea98-b041-4f3f-8986-435c43267a2e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:48 user nova-compute[70243]: INFO nova.compute.manager [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Detaching volume 914f1c49-d025-4757-84d7-32fa800e552b
Jul 24 16:24:48 user nova-compute[70243]: INFO nova.virt.block_device [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Attempting to driver detach volume 914f1c49-d025-4757-84d7-32fa800e552b from mountpoint /dev/vdb
Jul 24 16:24:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Attempting to detach device vdb from instance de22ea98-b041-4f3f-8986-435c43267a2e from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:24:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:24:48 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:24:48 user nova-compute[70243]:   <source dev="/dev/sdf"/>
Jul 24 16:24:48 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:24:48 user nova-compute[70243]:   <serial>914f1c49-d025-4757-84d7-32fa800e552b</serial>
Jul 24 16:24:48 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 16:24:48 user nova-compute[70243]: </disk>
Jul 24 16:24:48 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:24:48 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Successfully detached device vdb from instance de22ea98-b041-4f3f-8986-435c43267a2e from the persistent domain config.
Jul 24 16:24:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de22ea98-b041-4f3f-8986-435c43267a2e from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:24:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:24:48 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:24:48 user nova-compute[70243]:   <source dev="/dev/sdf"/>
Jul 24 16:24:48 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:24:48 user nova-compute[70243]:   <serial>914f1c49-d025-4757-84d7-32fa800e552b</serial>
Jul 24 16:24:48 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 16:24:48 user nova-compute[70243]: </disk>
Jul 24 16:24:48 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:24:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690215888.9572394, de22ea98-b041-4f3f-8986-435c43267a2e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:24:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de22ea98-b041-4f3f-8986-435c43267a2e {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:24:48 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Successfully detached device vdb from instance de22ea98-b041-4f3f-8986-435c43267a2e from the live domain config.
Jul 24 16:24:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:24:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIXqhlWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:24:48 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:24:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:24:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:24:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:48 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bd0a3b-c2ad-4a89-904f-a0486093c6c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:24:48 user nova-compute[70243]: No targets found.
Jul 24 16:24:48 user nova-compute[70243]: iSNS:
Jul 24 16:24:48 user nova-compute[70243]: No targets found.
Jul 24 16:24:48 user nova-compute[70243]: STATIC:
Jul 24 16:24:48 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b
Jul 24 16:24:48 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:24:48 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:24:48 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323
Jul 24 16:24:48 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:24:48 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:24:48 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b
Jul 24 16:24:48 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:24:48 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:24:48 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b
Jul 24 16:24:48 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:24:48 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:24:48 user nova-compute[70243]: FIRMWARE:
Jul 24 16:24:48 user nova-compute[70243]: No targets found.
Jul 24 16:24:48 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:24:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:24:48 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:24:48 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:24:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2358cab5-c73f-4d14-925f-ba25dd51eb3b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8b20ac-d178-4864-bc3e-11c47b6b2935]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:24:49 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:24:49 user nova-compute[70243]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:24:49 user nova-compute[70243]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:24:49 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:24:49 user nova-compute[70243]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b (non-flash)
Jul 24 16:24:49 user nova-compute[70243]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:24:49 user nova-compute[70243]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:24:49 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc134b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b'): ({'sdf'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Removing single pathed devices sdf {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9b1c71-7fec-4cc6-bf4f-c23f32064407]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cccdff-4eb4-412a-bf07-7b13b24221f3]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Flushing IO for device /dev/sdf {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.038s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2f0045-976d-4fc5-a069-78793be0e460]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.033s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61a35ca-8b5d-4398-a825-18b15226e477]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] SCSI volumes sdf have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dc869e-11d4-47d8-8834-153a60b8dc8a]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[baffd7dc-c352-4d05-927c-43067c42d29a]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b, portal: 172.16.0.220,3260]
Jul 24 16:24:49 user nova-compute[70243]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b, portal: 172.16.0.220,3260] successful.
Jul 24 16:24:49 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:914f1c49-d025-4757-84d7-32fa800e552b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c1b40a-2c61-40fd-b220-66d7fbafd420]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] <== disconnect_volume: return (337ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:24:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:50 user nova-compute[70243]: DEBUG nova.objects.instance [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lazy-loading 'flavor' on Instance uuid de22ea98-b041-4f3f-8986-435c43267a2e {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:24:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4f2d860f-396a-4f77-aee4-e2111a257b18 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "de22ea98-b041-4f3f-8986-435c43267a2e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.809s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:50 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690215875.9306283, de484cb2-7f20-4bf1-927b-c066735bfeca => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:24:50 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] VM Stopped (Lifecycle Event)
Jul 24 16:24:50 user nova-compute[70243]: DEBUG nova.compute.manager [None req-26333a94-2439-4c1e-8dc1-c8cf9cabb831 None None] [instance: de484cb2-7f20-4bf1-927b-c066735bfeca] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:24:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquiring lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:52 user nova-compute[70243]: INFO nova.compute.manager [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Detaching volume fa6f7d2d-caff-4248-b9c7-4d785414616b
Jul 24 16:24:53 user nova-compute[70243]: INFO nova.virt.block_device [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Attempting to driver detach volume fa6f7d2d-caff-4248-b9c7-4d785414616b from mountpoint /dev/vdb
Jul 24 16:24:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Attempting to detach device vdb from instance a13c243a-2b98-4ef1-b17c-e2e15ba005fd from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:24:53 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:24:53 user nova-compute[70243]:   <source dev="/dev/sdc"/>
Jul 24 16:24:53 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:24:53 user nova-compute[70243]:   <serial>fa6f7d2d-caff-4248-b9c7-4d785414616b</serial>
Jul 24 16:24:53 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:24:53 user nova-compute[70243]: </disk>
Jul 24 16:24:53 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:24:53 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Successfully detached device vdb from instance a13c243a-2b98-4ef1-b17c-e2e15ba005fd from the persistent domain config.
Jul 24 16:24:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a13c243a-2b98-4ef1-b17c-e2e15ba005fd from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:24:53 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:24:53 user nova-compute[70243]:   <source dev="/dev/sdc"/>
Jul 24 16:24:53 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:24:53 user nova-compute[70243]:   <serial>fa6f7d2d-caff-4248-b9c7-4d785414616b</serial>
Jul 24 16:24:53 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:24:53 user nova-compute[70243]: </disk>
Jul 24 16:24:53 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690215893.4773903, a13c243a-2b98-4ef1-b17c-e2e15ba005fd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a13c243a-2b98-4ef1-b17c-e2e15ba005fd {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:24:53 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Successfully detached device vdb from instance a13c243a-2b98-4ef1-b17c-e2e15ba005fd from the live domain config.
Jul 24 16:24:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAkhOXje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:24:53 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:24:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa11f43-37c7-4b7e-88f4-a1f574d8a067]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:24:53 user nova-compute[70243]: No targets found.
Jul 24 16:24:53 user nova-compute[70243]: iSNS:
Jul 24 16:24:53 user nova-compute[70243]: No targets found.
Jul 24 16:24:53 user nova-compute[70243]: STATIC:
Jul 24 16:24:53 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b
Jul 24 16:24:53 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:24:53 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:24:53 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323
Jul 24 16:24:53 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:24:53 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:24:53 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b
Jul 24 16:24:53 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:24:53 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:24:53 user nova-compute[70243]: FIRMWARE:
Jul 24 16:24:53 user nova-compute[70243]: No targets found.
Jul 24 16:24:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:24:53 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:24:53 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ea3651-1a07-47b9-81be-3f799342d1c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5cc548-72cc-4df5-93fd-6e1a561bdc07]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:24:53 user nova-compute[70243]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:24:53 user nova-compute[70243]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:24:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b (non-flash)
Jul 24 16:24:53 user nova-compute[70243]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:24:53 user nova-compute[70243]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:24:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc7743a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b'): ({'sdc'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Removing single pathed devices sdc {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac02624a-d15d-4396-ba1e-4f8b448bca83]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[925413c1-4f56-4179-9d10-8adf3afacd59]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Flushing IO for device /dev/sdc {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fc6956-62e6-4005-9594-57ae6c89f60e]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e66cc8-6802-4859-98ce-9c54642d06a0]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] SCSI volumes sdc have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12c5711-72d9-4fc1-8db1-9b339b6cc732]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[218d8d4f-d97c-4296-bf77-40bb5defd184]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b, portal: 172.16.0.220,3260]
Jul 24 16:24:53 user nova-compute[70243]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b, portal: 172.16.0.220,3260] successful.
Jul 24 16:24:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6f7d2d-caff-4248-b9c7-4d785414616b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ed3ff3-e4c5-4cbf-9278-be7751fbda88]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] <== disconnect_volume: return (286ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:24:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:24:54 user nova-compute[70243]: DEBUG nova.objects.instance [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lazy-loading 'flavor' on Instance uuid a13c243a-2b98-4ef1-b17c-e2e15ba005fd {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:24:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28dd5d52-b72e-49d2-bf3c-fcc049815715 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.589s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:24:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:24:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:59 user nova-compute[70243]: DEBUG nova.compute.manager [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:24:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:24:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:24:59 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:24:59 user nova-compute[70243]: INFO nova.compute.claims [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Claim successful on node user
Jul 24 16:25:00 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:25:00 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:25:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG nova.policy [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8df18929107a458194a9c528d9bdfeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e819e22e590947478d513e1b9ad39494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:25:00 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Creating image(s)
Jul 24 16:25:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "/opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "/opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.130s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk 1073741824" returned: 0 in 0.048s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.152s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Successfully created port: bc944a2d-ab8f-475a-b276-485ab373860a {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:25:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:01 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Cannot resize image /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:25:01 user nova-compute[70243]: DEBUG nova.objects.instance [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lazy-loading 'migration_context' on Instance uuid 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:25:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:25:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Ensure instance console log exists: /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:25:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:01 user nova-compute[70243]: DEBUG nova.network.neutron [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Successfully updated port: bc944a2d-ab8f-475a-b276-485ab373860a {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:25:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "refresh_cache-9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:25:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquired lock "refresh_cache-9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:25:01 user nova-compute[70243]: DEBUG nova.network.neutron [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:25:01 user nova-compute[70243]: DEBUG nova.compute.manager [req-3873c62d-d613-4cf9-b20a-ebbcc6e68805 req-2c73daa4-6d6e-4e69-a9f2-162357b34851 service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Received event network-changed-bc944a2d-ab8f-475a-b276-485ab373860a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:01 user nova-compute[70243]: DEBUG nova.compute.manager [req-3873c62d-d613-4cf9-b20a-ebbcc6e68805 req-2c73daa4-6d6e-4e69-a9f2-162357b34851 service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Refreshing instance network info cache due to event network-changed-bc944a2d-ab8f-475a-b276-485ab373860a. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:25:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3873c62d-d613-4cf9-b20a-ebbcc6e68805 req-2c73daa4-6d6e-4e69-a9f2-162357b34851 service nova] Acquiring lock "refresh_cache-9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:25:01 user nova-compute[70243]: DEBUG nova.network.neutron [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.network.neutron [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Updating instance_info_cache with network_info: [{"id": "bc944a2d-ab8f-475a-b276-485ab373860a", "address": "fa:16:3e:de:36:b6", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc944a2d-ab", "ovs_interfaceid": "bc944a2d-ab8f-475a-b276-485ab373860a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Releasing lock "refresh_cache-9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.compute.manager [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Instance network_info: |[{"id": "bc944a2d-ab8f-475a-b276-485ab373860a", "address": "fa:16:3e:de:36:b6", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc944a2d-ab", "ovs_interfaceid": "bc944a2d-ab8f-475a-b276-485ab373860a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3873c62d-d613-4cf9-b20a-ebbcc6e68805 req-2c73daa4-6d6e-4e69-a9f2-162357b34851 service nova] Acquired lock "refresh_cache-9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.network.neutron [req-3873c62d-d613-4cf9-b20a-ebbcc6e68805 req-2c73daa4-6d6e-4e69-a9f2-162357b34851 service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Refreshing network info cache for port bc944a2d-ab8f-475a-b276-485ab373860a {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Start _get_guest_xml network_info=[{"id": "bc944a2d-ab8f-475a-b276-485ab373860a", "address": "fa:16:3e:de:36:b6", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc944a2d-ab", "ovs_interfaceid": "bc944a2d-ab8f-475a-b276-485ab373860a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:25:02 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:25:02 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:24:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1233422015',display_name='tempest-AttachVolumeNegativeTest-server-1233422015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1233422015',id=17,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGT2rkGSyXlMbTq/yju1RCH/R39q/wP+8/at2zAYGOJkKVQGAMqmx1u2dapVODLNC31GOE7t50QLv5CBwzfMkoaMIGDOZgz6KtBTHgG1635SSIdlm7b2nzTv0J9CMuDqQ==',key_name='tempest-keypair-1272592606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e819e22e590947478d513e1b9ad39494',ramdisk_id='',reservation_id='r-ooxr0ou9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1152214105',owner_user_name='tempest-AttachVolumeNegativeTest-1152214105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:25:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df18929107a458194a9c528d9bdfeac',uuid=9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc944a2d-ab8f-475a-b276-485ab373860a", "address": "fa:16:3e:de:36:b6", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc944a2d-ab", "ovs_interfaceid": "bc944a2d-ab8f-475a-b276-485ab373860a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converting VIF {"id": "bc944a2d-ab8f-475a-b276-485ab373860a", "address": "fa:16:3e:de:36:b6", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc944a2d-ab", "ovs_interfaceid": "bc944a2d-ab8f-475a-b276-485ab373860a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:36:b6,bridge_name='br-int',has_traffic_filtering=True,id=bc944a2d-ab8f-475a-b276-485ab373860a,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc944a2d-ab') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.objects.instance [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:25:02 user nova-compute[70243]:   <uuid>9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04</uuid>
Jul 24 16:25:02 user nova-compute[70243]:   <name>instance-00000011</name>
Jul 24 16:25:02 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:25:02 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:25:02 user nova-compute[70243]:   <metadata>
Jul 24 16:25:02 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:25:02 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:25:02 user nova-compute[70243]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1233422015</nova:name>
Jul 24 16:25:02 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:25:02</nova:creationTime>
Jul 24 16:25:02 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:25:02 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:25:02 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:25:02 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:25:02 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:25:02 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:25:02 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:25:02 user nova-compute[70243]:       <nova:owner>
Jul 24 16:25:02 user nova-compute[70243]:         <nova:user uuid="8df18929107a458194a9c528d9bdfeac">tempest-AttachVolumeNegativeTest-1152214105-project-member</nova:user>
Jul 24 16:25:02 user nova-compute[70243]:         <nova:project uuid="e819e22e590947478d513e1b9ad39494">tempest-AttachVolumeNegativeTest-1152214105</nova:project>
Jul 24 16:25:02 user nova-compute[70243]:       </nova:owner>
Jul 24 16:25:02 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:25:02 user nova-compute[70243]:       <nova:ports>
Jul 24 16:25:02 user nova-compute[70243]:         <nova:port uuid="bc944a2d-ab8f-475a-b276-485ab373860a">
Jul 24 16:25:02 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 24 16:25:02 user nova-compute[70243]:         </nova:port>
Jul 24 16:25:02 user nova-compute[70243]:       </nova:ports>
Jul 24 16:25:02 user nova-compute[70243]:     </nova:instance>
Jul 24 16:25:02 user nova-compute[70243]:   </metadata>
Jul 24 16:25:02 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:25:02 user nova-compute[70243]:     <system>
Jul 24 16:25:02 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:25:02 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:25:02 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:25:02 user nova-compute[70243]:       <entry name="serial">9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04</entry>
Jul 24 16:25:02 user nova-compute[70243]:       <entry name="uuid">9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04</entry>
Jul 24 16:25:02 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:25:02 user nova-compute[70243]:     </system>
Jul 24 16:25:02 user nova-compute[70243]:   </sysinfo>
Jul 24 16:25:02 user nova-compute[70243]:   <os>
Jul 24 16:25:02 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:25:02 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:25:02 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:25:02 user nova-compute[70243]:   </os>
Jul 24 16:25:02 user nova-compute[70243]:   <features>
Jul 24 16:25:02 user nova-compute[70243]:     <acpi/>
Jul 24 16:25:02 user nova-compute[70243]:     <apic/>
Jul 24 16:25:02 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:25:02 user nova-compute[70243]:   </features>
Jul 24 16:25:02 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:25:02 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:25:02 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:25:02 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:25:02 user nova-compute[70243]:   </clock>
Jul 24 16:25:02 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:25:02 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:25:02 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:25:02 user nova-compute[70243]:   </cpu>
Jul 24 16:25:02 user nova-compute[70243]:   <devices>
Jul 24 16:25:02 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:25:02 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:25:02 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk"/>
Jul 24 16:25:02 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:25:02 user nova-compute[70243]:     </disk>
Jul 24 16:25:02 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:25:02 user nova-compute[70243]:       <mac address="fa:16:3e:de:36:b6"/>
Jul 24 16:25:02 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:25:02 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:25:02 user nova-compute[70243]:       <target dev="tapbc944a2d-ab"/>
Jul 24 16:25:02 user nova-compute[70243]:     </interface>
Jul 24 16:25:02 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:25:02 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/console.log" append="off"/>
Jul 24 16:25:02 user nova-compute[70243]:     </serial>
Jul 24 16:25:02 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:25:02 user nova-compute[70243]:     <video>
Jul 24 16:25:02 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:25:02 user nova-compute[70243]:     </video>
Jul 24 16:25:02 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:25:02 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:25:02 user nova-compute[70243]:     </rng>
Jul 24 16:25:02 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:25:02 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:25:02 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:25:02 user nova-compute[70243]:     </memballoon>
Jul 24 16:25:02 user nova-compute[70243]:   </devices>
Jul 24 16:25:02 user nova-compute[70243]: </domain>
Jul 24 16:25:02 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:24:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1233422015',display_name='tempest-AttachVolumeNegativeTest-server-1233422015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1233422015',id=17,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGT2rkGSyXlMbTq/yju1RCH/R39q/wP+8/at2zAYGOJkKVQGAMqmx1u2dapVODLNC31GOE7t50QLv5CBwzfMkoaMIGDOZgz6KtBTHgG1635SSIdlm7b2nzTv0J9CMuDqQ==',key_name='tempest-keypair-1272592606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e819e22e590947478d513e1b9ad39494',ramdisk_id='',reservation_id='r-ooxr0ou9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1152214105',owner_user_name='tempest-AttachVolumeNegativeTest-1152214105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:25:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df18929107a458194a9c528d9bdfeac',uuid=9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc944a2d-ab8f-475a-b276-485ab373860a", "address": "fa:16:3e:de:36:b6", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc944a2d-ab", "ovs_interfaceid": "bc944a2d-ab8f-475a-b276-485ab373860a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converting VIF {"id": "bc944a2d-ab8f-475a-b276-485ab373860a", "address": "fa:16:3e:de:36:b6", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc944a2d-ab", "ovs_interfaceid": "bc944a2d-ab8f-475a-b276-485ab373860a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:36:b6,bridge_name='br-int',has_traffic_filtering=True,id=bc944a2d-ab8f-475a-b276-485ab373860a,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc944a2d-ab') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG os_vif [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:36:b6,bridge_name='br-int',has_traffic_filtering=True,id=bc944a2d-ab8f-475a-b276-485ab373860a,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc944a2d-ab') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc944a2d-ab, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbc944a2d-ab, col_values=(('external_ids', {'iface-id': 'bc944a2d-ab8f-475a-b276-485ab373860a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:36:b6', 'vm-uuid': '9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:02 user nova-compute[70243]: INFO os_vif [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:36:b6,bridge_name='br-int',has_traffic_filtering=True,id=bc944a2d-ab8f-475a-b276-485ab373860a,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc944a2d-ab')
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] No VIF found with MAC fa:16:3e:de:36:b6, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.network.neutron [req-3873c62d-d613-4cf9-b20a-ebbcc6e68805 req-2c73daa4-6d6e-4e69-a9f2-162357b34851 service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Updated VIF entry in instance network info cache for port bc944a2d-ab8f-475a-b276-485ab373860a. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG nova.network.neutron [req-3873c62d-d613-4cf9-b20a-ebbcc6e68805 req-2c73daa4-6d6e-4e69-a9f2-162357b34851 service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Updating instance_info_cache with network_info: [{"id": "bc944a2d-ab8f-475a-b276-485ab373860a", "address": "fa:16:3e:de:36:b6", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc944a2d-ab", "ovs_interfaceid": "bc944a2d-ab8f-475a-b276-485ab373860a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:25:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3873c62d-d613-4cf9-b20a-ebbcc6e68805 req-2c73daa4-6d6e-4e69-a9f2-162357b34851 service nova] Releasing lock "refresh_cache-9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:25:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:03 user nova-compute[70243]: DEBUG nova.compute.manager [req-1b3eb7c2-d098-4499-a691-c76f6361b9dd req-6d364f8d-f318-4ca5-af8b-ccf6ac3856b5 service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Received event network-vif-plugged-bc944a2d-ab8f-475a-b276-485ab373860a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1b3eb7c2-d098-4499-a691-c76f6361b9dd req-6d364f8d-f318-4ca5-af8b-ccf6ac3856b5 service nova] Acquiring lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1b3eb7c2-d098-4499-a691-c76f6361b9dd req-6d364f8d-f318-4ca5-af8b-ccf6ac3856b5 service nova] Lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1b3eb7c2-d098-4499-a691-c76f6361b9dd req-6d364f8d-f318-4ca5-af8b-ccf6ac3856b5 service nova] Lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:03 user nova-compute[70243]: DEBUG nova.compute.manager [req-1b3eb7c2-d098-4499-a691-c76f6361b9dd req-6d364f8d-f318-4ca5-af8b-ccf6ac3856b5 service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] No waiting events found dispatching network-vif-plugged-bc944a2d-ab8f-475a-b276-485ab373860a {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:25:03 user nova-compute[70243]: WARNING nova.compute.manager [req-1b3eb7c2-d098-4499-a691-c76f6361b9dd req-6d364f8d-f318-4ca5-af8b-ccf6ac3856b5 service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Received unexpected event network-vif-plugged-bc944a2d-ab8f-475a-b276-485ab373860a for instance with vm_state building and task_state spawning.
Jul 24 16:25:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:05 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215905.652048, 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:25:05 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] VM Resumed (Lifecycle Event)
Jul 24 16:25:05 user nova-compute[70243]: DEBUG nova.compute.manager [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:25:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:25:05 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Instance spawned successfully.
Jul 24 16:25:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:25:05 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:25:05 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:25:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:05 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:25:05 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215905.6535797, 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:25:05 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] VM Started (Lifecycle Event)
Jul 24 16:25:05 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:25:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-702d2f8a-ff35-49bf-9b1a-7b78a2d2c4cc req-1a7eadff-d3bd-47ba-b976-89d9d8b8e85a service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Received event network-vif-plugged-bc944a2d-ab8f-475a-b276-485ab373860a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-702d2f8a-ff35-49bf-9b1a-7b78a2d2c4cc req-1a7eadff-d3bd-47ba-b976-89d9d8b8e85a service nova] Acquiring lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-702d2f8a-ff35-49bf-9b1a-7b78a2d2c4cc req-1a7eadff-d3bd-47ba-b976-89d9d8b8e85a service nova] Lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-702d2f8a-ff35-49bf-9b1a-7b78a2d2c4cc req-1a7eadff-d3bd-47ba-b976-89d9d8b8e85a service nova] Lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-702d2f8a-ff35-49bf-9b1a-7b78a2d2c4cc req-1a7eadff-d3bd-47ba-b976-89d9d8b8e85a service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] No waiting events found dispatching network-vif-plugged-bc944a2d-ab8f-475a-b276-485ab373860a {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:25:05 user nova-compute[70243]: WARNING nova.compute.manager [req-702d2f8a-ff35-49bf-9b1a-7b78a2d2c4cc req-1a7eadff-d3bd-47ba-b976-89d9d8b8e85a service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Received unexpected event network-vif-plugged-bc944a2d-ab8f-475a-b276-485ab373860a for instance with vm_state building and task_state spawning.
Jul 24 16:25:05 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:25:05 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:25:05 user nova-compute[70243]: INFO nova.compute.manager [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Took 5.34 seconds to spawn the instance on the hypervisor.
Jul 24 16:25:05 user nova-compute[70243]: DEBUG nova.compute.manager [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:25:05 user nova-compute[70243]: INFO nova.compute.manager [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Took 6.09 seconds to build instance.
Jul 24 16:25:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b08e61b-9ac6-41f9-8382-6a9b03f3caf6 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.220s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:06 user nova-compute[70243]: DEBUG nova.compute.manager [req-03090227-7fcc-4ca6-8330-71238cbf46d2 req-543ecac7-42d9-4f0d-a776-c1b29436a279 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Received event network-changed-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:06 user nova-compute[70243]: DEBUG nova.compute.manager [req-03090227-7fcc-4ca6-8330-71238cbf46d2 req-543ecac7-42d9-4f0d-a776-c1b29436a279 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Refreshing instance network info cache due to event network-changed-b7b407a6-851a-4096-b6d4-d60d5e1d40d0. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:25:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-03090227-7fcc-4ca6-8330-71238cbf46d2 req-543ecac7-42d9-4f0d-a776-c1b29436a279 service nova] Acquiring lock "refresh_cache-abcd54bc-02d4-4872-8227-43cb93d27491" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:25:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-03090227-7fcc-4ca6-8330-71238cbf46d2 req-543ecac7-42d9-4f0d-a776-c1b29436a279 service nova] Acquired lock "refresh_cache-abcd54bc-02d4-4872-8227-43cb93d27491" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:25:06 user nova-compute[70243]: DEBUG nova.network.neutron [req-03090227-7fcc-4ca6-8330-71238cbf46d2 req-543ecac7-42d9-4f0d-a776-c1b29436a279 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Refreshing network info cache for port b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:25:06 user nova-compute[70243]: DEBUG nova.network.neutron [req-03090227-7fcc-4ca6-8330-71238cbf46d2 req-543ecac7-42d9-4f0d-a776-c1b29436a279 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Updated VIF entry in instance network info cache for port b7b407a6-851a-4096-b6d4-d60d5e1d40d0. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:25:06 user nova-compute[70243]: DEBUG nova.network.neutron [req-03090227-7fcc-4ca6-8330-71238cbf46d2 req-543ecac7-42d9-4f0d-a776-c1b29436a279 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Updating instance_info_cache with network_info: [{"id": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "address": "fa:16:3e:11:51:64", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b407a6-85", "ovs_interfaceid": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:25:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-03090227-7fcc-4ca6-8330-71238cbf46d2 req-543ecac7-42d9-4f0d-a776-c1b29436a279 service nova] Releasing lock "refresh_cache-abcd54bc-02d4-4872-8227-43cb93d27491" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:25:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "abcd54bc-02d4-4872-8227-43cb93d27491" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "abcd54bc-02d4-4872-8227-43cb93d27491" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:10 user nova-compute[70243]: INFO nova.compute.manager [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Shelving
Jul 24 16:25:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:10 user nova-compute[70243]: DEBUG nova.compute.manager [req-70d22ff3-1283-41c7-bc6b-612934a1da9a req-1496bc67-6397-417a-ab2a-16595aba4c80 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Received event network-vif-unplugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-70d22ff3-1283-41c7-bc6b-612934a1da9a req-1496bc67-6397-417a-ab2a-16595aba4c80 service nova] Acquiring lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-70d22ff3-1283-41c7-bc6b-612934a1da9a req-1496bc67-6397-417a-ab2a-16595aba4c80 service nova] Lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-70d22ff3-1283-41c7-bc6b-612934a1da9a req-1496bc67-6397-417a-ab2a-16595aba4c80 service nova] Lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:10 user nova-compute[70243]: DEBUG nova.compute.manager [req-70d22ff3-1283-41c7-bc6b-612934a1da9a req-1496bc67-6397-417a-ab2a-16595aba4c80 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] No waiting events found dispatching network-vif-unplugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:25:10 user nova-compute[70243]: WARNING nova.compute.manager [req-70d22ff3-1283-41c7-bc6b-612934a1da9a req-1496bc67-6397-417a-ab2a-16595aba4c80 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Received unexpected event network-vif-unplugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 for instance with vm_state active and task_state shelving.
Jul 24 16:25:10 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Instance destroyed successfully.
Jul 24 16:25:10 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Beginning cold snapshot process
Jul 24 16:25:11 user nova-compute[70243]: DEBUG nova.privsep.utils [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70243) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 16:25:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk /opt/stack/data/nova/instances/snapshots/tmplspmm3bk/1ae326944dfb483fbb14e1483cb9666d {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk /opt/stack/data/nova/instances/snapshots/tmplspmm3bk/1ae326944dfb483fbb14e1483cb9666d" returned: 0 in 0.648s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:11 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Snapshot extracted, beginning image upload
Jul 24 16:25:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:12 user nova-compute[70243]: DEBUG nova.compute.manager [req-3b71b4ee-5c63-4167-b14d-faa438e3d52b req-552ed865-ffbe-4e6a-bb65-6884923def87 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Received event network-vif-plugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3b71b4ee-5c63-4167-b14d-faa438e3d52b req-552ed865-ffbe-4e6a-bb65-6884923def87 service nova] Acquiring lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3b71b4ee-5c63-4167-b14d-faa438e3d52b req-552ed865-ffbe-4e6a-bb65-6884923def87 service nova] Lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3b71b4ee-5c63-4167-b14d-faa438e3d52b req-552ed865-ffbe-4e6a-bb65-6884923def87 service nova] Lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:12 user nova-compute[70243]: DEBUG nova.compute.manager [req-3b71b4ee-5c63-4167-b14d-faa438e3d52b req-552ed865-ffbe-4e6a-bb65-6884923def87 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] No waiting events found dispatching network-vif-plugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:25:12 user nova-compute[70243]: WARNING nova.compute.manager [req-3b71b4ee-5c63-4167-b14d-faa438e3d52b req-552ed865-ffbe-4e6a-bb65-6884923def87 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Received unexpected event network-vif-plugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 for instance with vm_state active and task_state shelving_image_uploading.
Jul 24 16:25:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:14 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Snapshot image upload complete
Jul 24 16:25:14 user nova-compute[70243]: DEBUG nova.compute.manager [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:25:14 user nova-compute[70243]: INFO nova.compute.manager [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Shelve offloading
Jul 24 16:25:14 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Instance destroyed successfully.
Jul 24 16:25:14 user nova-compute[70243]: DEBUG nova.compute.manager [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:25:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "refresh_cache-abcd54bc-02d4-4872-8227-43cb93d27491" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:25:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquired lock "refresh_cache-abcd54bc-02d4-4872-8227-43cb93d27491" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:25:14 user nova-compute[70243]: DEBUG nova.network.neutron [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:25:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:15 user nova-compute[70243]: DEBUG nova.network.neutron [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Updating instance_info_cache with network_info: [{"id": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "address": "fa:16:3e:11:51:64", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b407a6-85", "ovs_interfaceid": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:25:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Releasing lock "refresh_cache-abcd54bc-02d4-4872-8227-43cb93d27491" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:25:15 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Instance destroyed successfully.
Jul 24 16:25:15 user nova-compute[70243]: DEBUG nova.objects.instance [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'resources' on Instance uuid abcd54bc-02d4-4872-8227-43cb93d27491 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:25:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:23:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-81833196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-81833196',id=15,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0i2hBPJPt19uO9e4TSXZhl857gb3L3vMLFLZH6nJI1HpAainLWo36bPWYJB/sqsGP2BMKBKQjwJvt+xGzUlD69hcH1UBhw08zHqrJxdyORpjwKrQqIUJvk9SNHZKYJ2A==',key_name='tempest-keypair-146229776',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:23:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9fcf70d1092145a2bda67106833fe84d',ramdisk_id='',reservation_id='r-i86lveuw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-372850833',owner_user_name='tempest-AttachVolumeShelveTestJSON-372850833-project-member',shelved_at='2023-07-24T16:25:14.345223',shelved_host='user',shelved_image_id='9437ed8b-aed0-44ce-a0b8-369ce0e846cc'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:25:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62f8a994029a48608bfdcb15f14b2067',uuid=abcd54bc-02d4-4872-8227-43cb93d27491,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "address": "fa:16:3e:11:51:64", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b407a6-85", "ovs_interfaceid": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:25:15 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converting VIF {"id": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "address": "fa:16:3e:11:51:64", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b407a6-85", "ovs_interfaceid": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:25:15 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:51:64,bridge_name='br-int',has_traffic_filtering=True,id=b7b407a6-851a-4096-b6d4-d60d5e1d40d0,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b407a6-85') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:25:15 user nova-compute[70243]: DEBUG os_vif [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:51:64,bridge_name='br-int',has_traffic_filtering=True,id=b7b407a6-851a-4096-b6d4-d60d5e1d40d0,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b407a6-85') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:25:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7b407a6-85, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:25:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:25:15 user nova-compute[70243]: DEBUG nova.compute.manager [req-aaa371d7-a5c5-4338-b6f9-443233852f3b req-f7d4e38b-a4fb-499b-83c3-abdab08f0034 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Received event network-changed-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:15 user nova-compute[70243]: DEBUG nova.compute.manager [req-aaa371d7-a5c5-4338-b6f9-443233852f3b req-f7d4e38b-a4fb-499b-83c3-abdab08f0034 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Refreshing instance network info cache due to event network-changed-b7b407a6-851a-4096-b6d4-d60d5e1d40d0. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:25:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-aaa371d7-a5c5-4338-b6f9-443233852f3b req-f7d4e38b-a4fb-499b-83c3-abdab08f0034 service nova] Acquiring lock "refresh_cache-abcd54bc-02d4-4872-8227-43cb93d27491" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:25:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-aaa371d7-a5c5-4338-b6f9-443233852f3b req-f7d4e38b-a4fb-499b-83c3-abdab08f0034 service nova] Acquired lock "refresh_cache-abcd54bc-02d4-4872-8227-43cb93d27491" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:25:15 user nova-compute[70243]: DEBUG nova.network.neutron [req-aaa371d7-a5c5-4338-b6f9-443233852f3b req-f7d4e38b-a4fb-499b-83c3-abdab08f0034 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Refreshing network info cache for port b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:25:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:15 user nova-compute[70243]: INFO os_vif [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:51:64,bridge_name='br-int',has_traffic_filtering=True,id=b7b407a6-851a-4096-b6d4-d60d5e1d40d0,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b407a6-85')
Jul 24 16:25:15 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Deleting instance files /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491_del
Jul 24 16:25:15 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Deletion of /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491_del complete
Jul 24 16:25:15 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Deleted allocations for instance abcd54bc-02d4-4872-8227-43cb93d27491
Jul 24 16:25:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:15 user nova-compute[70243]: DEBUG nova.objects.instance [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'numa_topology' on Instance uuid abcd54bc-02d4-4872-8227-43cb93d27491 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:25:16 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:25:16 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:25:16 user nova-compute[70243]: DEBUG nova.network.neutron [req-aaa371d7-a5c5-4338-b6f9-443233852f3b req-f7d4e38b-a4fb-499b-83c3-abdab08f0034 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Updated VIF entry in instance network info cache for port b7b407a6-851a-4096-b6d4-d60d5e1d40d0. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:25:16 user nova-compute[70243]: DEBUG nova.network.neutron [req-aaa371d7-a5c5-4338-b6f9-443233852f3b req-f7d4e38b-a4fb-499b-83c3-abdab08f0034 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Updating instance_info_cache with network_info: [{"id": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "address": "fa:16:3e:11:51:64", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb7b407a6-85", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:25:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-aaa371d7-a5c5-4338-b6f9-443233852f3b req-f7d4e38b-a4fb-499b-83c3-abdab08f0034 service nova] Releasing lock "refresh_cache-abcd54bc-02d4-4872-8227-43cb93d27491" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:25:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-390adfeb-e214-455b-add8-ac1a867312db tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "abcd54bc-02d4-4872-8227-43cb93d27491" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.221s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-dee6898b-f400-4932-855f-cb556e212017 req-39ddfaf6-6813-489d-a283-6c5903be36b5 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received event network-changed-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-dee6898b-f400-4932-855f-cb556e212017 req-39ddfaf6-6813-489d-a283-6c5903be36b5 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Refreshing instance network info cache due to event network-changed-809292ba-1131-47d4-8b1c-b7cef6888d76. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:25:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dee6898b-f400-4932-855f-cb556e212017 req-39ddfaf6-6813-489d-a283-6c5903be36b5 service nova] Acquiring lock "refresh_cache-b0dd6065-3916-4f0e-841e-3df5ded2e2ee" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:25:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dee6898b-f400-4932-855f-cb556e212017 req-39ddfaf6-6813-489d-a283-6c5903be36b5 service nova] Acquired lock "refresh_cache-b0dd6065-3916-4f0e-841e-3df5ded2e2ee" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:25:24 user nova-compute[70243]: DEBUG nova.network.neutron [req-dee6898b-f400-4932-855f-cb556e212017 req-39ddfaf6-6813-489d-a283-6c5903be36b5 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Refreshing network info cache for port 809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:25:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:25 user nova-compute[70243]: DEBUG nova.network.neutron [req-dee6898b-f400-4932-855f-cb556e212017 req-39ddfaf6-6813-489d-a283-6c5903be36b5 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Updated VIF entry in instance network info cache for port 809292ba-1131-47d4-8b1c-b7cef6888d76. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:25:25 user nova-compute[70243]: DEBUG nova.network.neutron [req-dee6898b-f400-4932-855f-cb556e212017 req-39ddfaf6-6813-489d-a283-6c5903be36b5 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Updating instance_info_cache with network_info: [{"id": "809292ba-1131-47d4-8b1c-b7cef6888d76", "address": "fa:16:3e:83:78:ca", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809292ba-11", "ovs_interfaceid": "809292ba-1131-47d4-8b1c-b7cef6888d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:25:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dee6898b-f400-4932-855f-cb556e212017 req-39ddfaf6-6813-489d-a283-6c5903be36b5 service nova] Releasing lock "refresh_cache-b0dd6065-3916-4f0e-841e-3df5ded2e2ee" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:25:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:25 user nova-compute[70243]: INFO nova.compute.manager [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Detaching volume 83ffe933-b556-46eb-b3eb-b77f6c75e323
Jul 24 16:25:25 user nova-compute[70243]: INFO nova.virt.block_device [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Attempting to driver detach volume 83ffe933-b556-46eb-b3eb-b77f6c75e323 from mountpoint /dev/vdb
Jul 24 16:25:25 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Attempting to detach device vdb from instance b0dd6065-3916-4f0e-841e-3df5ded2e2ee from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:25:25 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:25:25 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:25:25 user nova-compute[70243]:   <source dev="/dev/sdj"/>
Jul 24 16:25:25 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:25:25 user nova-compute[70243]:   <serial>83ffe933-b556-46eb-b3eb-b77f6c75e323</serial>
Jul 24 16:25:25 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 16:25:25 user nova-compute[70243]: </disk>
Jul 24 16:25:25 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:25:25 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Successfully detached device vdb from instance b0dd6065-3916-4f0e-841e-3df5ded2e2ee from the persistent domain config.
Jul 24 16:25:25 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b0dd6065-3916-4f0e-841e-3df5ded2e2ee from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:25:25 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:25:25 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:25:25 user nova-compute[70243]:   <source dev="/dev/sdj"/>
Jul 24 16:25:25 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:25:25 user nova-compute[70243]:   <serial>83ffe933-b556-46eb-b3eb-b77f6c75e323</serial>
Jul 24 16:25:25 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 16:25:25 user nova-compute[70243]: </disk>
Jul 24 16:25:25 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:25:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:25 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690215910.867226, abcd54bc-02d4-4872-8227-43cb93d27491 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:25:25 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] VM Stopped (Lifecycle Event)
Jul 24 16:25:25 user nova-compute[70243]: DEBUG nova.compute.manager [None req-619d242d-daa4-4dd5-b98f-441030d57380 None None] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690215926.1302266, b0dd6065-3916-4f0e-841e-3df5ded2e2ee => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b0dd6065-3916-4f0e-841e-3df5ded2e2ee {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:25:26 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Successfully detached device vdb from instance b0dd6065-3916-4f0e-841e-3df5ded2e2ee from the live domain config.
Jul 24 16:25:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFvxVoyb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:25:26 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:25:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e808639-91ce-47b0-a9ef-921f3c9f640b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:25:26 user nova-compute[70243]: No targets found.
Jul 24 16:25:26 user nova-compute[70243]: iSNS:
Jul 24 16:25:26 user nova-compute[70243]: No targets found.
Jul 24 16:25:26 user nova-compute[70243]: STATIC:
Jul 24 16:25:26 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323
Jul 24 16:25:26 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:25:26 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:25:26 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b
Jul 24 16:25:26 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:25:26 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:25:26 user nova-compute[70243]: FIRMWARE:
Jul 24 16:25:26 user nova-compute[70243]: No targets found.
Jul 24 16:25:26 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:25:26 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:25:26 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0dd255-02c4-4a4d-a5dd-27d09c79e30b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[16716909-0f1a-43ed-bb26-9c7838dca617]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:25:26 user nova-compute[70243]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:25:26 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 (non-flash)
Jul 24 16:25:26 user nova-compute[70243]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:25:26 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc7740d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323'): ({'sdj'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Removing single pathed devices sdj {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[84059431-81fd-4300-a408-d3e70a34a953]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de84eb4-731e-48db-9935-65472e0c3dc4]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Flushing IO for device /dev/sdj {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8814b265-6ff1-40bf-badd-a9521e74471d]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.046s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae12dbea-9fbd-4e4a-900d-3168e1841488]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] SCSI volumes sdj have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ce7c34-cf3c-40dd-9182-4cfc019e6ea0]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f834dc98-c063-458c-827c-49272a786ee5]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323, portal: 172.16.0.220,3260]
Jul 24 16:25:26 user nova-compute[70243]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323, portal: 172.16.0.220,3260] successful.
Jul 24 16:25:26 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ffe933-b556-46eb-b3eb-b77f6c75e323 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dca4f7-1d22-4b26-87d4-2cb17c1b8c78]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] <== disconnect_volume: return (358ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-38c9f5af-17b2-4842-bc9e-8356580928e6 req-24fed80b-8385-4598-a235-bbc373967869 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received event network-changed-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-38c9f5af-17b2-4842-bc9e-8356580928e6 req-24fed80b-8385-4598-a235-bbc373967869 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Refreshing instance network info cache due to event network-changed-809292ba-1131-47d4-8b1c-b7cef6888d76. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-38c9f5af-17b2-4842-bc9e-8356580928e6 req-24fed80b-8385-4598-a235-bbc373967869 service nova] Acquiring lock "refresh_cache-b0dd6065-3916-4f0e-841e-3df5ded2e2ee" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-38c9f5af-17b2-4842-bc9e-8356580928e6 req-24fed80b-8385-4598-a235-bbc373967869 service nova] Acquired lock "refresh_cache-b0dd6065-3916-4f0e-841e-3df5ded2e2ee" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:25:26 user nova-compute[70243]: DEBUG nova.network.neutron [req-38c9f5af-17b2-4842-bc9e-8356580928e6 req-24fed80b-8385-4598-a235-bbc373967869 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Refreshing network info cache for port 809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:25:27 user nova-compute[70243]: DEBUG nova.objects.instance [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lazy-loading 'flavor' on Instance uuid b0dd6065-3916-4f0e-841e-3df5ded2e2ee {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:25:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-312fc665-a38c-4bec-9443-19eeb47cda50 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.874s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:27 user nova-compute[70243]: DEBUG nova.network.neutron [req-38c9f5af-17b2-4842-bc9e-8356580928e6 req-24fed80b-8385-4598-a235-bbc373967869 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Updated VIF entry in instance network info cache for port 809292ba-1131-47d4-8b1c-b7cef6888d76. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:25:27 user nova-compute[70243]: DEBUG nova.network.neutron [req-38c9f5af-17b2-4842-bc9e-8356580928e6 req-24fed80b-8385-4598-a235-bbc373967869 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Updating instance_info_cache with network_info: [{"id": "809292ba-1131-47d4-8b1c-b7cef6888d76", "address": "fa:16:3e:83:78:ca", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809292ba-11", "ovs_interfaceid": "809292ba-1131-47d4-8b1c-b7cef6888d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:25:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-38c9f5af-17b2-4842-bc9e-8356580928e6 req-24fed80b-8385-4598-a235-bbc373967869 service nova] Releasing lock "refresh_cache-b0dd6065-3916-4f0e-841e-3df5ded2e2ee" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:25:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "50fecb3a-8f06-4822-8c84-76df51acfe50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:39 user nova-compute[70243]: DEBUG nova.compute.manager [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:25:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:39 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:25:39 user nova-compute[70243]: INFO nova.compute.claims [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Claim successful on node user
Jul 24 16:25:40 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG nova.network.neutron [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:25:40 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:25:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "6f2258de-6b31-48af-81df-37b64da4ca99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "6f2258de-6b31-48af-81df-37b64da4ca99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG nova.policy [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fcb7fb5c11bb4d65b9c39923840685c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c25474ae9fb49cb92c611e77f2dbc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:25:40 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Creating image(s)
Jul 24 16:25:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "/opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "/opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "/opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:25:40 user nova-compute[70243]: INFO nova.compute.claims [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Claim successful on node user
Jul 24 16:25:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.142s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk 1073741824" returned: 0 in 0.050s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.155s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Checking if we can resize image /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG nova.network.neutron [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Successfully created port: 657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Cannot resize image /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG nova.objects.instance [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'migration_context' on Instance uuid 50fecb3a-8f06-4822-8c84-76df51acfe50 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Ensure instance console log exists: /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.599s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG nova.compute.manager [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG nova.compute.manager [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG nova.network.neutron [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:25:41 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:25:41 user nova-compute[70243]: DEBUG nova.compute.manager [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Acquiring lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG nova.compute.manager [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:25:41 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Creating image(s)
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "/opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "/opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG nova.policy [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fcb7fb5c11bb4d65b9c39923840685c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c25474ae9fb49cb92c611e77f2dbc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:25:41 user nova-compute[70243]: INFO nova.compute.claims [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Claim successful on node user
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.157s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.165s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG nova.network.neutron [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Successfully updated port: 657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Acquiring lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Acquiring lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "refresh_cache-50fecb3a-8f06-4822-8c84-76df51acfe50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquired lock "refresh_cache-50fecb3a-8f06-4822-8c84-76df51acfe50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG nova.network.neutron [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:25:41 user nova-compute[70243]: INFO nova.compute.manager [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Terminating instance
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk 1073741824" returned: 0 in 0.081s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG nova.compute.manager [req-cdf77c05-b3f7-4a92-bc82-7835ab3e53ff req-b2b55ac6-af8f-4888-9c14-ee1f0acb645e service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received event network-changed-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG nova.compute.manager [req-cdf77c05-b3f7-4a92-bc82-7835ab3e53ff req-b2b55ac6-af8f-4888-9c14-ee1f0acb645e service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Refreshing instance network info cache due to event network-changed-657cc261-2d12-42c2-a879-f8cc121bd811. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cdf77c05-b3f7-4a92-bc82-7835ab3e53ff req-b2b55ac6-af8f-4888-9c14-ee1f0acb645e service nova] Acquiring lock "refresh_cache-50fecb3a-8f06-4822-8c84-76df51acfe50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:41 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG nova.network.neutron [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.157s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Cannot resize image /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG nova.objects.instance [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'migration_context' on Instance uuid 6f2258de-6b31-48af-81df-37b64da4ca99 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.700s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Ensure instance console log exists: /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG nova.network.neutron [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:25:42 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:25:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:25:42 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Creating image(s)
Jul 24 16:25:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "/opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "/opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:42 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Instance destroyed successfully.
Jul 24 16:25:42 user nova-compute[70243]: DEBUG nova.objects.instance [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Lazy-loading 'resources' on Instance uuid 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:23:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1766332538',display_name='tempest-VolumesActionsTest-instance-1766332538',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1766332538',id=16,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:23:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc232fc3856a4edb8adc0c47cb15cc66',ramdisk_id='',reservation_id='r-5z3f7kxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1813125667',owner_user_name='tempest-VolumesActionsTest-1813125667-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:23:51Z,user_data=None,user_id='05e972674e79471db0805b73b7d3d93f',uuid=66147ca4-6c90-4ed8-b6f4-6437d0e8c38b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebb9c545-4b4b-4765-848b-e81ff8cd8bed", "address": "fa:16:3e:e2:95:9b", "network": {"id": "b0c05f1d-624c-49c4-98a2-20542fd327de", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1473655018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc232fc3856a4edb8adc0c47cb15cc66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb9c545-4b", "ovs_interfaceid": "ebb9c545-4b4b-4765-848b-e81ff8cd8bed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Converting VIF {"id": "ebb9c545-4b4b-4765-848b-e81ff8cd8bed", "address": "fa:16:3e:e2:95:9b", "network": {"id": "b0c05f1d-624c-49c4-98a2-20542fd327de", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1473655018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc232fc3856a4edb8adc0c47cb15cc66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb9c545-4b", "ovs_interfaceid": "ebb9c545-4b4b-4765-848b-e81ff8cd8bed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:95:9b,bridge_name='br-int',has_traffic_filtering=True,id=ebb9c545-4b4b-4765-848b-e81ff8cd8bed,network=Network(b0c05f1d-624c-49c4-98a2-20542fd327de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb9c545-4b') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG os_vif [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:95:9b,bridge_name='br-int',has_traffic_filtering=True,id=ebb9c545-4b4b-4765-848b-e81ff8cd8bed,network=Network(b0c05f1d-624c-49c4-98a2-20542fd327de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb9c545-4b') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebb9c545-4b, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:42 user nova-compute[70243]: INFO os_vif [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:95:9b,bridge_name='br-int',has_traffic_filtering=True,id=ebb9c545-4b4b-4765-848b-e81ff8cd8bed,network=Network(b0c05f1d-624c-49c4-98a2-20542fd327de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb9c545-4b')
Jul 24 16:25:42 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Deleting instance files /opt/stack/data/nova/instances/66147ca4-6c90-4ed8-b6f4-6437d0e8c38b_del
Jul 24 16:25:42 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Deletion of /opt/stack/data/nova/instances/66147ca4-6c90-4ed8-b6f4-6437d0e8c38b_del complete
Jul 24 16:25:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.171s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:42 user nova-compute[70243]: INFO nova.compute.manager [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Took 0.78 seconds to destroy the instance on the hypervisor.
Jul 24 16:25:42 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.156s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk 1073741824" returned: 0 in 0.052s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.network.neutron [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Updating instance_info_cache with network_info: [{"id": "657cc261-2d12-42c2-a879-f8cc121bd811", "address": "fa:16:3e:93:0d:e3", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657cc261-2d", "ovs_interfaceid": "657cc261-2d12-42c2-a879-f8cc121bd811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Releasing lock "refresh_cache-50fecb3a-8f06-4822-8c84-76df51acfe50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.compute.manager [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Instance network_info: |[{"id": "657cc261-2d12-42c2-a879-f8cc121bd811", "address": "fa:16:3e:93:0d:e3", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657cc261-2d", "ovs_interfaceid": "657cc261-2d12-42c2-a879-f8cc121bd811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cdf77c05-b3f7-4a92-bc82-7835ab3e53ff req-b2b55ac6-af8f-4888-9c14-ee1f0acb645e service nova] Acquired lock "refresh_cache-50fecb3a-8f06-4822-8c84-76df51acfe50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.network.neutron [req-cdf77c05-b3f7-4a92-bc82-7835ab3e53ff req-b2b55ac6-af8f-4888-9c14-ee1f0acb645e service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Refreshing network info cache for port 657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Start _get_guest_xml network_info=[{"id": "657cc261-2d12-42c2-a879-f8cc121bd811", "address": "fa:16:3e:93:0d:e3", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657cc261-2d", "ovs_interfaceid": "657cc261-2d12-42c2-a879-f8cc121bd811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.policy [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '695787042f9f4e4eb0997bf72d169913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d8ae9e361c4588ac564ac242dcab21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.188s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.network.neutron [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Successfully created port: 38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:25:43 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:25:43 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1525531413',display_name='tempest-ServerRescueNegativeTestJSON-server-1525531413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1525531413',id=18,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c25474ae9fb49cb92c611e77f2dbc79',ramdisk_id='',reservation_id='r-yg0b8tqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1414931075',owner_user_name='tempest-ServerRescueNegativeTestJSON-1414931075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:25:40Z,user_data=None,user_id='fcb7fb5c11bb4d65b9c39923840685c6',uuid=50fecb3a-8f06-4822-8c84-76df51acfe50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "657cc261-2d12-42c2-a879-f8cc121bd811", "address": "fa:16:3e:93:0d:e3", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657cc261-2d", "ovs_interfaceid": "657cc261-2d12-42c2-a879-f8cc121bd811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converting VIF {"id": "657cc261-2d12-42c2-a879-f8cc121bd811", "address": "fa:16:3e:93:0d:e3", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657cc261-2d", "ovs_interfaceid": "657cc261-2d12-42c2-a879-f8cc121bd811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:0d:e3,bridge_name='br-int',has_traffic_filtering=True,id=657cc261-2d12-42c2-a879-f8cc121bd811,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657cc261-2d') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.objects.instance [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'pci_devices' on Instance uuid 50fecb3a-8f06-4822-8c84-76df51acfe50 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Cannot resize image /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.objects.instance [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lazy-loading 'migration_context' on Instance uuid 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:25:43 user nova-compute[70243]:   <uuid>50fecb3a-8f06-4822-8c84-76df51acfe50</uuid>
Jul 24 16:25:43 user nova-compute[70243]:   <name>instance-00000012</name>
Jul 24 16:25:43 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:25:43 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:25:43 user nova-compute[70243]:   <metadata>
Jul 24 16:25:43 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:25:43 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:25:43 user nova-compute[70243]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1525531413</nova:name>
Jul 24 16:25:43 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:25:43</nova:creationTime>
Jul 24 16:25:43 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:25:43 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:25:43 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:25:43 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:25:43 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:25:43 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:25:43 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:25:43 user nova-compute[70243]:       <nova:owner>
Jul 24 16:25:43 user nova-compute[70243]:         <nova:user uuid="fcb7fb5c11bb4d65b9c39923840685c6">tempest-ServerRescueNegativeTestJSON-1414931075-project-member</nova:user>
Jul 24 16:25:43 user nova-compute[70243]:         <nova:project uuid="9c25474ae9fb49cb92c611e77f2dbc79">tempest-ServerRescueNegativeTestJSON-1414931075</nova:project>
Jul 24 16:25:43 user nova-compute[70243]:       </nova:owner>
Jul 24 16:25:43 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:25:43 user nova-compute[70243]:       <nova:ports>
Jul 24 16:25:43 user nova-compute[70243]:         <nova:port uuid="657cc261-2d12-42c2-a879-f8cc121bd811">
Jul 24 16:25:43 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 16:25:43 user nova-compute[70243]:         </nova:port>
Jul 24 16:25:43 user nova-compute[70243]:       </nova:ports>
Jul 24 16:25:43 user nova-compute[70243]:     </nova:instance>
Jul 24 16:25:43 user nova-compute[70243]:   </metadata>
Jul 24 16:25:43 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:25:43 user nova-compute[70243]:     <system>
Jul 24 16:25:43 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:25:43 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:25:43 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:25:43 user nova-compute[70243]:       <entry name="serial">50fecb3a-8f06-4822-8c84-76df51acfe50</entry>
Jul 24 16:25:43 user nova-compute[70243]:       <entry name="uuid">50fecb3a-8f06-4822-8c84-76df51acfe50</entry>
Jul 24 16:25:43 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:25:43 user nova-compute[70243]:     </system>
Jul 24 16:25:43 user nova-compute[70243]:   </sysinfo>
Jul 24 16:25:43 user nova-compute[70243]:   <os>
Jul 24 16:25:43 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:25:43 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:25:43 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:25:43 user nova-compute[70243]:   </os>
Jul 24 16:25:43 user nova-compute[70243]:   <features>
Jul 24 16:25:43 user nova-compute[70243]:     <acpi/>
Jul 24 16:25:43 user nova-compute[70243]:     <apic/>
Jul 24 16:25:43 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:25:43 user nova-compute[70243]:   </features>
Jul 24 16:25:43 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:25:43 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:25:43 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:25:43 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:25:43 user nova-compute[70243]:   </clock>
Jul 24 16:25:43 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:25:43 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:25:43 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:25:43 user nova-compute[70243]:   </cpu>
Jul 24 16:25:43 user nova-compute[70243]:   <devices>
Jul 24 16:25:43 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:25:43 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:25:43 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk"/>
Jul 24 16:25:43 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:25:43 user nova-compute[70243]:     </disk>
Jul 24 16:25:43 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:25:43 user nova-compute[70243]:       <mac address="fa:16:3e:93:0d:e3"/>
Jul 24 16:25:43 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:25:43 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:25:43 user nova-compute[70243]:       <target dev="tap657cc261-2d"/>
Jul 24 16:25:43 user nova-compute[70243]:     </interface>
Jul 24 16:25:43 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:25:43 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/console.log" append="off"/>
Jul 24 16:25:43 user nova-compute[70243]:     </serial>
Jul 24 16:25:43 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:25:43 user nova-compute[70243]:     <video>
Jul 24 16:25:43 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:25:43 user nova-compute[70243]:     </video>
Jul 24 16:25:43 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:25:43 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:25:43 user nova-compute[70243]:     </rng>
Jul 24 16:25:43 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:25:43 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:25:43 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:25:43 user nova-compute[70243]:     </memballoon>
Jul 24 16:25:43 user nova-compute[70243]:   </devices>
Jul 24 16:25:43 user nova-compute[70243]: </domain>
Jul 24 16:25:43 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1525531413',display_name='tempest-ServerRescueNegativeTestJSON-server-1525531413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1525531413',id=18,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c25474ae9fb49cb92c611e77f2dbc79',ramdisk_id='',reservation_id='r-yg0b8tqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1414931075',owner_user_name='tempest-ServerRescueNegativeTestJSON-1414931075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:25:40Z,user_data=None,user_id='fcb7fb5c11bb4d65b9c39923840685c6',uuid=50fecb3a-8f06-4822-8c84-76df51acfe50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "657cc261-2d12-42c2-a879-f8cc121bd811", "address": "fa:16:3e:93:0d:e3", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657cc261-2d", "ovs_interfaceid": "657cc261-2d12-42c2-a879-f8cc121bd811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converting VIF {"id": "657cc261-2d12-42c2-a879-f8cc121bd811", "address": "fa:16:3e:93:0d:e3", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657cc261-2d", "ovs_interfaceid": "657cc261-2d12-42c2-a879-f8cc121bd811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:0d:e3,bridge_name='br-int',has_traffic_filtering=True,id=657cc261-2d12-42c2-a879-f8cc121bd811,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657cc261-2d') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG os_vif [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:0d:e3,bridge_name='br-int',has_traffic_filtering=True,id=657cc261-2d12-42c2-a879-f8cc121bd811,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657cc261-2d') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Ensure instance console log exists: /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap657cc261-2d, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap657cc261-2d, col_values=(('external_ids', {'iface-id': '657cc261-2d12-42c2-a879-f8cc121bd811', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:0d:e3', 'vm-uuid': '50fecb3a-8f06-4822-8c84-76df51acfe50'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:43 user nova-compute[70243]: INFO os_vif [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:0d:e3,bridge_name='br-int',has_traffic_filtering=True,id=657cc261-2d12-42c2-a879-f8cc121bd811,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657cc261-2d')
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] No VIF found with MAC fa:16:3e:93:0d:e3, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:25:43 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Took 0.68 seconds to deallocate network for instance.
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.compute.manager [req-93db839d-a1c1-4c29-9aa8-a81f0eafe140 req-7b444ebc-e5ea-4aca-aa48-71792f793d53 service nova] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Received event network-vif-deleted-ebb9c545-4b4b-4765-848b-e81ff8cd8bed {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.network.neutron [req-cdf77c05-b3f7-4a92-bc82-7835ab3e53ff req-b2b55ac6-af8f-4888-9c14-ee1f0acb645e service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Updated VIF entry in instance network info cache for port 657cc261-2d12-42c2-a879-f8cc121bd811. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.network.neutron [req-cdf77c05-b3f7-4a92-bc82-7835ab3e53ff req-b2b55ac6-af8f-4888-9c14-ee1f0acb645e service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Updating instance_info_cache with network_info: [{"id": "657cc261-2d12-42c2-a879-f8cc121bd811", "address": "fa:16:3e:93:0d:e3", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657cc261-2d", "ovs_interfaceid": "657cc261-2d12-42c2-a879-f8cc121bd811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cdf77c05-b3f7-4a92-bc82-7835ab3e53ff req-b2b55ac6-af8f-4888-9c14-ee1f0acb645e service nova] Releasing lock "refresh_cache-50fecb3a-8f06-4822-8c84-76df51acfe50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.objects.instance [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'flavor' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "refresh_cache-ad611655-ba4d-4a66-b78e-a82c058f4414" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquired lock "refresh_cache-ad611655-ba4d-4a66-b78e-a82c058f4414" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.network.neutron [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.objects.instance [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'info_cache' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:25:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-d582a59c-77f9-4466-8ba5-0250a6c02ea2 req-56af988b-6fe6-4a87-afaa-bbf925831c11 service nova] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Received event network-vif-unplugged-ebb9c545-4b4b-4765-848b-e81ff8cd8bed {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d582a59c-77f9-4466-8ba5-0250a6c02ea2 req-56af988b-6fe6-4a87-afaa-bbf925831c11 service nova] Acquiring lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d582a59c-77f9-4466-8ba5-0250a6c02ea2 req-56af988b-6fe6-4a87-afaa-bbf925831c11 service nova] Lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d582a59c-77f9-4466-8ba5-0250a6c02ea2 req-56af988b-6fe6-4a87-afaa-bbf925831c11 service nova] Lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-d582a59c-77f9-4466-8ba5-0250a6c02ea2 req-56af988b-6fe6-4a87-afaa-bbf925831c11 service nova] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] No waiting events found dispatching network-vif-unplugged-ebb9c545-4b4b-4765-848b-e81ff8cd8bed {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:25:44 user nova-compute[70243]: WARNING nova.compute.manager [req-d582a59c-77f9-4466-8ba5-0250a6c02ea2 req-56af988b-6fe6-4a87-afaa-bbf925831c11 service nova] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Received unexpected event network-vif-unplugged-ebb9c545-4b4b-4765-848b-e81ff8cd8bed for instance with vm_state deleted and task_state None.
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-d582a59c-77f9-4466-8ba5-0250a6c02ea2 req-56af988b-6fe6-4a87-afaa-bbf925831c11 service nova] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Received event network-vif-plugged-ebb9c545-4b4b-4765-848b-e81ff8cd8bed {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d582a59c-77f9-4466-8ba5-0250a6c02ea2 req-56af988b-6fe6-4a87-afaa-bbf925831c11 service nova] Acquiring lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d582a59c-77f9-4466-8ba5-0250a6c02ea2 req-56af988b-6fe6-4a87-afaa-bbf925831c11 service nova] Lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d582a59c-77f9-4466-8ba5-0250a6c02ea2 req-56af988b-6fe6-4a87-afaa-bbf925831c11 service nova] Lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-d582a59c-77f9-4466-8ba5-0250a6c02ea2 req-56af988b-6fe6-4a87-afaa-bbf925831c11 service nova] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] No waiting events found dispatching network-vif-plugged-ebb9c545-4b4b-4765-848b-e81ff8cd8bed {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:25:44 user nova-compute[70243]: WARNING nova.compute.manager [req-d582a59c-77f9-4466-8ba5-0250a6c02ea2 req-56af988b-6fe6-4a87-afaa-bbf925831c11 service nova] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Received unexpected event network-vif-plugged-ebb9c545-4b4b-4765-848b-e81ff8cd8bed for instance with vm_state deleted and task_state None.
Jul 24 16:25:44 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Deleted allocations for instance 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b
Jul 24 16:25:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e66f2d01-b15f-419e-b1ef-ae757d7f375a tempest-VolumesActionsTest-1813125667 tempest-VolumesActionsTest-1813125667-project-member] Lock "66147ca4-6c90-4ed8-b6f4-6437d0e8c38b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.193s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.network.neutron [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Updating instance_info_cache with network_info: [{"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Releasing lock "refresh_cache-ad611655-ba4d-4a66-b78e-a82c058f4414" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:25:44 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Instance destroyed successfully.
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.objects.instance [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'resources' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1592531500',display_name='tempest-AttachVolumeTestJSON-server-1592531500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1592531500',id=5,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyqJB6onbLaD2r1QfVtdarKDSnujLrUpKPczrv1sRKzUEbnqnXysxM1e2pVM0BKjCFI6X1To86Tx81MPL8yxdaUKlyWRVQ/8A7Y/aJ/EGuRxG0ZYo3tQwvjAcenmDrEEg==',key_name='tempest-keypair-810229109',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:18:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d099632b940545b9bbe000e5cc323ec1',ramdisk_id='',reservation_id='r-6lakmpdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1836925262',owner_user_name='tempest-AttachVolumeTestJSON-1836925262-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:23:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7de0cd9dd23d4569939884728bde772c',uuid=ad611655-ba4d-4a66-b78e-a82c058f4414,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converting VIF {"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d8:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef8e7d11-464b-421b-bfc9-0d5a17f610d4,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8e7d11-46') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG os_vif [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d8:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef8e7d11-464b-421b-bfc9-0d5a17f610d4,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8e7d11-46') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef8e7d11-46, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:44 user nova-compute[70243]: INFO os_vif [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d8:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef8e7d11-464b-421b-bfc9-0d5a17f610d4,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8e7d11-46')
Jul 24 16:25:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Start _get_guest_xml network_info=[{"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.objects.instance [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'numa_topology' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:25:44 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:25:44 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.network.neutron [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Successfully updated port: 38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.objects.instance [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'vcpu_model' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "refresh_cache-6f2258de-6b31-48af-81df-37b64da4ca99" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquired lock "refresh_cache-6f2258de-6b31-48af-81df-37b64da4ca99" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.network.neutron [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1592531500',display_name='tempest-AttachVolumeTestJSON-server-1592531500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1592531500',id=5,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyqJB6onbLaD2r1QfVtdarKDSnujLrUpKPczrv1sRKzUEbnqnXysxM1e2pVM0BKjCFI6X1To86Tx81MPL8yxdaUKlyWRVQ/8A7Y/aJ/EGuRxG0ZYo3tQwvjAcenmDrEEg==',key_name='tempest-keypair-810229109',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:18:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d099632b940545b9bbe000e5cc323ec1',ramdisk_id='',reservation_id='r-6lakmpdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1836925262',owner_user_name='tempest-AttachVolumeTestJSON-1836925262-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:23:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7de0cd9dd23d4569939884728bde772c',uuid=ad611655-ba4d-4a66-b78e-a82c058f4414,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converting VIF {"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d8:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef8e7d11-464b-421b-bfc9-0d5a17f610d4,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8e7d11-46') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.objects.instance [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'pci_devices' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-c9c70aca-8a9d-459c-b564-30af19e853c8 req-74497bf5-c3b4-4f21-a39c-19e8959f9bea service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Received event network-changed-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-c9c70aca-8a9d-459c-b564-30af19e853c8 req-74497bf5-c3b4-4f21-a39c-19e8959f9bea service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Refreshing instance network info cache due to event network-changed-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c9c70aca-8a9d-459c-b564-30af19e853c8 req-74497bf5-c3b4-4f21-a39c-19e8959f9bea service nova] Acquiring lock "refresh_cache-6f2258de-6b31-48af-81df-37b64da4ca99" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:25:44 user nova-compute[70243]:   <uuid>ad611655-ba4d-4a66-b78e-a82c058f4414</uuid>
Jul 24 16:25:44 user nova-compute[70243]:   <name>instance-00000005</name>
Jul 24 16:25:44 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:25:44 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:25:44 user nova-compute[70243]:   <metadata>
Jul 24 16:25:44 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:25:44 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:25:44 user nova-compute[70243]:       <nova:name>tempest-AttachVolumeTestJSON-server-1592531500</nova:name>
Jul 24 16:25:44 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:25:44</nova:creationTime>
Jul 24 16:25:44 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:25:44 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:25:44 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:25:44 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:25:44 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:25:44 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:25:44 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:25:44 user nova-compute[70243]:       <nova:owner>
Jul 24 16:25:44 user nova-compute[70243]:         <nova:user uuid="7de0cd9dd23d4569939884728bde772c">tempest-AttachVolumeTestJSON-1836925262-project-member</nova:user>
Jul 24 16:25:44 user nova-compute[70243]:         <nova:project uuid="d099632b940545b9bbe000e5cc323ec1">tempest-AttachVolumeTestJSON-1836925262</nova:project>
Jul 24 16:25:44 user nova-compute[70243]:       </nova:owner>
Jul 24 16:25:44 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:25:44 user nova-compute[70243]:       <nova:ports>
Jul 24 16:25:44 user nova-compute[70243]:         <nova:port uuid="ef8e7d11-464b-421b-bfc9-0d5a17f610d4">
Jul 24 16:25:44 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 24 16:25:44 user nova-compute[70243]:         </nova:port>
Jul 24 16:25:44 user nova-compute[70243]:       </nova:ports>
Jul 24 16:25:44 user nova-compute[70243]:     </nova:instance>
Jul 24 16:25:44 user nova-compute[70243]:   </metadata>
Jul 24 16:25:44 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:25:44 user nova-compute[70243]:     <system>
Jul 24 16:25:44 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:25:44 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:25:44 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:25:44 user nova-compute[70243]:       <entry name="serial">ad611655-ba4d-4a66-b78e-a82c058f4414</entry>
Jul 24 16:25:44 user nova-compute[70243]:       <entry name="uuid">ad611655-ba4d-4a66-b78e-a82c058f4414</entry>
Jul 24 16:25:44 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:25:44 user nova-compute[70243]:     </system>
Jul 24 16:25:44 user nova-compute[70243]:   </sysinfo>
Jul 24 16:25:44 user nova-compute[70243]:   <os>
Jul 24 16:25:44 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:25:44 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:25:44 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:25:44 user nova-compute[70243]:   </os>
Jul 24 16:25:44 user nova-compute[70243]:   <features>
Jul 24 16:25:44 user nova-compute[70243]:     <acpi/>
Jul 24 16:25:44 user nova-compute[70243]:     <apic/>
Jul 24 16:25:44 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:25:44 user nova-compute[70243]:   </features>
Jul 24 16:25:44 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:25:44 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:25:44 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:25:44 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:25:44 user nova-compute[70243]:   </clock>
Jul 24 16:25:44 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:25:44 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:25:44 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:25:44 user nova-compute[70243]:   </cpu>
Jul 24 16:25:44 user nova-compute[70243]:   <devices>
Jul 24 16:25:44 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:25:44 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:25:44 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk"/>
Jul 24 16:25:44 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:25:44 user nova-compute[70243]:     </disk>
Jul 24 16:25:44 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:25:44 user nova-compute[70243]:       <mac address="fa:16:3e:0e:d8:8a"/>
Jul 24 16:25:44 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:25:44 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:25:44 user nova-compute[70243]:       <target dev="tapef8e7d11-46"/>
Jul 24 16:25:44 user nova-compute[70243]:     </interface>
Jul 24 16:25:44 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:25:44 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/console.log" append="off"/>
Jul 24 16:25:44 user nova-compute[70243]:     </serial>
Jul 24 16:25:44 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:25:44 user nova-compute[70243]:     <video>
Jul 24 16:25:44 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:25:44 user nova-compute[70243]:     </video>
Jul 24 16:25:44 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:25:44 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:25:44 user nova-compute[70243]:     </rng>
Jul 24 16:25:44 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:25:44 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:25:44 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:25:44 user nova-compute[70243]:     </memballoon>
Jul 24 16:25:44 user nova-compute[70243]:   </devices>
Jul 24 16:25:44 user nova-compute[70243]: </domain>
Jul 24 16:25:44 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.network.neutron [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Successfully created port: d441139a-506e-44b6-9bea-0825befacf40 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG nova.network.neutron [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.objects.instance [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'trusted_certs' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.146s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Cannot resize image /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.objects.instance [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'migration_context' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1592531500',display_name='tempest-AttachVolumeTestJSON-server-1592531500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1592531500',id=5,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyqJB6onbLaD2r1QfVtdarKDSnujLrUpKPczrv1sRKzUEbnqnXysxM1e2pVM0BKjCFI6X1To86Tx81MPL8yxdaUKlyWRVQ/8A7Y/aJ/EGuRxG0ZYo3tQwvjAcenmDrEEg==',key_name='tempest-keypair-810229109',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:18:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d099632b940545b9bbe000e5cc323ec1',ramdisk_id='',reservation_id='r-6lakmpdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1836925262',owner_user_name='tempest-AttachVolumeTestJSON-1836925262-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:23:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7de0cd9dd23d4569939884728bde772c',uuid=ad611655-ba4d-4a66-b78e-a82c058f4414,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converting VIF {"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d8:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef8e7d11-464b-421b-bfc9-0d5a17f610d4,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8e7d11-46') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG os_vif [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d8:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef8e7d11-464b-421b-bfc9-0d5a17f610d4,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8e7d11-46') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef8e7d11-46, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef8e7d11-46, col_values=(('external_ids', {'iface-id': 'ef8e7d11-464b-421b-bfc9-0d5a17f610d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:d8:8a', 'vm-uuid': 'ad611655-ba4d-4a66-b78e-a82c058f4414'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:45 user nova-compute[70243]: INFO os_vif [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d8:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef8e7d11-464b-421b-bfc9-0d5a17f610d4,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8e7d11-46')
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.network.neutron [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Updating instance_info_cache with network_info: [{"id": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "address": "fa:16:3e:d4:bf:cd", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a2f7cb-1b", "ovs_interfaceid": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Releasing lock "refresh_cache-6f2258de-6b31-48af-81df-37b64da4ca99" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.compute.manager [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Instance network_info: |[{"id": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "address": "fa:16:3e:d4:bf:cd", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a2f7cb-1b", "ovs_interfaceid": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c9c70aca-8a9d-459c-b564-30af19e853c8 req-74497bf5-c3b4-4f21-a39c-19e8959f9bea service nova] Acquired lock "refresh_cache-6f2258de-6b31-48af-81df-37b64da4ca99" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.network.neutron [req-c9c70aca-8a9d-459c-b564-30af19e853c8 req-74497bf5-c3b4-4f21-a39c-19e8959f9bea service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Refreshing network info cache for port 38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Start _get_guest_xml network_info=[{"id": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "address": "fa:16:3e:d4:bf:cd", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a2f7cb-1b", "ovs_interfaceid": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:45 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:25:45 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:25:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-394931060',display_name='tempest-ServerRescueNegativeTestJSON-server-394931060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-394931060',id=19,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c25474ae9fb49cb92c611e77f2dbc79',ramdisk_id='',reservation_id='r-s6khqx0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1414931075',owner_user_name='tempest-ServerRescueNegativeTestJSON-1414931075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:25:41Z,user_data=None,user_id='fcb7fb5c11bb4d65b9c39923840685c6',uuid=6f2258de-6b31-48af-81df-37b64da4ca99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "address": "fa:16:3e:d4:bf:cd", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a2f7cb-1b", "ovs_interfaceid": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converting VIF {"id": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "address": "fa:16:3e:d4:bf:cd", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a2f7cb-1b", "ovs_interfaceid": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:bf:cd,bridge_name='br-int',has_traffic_filtering=True,id=38a2f7cb-1b7b-48c1-8bb5-2ae805783d61,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a2f7cb-1b') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.objects.instance [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f2258de-6b31-48af-81df-37b64da4ca99 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:25:45 user nova-compute[70243]:   <uuid>6f2258de-6b31-48af-81df-37b64da4ca99</uuid>
Jul 24 16:25:45 user nova-compute[70243]:   <name>instance-00000013</name>
Jul 24 16:25:45 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:25:45 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:25:45 user nova-compute[70243]:   <metadata>
Jul 24 16:25:45 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:25:45 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:25:45 user nova-compute[70243]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-394931060</nova:name>
Jul 24 16:25:45 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:25:45</nova:creationTime>
Jul 24 16:25:45 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:25:45 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:25:45 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:25:45 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:25:45 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:25:45 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:25:45 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:25:45 user nova-compute[70243]:       <nova:owner>
Jul 24 16:25:45 user nova-compute[70243]:         <nova:user uuid="fcb7fb5c11bb4d65b9c39923840685c6">tempest-ServerRescueNegativeTestJSON-1414931075-project-member</nova:user>
Jul 24 16:25:45 user nova-compute[70243]:         <nova:project uuid="9c25474ae9fb49cb92c611e77f2dbc79">tempest-ServerRescueNegativeTestJSON-1414931075</nova:project>
Jul 24 16:25:45 user nova-compute[70243]:       </nova:owner>
Jul 24 16:25:45 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:25:45 user nova-compute[70243]:       <nova:ports>
Jul 24 16:25:45 user nova-compute[70243]:         <nova:port uuid="38a2f7cb-1b7b-48c1-8bb5-2ae805783d61">
Jul 24 16:25:45 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 24 16:25:45 user nova-compute[70243]:         </nova:port>
Jul 24 16:25:45 user nova-compute[70243]:       </nova:ports>
Jul 24 16:25:45 user nova-compute[70243]:     </nova:instance>
Jul 24 16:25:45 user nova-compute[70243]:   </metadata>
Jul 24 16:25:45 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:25:45 user nova-compute[70243]:     <system>
Jul 24 16:25:45 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:25:45 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:25:45 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:25:45 user nova-compute[70243]:       <entry name="serial">6f2258de-6b31-48af-81df-37b64da4ca99</entry>
Jul 24 16:25:45 user nova-compute[70243]:       <entry name="uuid">6f2258de-6b31-48af-81df-37b64da4ca99</entry>
Jul 24 16:25:45 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:25:45 user nova-compute[70243]:     </system>
Jul 24 16:25:45 user nova-compute[70243]:   </sysinfo>
Jul 24 16:25:45 user nova-compute[70243]:   <os>
Jul 24 16:25:45 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:25:45 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:25:45 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:25:45 user nova-compute[70243]:   </os>
Jul 24 16:25:45 user nova-compute[70243]:   <features>
Jul 24 16:25:45 user nova-compute[70243]:     <acpi/>
Jul 24 16:25:45 user nova-compute[70243]:     <apic/>
Jul 24 16:25:45 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:25:45 user nova-compute[70243]:   </features>
Jul 24 16:25:45 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:25:45 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:25:45 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:25:45 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:25:45 user nova-compute[70243]:   </clock>
Jul 24 16:25:45 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:25:45 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:25:45 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:25:45 user nova-compute[70243]:   </cpu>
Jul 24 16:25:45 user nova-compute[70243]:   <devices>
Jul 24 16:25:45 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:25:45 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:25:45 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk"/>
Jul 24 16:25:45 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:25:45 user nova-compute[70243]:     </disk>
Jul 24 16:25:45 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:25:45 user nova-compute[70243]:       <mac address="fa:16:3e:d4:bf:cd"/>
Jul 24 16:25:45 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:25:45 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:25:45 user nova-compute[70243]:       <target dev="tap38a2f7cb-1b"/>
Jul 24 16:25:45 user nova-compute[70243]:     </interface>
Jul 24 16:25:45 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:25:45 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/console.log" append="off"/>
Jul 24 16:25:45 user nova-compute[70243]:     </serial>
Jul 24 16:25:45 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:25:45 user nova-compute[70243]:     <video>
Jul 24 16:25:45 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:25:45 user nova-compute[70243]:     </video>
Jul 24 16:25:45 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:25:45 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:25:45 user nova-compute[70243]:     </rng>
Jul 24 16:25:45 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:25:45 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:25:45 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:25:45 user nova-compute[70243]:     </memballoon>
Jul 24 16:25:45 user nova-compute[70243]:   </devices>
Jul 24 16:25:45 user nova-compute[70243]: </domain>
Jul 24 16:25:45 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:25:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-394931060',display_name='tempest-ServerRescueNegativeTestJSON-server-394931060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-394931060',id=19,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c25474ae9fb49cb92c611e77f2dbc79',ramdisk_id='',reservation_id='r-s6khqx0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1414931075',owner_user_name='tempest-ServerRescueNegativeTestJSON-1414931075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:25:41Z,user_data=None,user_id='fcb7fb5c11bb4d65b9c39923840685c6',uuid=6f2258de-6b31-48af-81df-37b64da4ca99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "address": "fa:16:3e:d4:bf:cd", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a2f7cb-1b", "ovs_interfaceid": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converting VIF {"id": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "address": "fa:16:3e:d4:bf:cd", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a2f7cb-1b", "ovs_interfaceid": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:bf:cd,bridge_name='br-int',has_traffic_filtering=True,id=38a2f7cb-1b7b-48c1-8bb5-2ae805783d61,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a2f7cb-1b') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG os_vif [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:bf:cd,bridge_name='br-int',has_traffic_filtering=True,id=38a2f7cb-1b7b-48c1-8bb5-2ae805783d61,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a2f7cb-1b') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38a2f7cb-1b, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap38a2f7cb-1b, col_values=(('external_ids', {'iface-id': '38a2f7cb-1b7b-48c1-8bb5-2ae805783d61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:bf:cd', 'vm-uuid': '6f2258de-6b31-48af-81df-37b64da4ca99'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:45 user nova-compute[70243]: INFO os_vif [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:bf:cd,bridge_name='br-int',has_traffic_filtering=True,id=38a2f7cb-1b7b-48c1-8bb5-2ae805783d61,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a2f7cb-1b')
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:25:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] No VIF found with MAC fa:16:3e:d4:bf:cd, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG nova.compute.manager [req-6c913a17-c4e8-4832-96c2-476a9d00e0cd req-30332045-befe-46a1-a338-6d77292eaeab service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received event network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6c913a17-c4e8-4832-96c2-476a9d00e0cd req-30332045-befe-46a1-a338-6d77292eaeab service nova] Acquiring lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6c913a17-c4e8-4832-96c2-476a9d00e0cd req-30332045-befe-46a1-a338-6d77292eaeab service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6c913a17-c4e8-4832-96c2-476a9d00e0cd req-30332045-befe-46a1-a338-6d77292eaeab service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG nova.compute.manager [req-6c913a17-c4e8-4832-96c2-476a9d00e0cd req-30332045-befe-46a1-a338-6d77292eaeab service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] No waiting events found dispatching network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:25:46 user nova-compute[70243]: WARNING nova.compute.manager [req-6c913a17-c4e8-4832-96c2-476a9d00e0cd req-30332045-befe-46a1-a338-6d77292eaeab service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received unexpected event network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 for instance with vm_state building and task_state spawning.
Jul 24 16:25:46 user nova-compute[70243]: DEBUG nova.compute.manager [req-6c913a17-c4e8-4832-96c2-476a9d00e0cd req-30332045-befe-46a1-a338-6d77292eaeab service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received event network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6c913a17-c4e8-4832-96c2-476a9d00e0cd req-30332045-befe-46a1-a338-6d77292eaeab service nova] Acquiring lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6c913a17-c4e8-4832-96c2-476a9d00e0cd req-30332045-befe-46a1-a338-6d77292eaeab service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6c913a17-c4e8-4832-96c2-476a9d00e0cd req-30332045-befe-46a1-a338-6d77292eaeab service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG nova.compute.manager [req-6c913a17-c4e8-4832-96c2-476a9d00e0cd req-30332045-befe-46a1-a338-6d77292eaeab service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] No waiting events found dispatching network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:25:46 user nova-compute[70243]: WARNING nova.compute.manager [req-6c913a17-c4e8-4832-96c2-476a9d00e0cd req-30332045-befe-46a1-a338-6d77292eaeab service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received unexpected event network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 for instance with vm_state building and task_state spawning.
Jul 24 16:25:46 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Skipping network cache update for instance because it is Building. {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9835}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Skipping network cache update for instance because it is Building. {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9835}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Skipping network cache update for instance because it is Building. {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9835}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-de22ea98-b041-4f3f-8986-435c43267a2e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-de22ea98-b041-4f3f-8986-435c43267a2e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lazy-loading 'info_cache' on Instance uuid de22ea98-b041-4f3f-8986-435c43267a2e {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG nova.network.neutron [req-c9c70aca-8a9d-459c-b564-30af19e853c8 req-74497bf5-c3b4-4f21-a39c-19e8959f9bea service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Updated VIF entry in instance network info cache for port 38a2f7cb-1b7b-48c1-8bb5-2ae805783d61. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG nova.network.neutron [req-c9c70aca-8a9d-459c-b564-30af19e853c8 req-74497bf5-c3b4-4f21-a39c-19e8959f9bea service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Updating instance_info_cache with network_info: [{"id": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "address": "fa:16:3e:d4:bf:cd", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a2f7cb-1b", "ovs_interfaceid": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c9c70aca-8a9d-459c-b564-30af19e853c8 req-74497bf5-c3b4-4f21-a39c-19e8959f9bea service nova] Releasing lock "refresh_cache-6f2258de-6b31-48af-81df-37b64da4ca99" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG nova.network.neutron [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Successfully updated port: d441139a-506e-44b6-9bea-0825befacf40 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Acquiring lock "refresh_cache-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Acquired lock "refresh_cache-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG nova.network.neutron [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG nova.network.neutron [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG nova.compute.manager [req-0b4edeb2-f38d-4bb8-8f64-d20319b28031 req-05a42b86-5308-427d-bed8-c8a97da3e746 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Received event network-changed-d441139a-506e-44b6-9bea-0825befacf40 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG nova.compute.manager [req-0b4edeb2-f38d-4bb8-8f64-d20319b28031 req-05a42b86-5308-427d-bed8-c8a97da3e746 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Refreshing instance network info cache due to event network-changed-d441139a-506e-44b6-9bea-0825befacf40. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0b4edeb2-f38d-4bb8-8f64-d20319b28031 req-05a42b86-5308-427d-bed8-c8a97da3e746 service nova] Acquiring lock "refresh_cache-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:25:46 user nova-compute[70243]: DEBUG nova.network.neutron [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Updating instance_info_cache with network_info: [{"id": "d441139a-506e-44b6-9bea-0825befacf40", "address": "fa:16:3e:61:2d:32", "network": {"id": "99dd3690-f380-4199-b2cd-a871694533f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1380968726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd441139a-50", "ovs_interfaceid": "d441139a-506e-44b6-9bea-0825befacf40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Releasing lock "refresh_cache-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Instance network_info: |[{"id": "d441139a-506e-44b6-9bea-0825befacf40", "address": "fa:16:3e:61:2d:32", "network": {"id": "99dd3690-f380-4199-b2cd-a871694533f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1380968726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd441139a-50", "ovs_interfaceid": "d441139a-506e-44b6-9bea-0825befacf40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0b4edeb2-f38d-4bb8-8f64-d20319b28031 req-05a42b86-5308-427d-bed8-c8a97da3e746 service nova] Acquired lock "refresh_cache-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.network.neutron [req-0b4edeb2-f38d-4bb8-8f64-d20319b28031 req-05a42b86-5308-427d-bed8-c8a97da3e746 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Refreshing network info cache for port d441139a-506e-44b6-9bea-0825befacf40 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Start _get_guest_xml network_info=[{"id": "d441139a-506e-44b6-9bea-0825befacf40", "address": "fa:16:3e:61:2d:32", "network": {"id": "99dd3690-f380-4199-b2cd-a871694533f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1380968726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd441139a-50", "ovs_interfaceid": "d441139a-506e-44b6-9bea-0825befacf40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:25:47 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:25:47 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:25:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-305165087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-305165087',id=20,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqr4Sb1YiAbSsHxY/YCQVoIvx0BtmisaU3JoqCzarQMjncCNKMWQUfzzjinb/WTtTYj0jaZsWe6GxxviHHKByoit7MC06BJwyYNp7QiEzsbdQ26xq1MPIO2FeXV/7igXw==',key_name='tempest-keypair-751084804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21d8ae9e361c4588ac564ac242dcab21',ramdisk_id='',reservation_id='r-kztppkde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-130428048',owner_user_name='tempest-TaggedAttachmentsTest-130428048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:25:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='695787042f9f4e4eb0997bf72d169913',uuid=9e4e0f20-5488-44ce-ac82-e0e77b8a3e30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d441139a-506e-44b6-9bea-0825befacf40", "address": "fa:16:3e:61:2d:32", "network": {"id": "99dd3690-f380-4199-b2cd-a871694533f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1380968726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd441139a-50", "ovs_interfaceid": "d441139a-506e-44b6-9bea-0825befacf40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Converting VIF {"id": "d441139a-506e-44b6-9bea-0825befacf40", "address": "fa:16:3e:61:2d:32", "network": {"id": "99dd3690-f380-4199-b2cd-a871694533f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1380968726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd441139a-50", "ovs_interfaceid": "d441139a-506e-44b6-9bea-0825befacf40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:2d:32,bridge_name='br-int',has_traffic_filtering=True,id=d441139a-506e-44b6-9bea-0825befacf40,network=Network(99dd3690-f380-4199-b2cd-a871694533f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd441139a-50') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.objects.instance [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:25:47 user nova-compute[70243]:   <uuid>9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</uuid>
Jul 24 16:25:47 user nova-compute[70243]:   <name>instance-00000014</name>
Jul 24 16:25:47 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:25:47 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:25:47 user nova-compute[70243]:   <metadata>
Jul 24 16:25:47 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:25:47 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:25:47 user nova-compute[70243]:       <nova:name>tempest-device-tagging-server-305165087</nova:name>
Jul 24 16:25:47 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:25:47</nova:creationTime>
Jul 24 16:25:47 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:25:47 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:25:47 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:25:47 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:25:47 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:25:47 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:25:47 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:25:47 user nova-compute[70243]:       <nova:owner>
Jul 24 16:25:47 user nova-compute[70243]:         <nova:user uuid="695787042f9f4e4eb0997bf72d169913">tempest-TaggedAttachmentsTest-130428048-project-member</nova:user>
Jul 24 16:25:47 user nova-compute[70243]:         <nova:project uuid="21d8ae9e361c4588ac564ac242dcab21">tempest-TaggedAttachmentsTest-130428048</nova:project>
Jul 24 16:25:47 user nova-compute[70243]:       </nova:owner>
Jul 24 16:25:47 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:25:47 user nova-compute[70243]:       <nova:ports>
Jul 24 16:25:47 user nova-compute[70243]:         <nova:port uuid="d441139a-506e-44b6-9bea-0825befacf40">
Jul 24 16:25:47 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 24 16:25:47 user nova-compute[70243]:         </nova:port>
Jul 24 16:25:47 user nova-compute[70243]:       </nova:ports>
Jul 24 16:25:47 user nova-compute[70243]:     </nova:instance>
Jul 24 16:25:47 user nova-compute[70243]:   </metadata>
Jul 24 16:25:47 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:25:47 user nova-compute[70243]:     <system>
Jul 24 16:25:47 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:25:47 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:25:47 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:25:47 user nova-compute[70243]:       <entry name="serial">9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</entry>
Jul 24 16:25:47 user nova-compute[70243]:       <entry name="uuid">9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</entry>
Jul 24 16:25:47 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:25:47 user nova-compute[70243]:     </system>
Jul 24 16:25:47 user nova-compute[70243]:   </sysinfo>
Jul 24 16:25:47 user nova-compute[70243]:   <os>
Jul 24 16:25:47 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:25:47 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:25:47 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:25:47 user nova-compute[70243]:   </os>
Jul 24 16:25:47 user nova-compute[70243]:   <features>
Jul 24 16:25:47 user nova-compute[70243]:     <acpi/>
Jul 24 16:25:47 user nova-compute[70243]:     <apic/>
Jul 24 16:25:47 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:25:47 user nova-compute[70243]:   </features>
Jul 24 16:25:47 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:25:47 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:25:47 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:25:47 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:25:47 user nova-compute[70243]:   </clock>
Jul 24 16:25:47 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:25:47 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:25:47 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:25:47 user nova-compute[70243]:   </cpu>
Jul 24 16:25:47 user nova-compute[70243]:   <devices>
Jul 24 16:25:47 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:25:47 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:25:47 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk"/>
Jul 24 16:25:47 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:25:47 user nova-compute[70243]:     </disk>
Jul 24 16:25:47 user nova-compute[70243]:     <disk type="file" device="cdrom">
Jul 24 16:25:47 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none"/>
Jul 24 16:25:47 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk.config"/>
Jul 24 16:25:47 user nova-compute[70243]:       <target dev="hda" bus="ide"/>
Jul 24 16:25:47 user nova-compute[70243]:     </disk>
Jul 24 16:25:47 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:25:47 user nova-compute[70243]:       <mac address="fa:16:3e:61:2d:32"/>
Jul 24 16:25:47 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:25:47 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:25:47 user nova-compute[70243]:       <target dev="tapd441139a-50"/>
Jul 24 16:25:47 user nova-compute[70243]:     </interface>
Jul 24 16:25:47 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:25:47 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/console.log" append="off"/>
Jul 24 16:25:47 user nova-compute[70243]:     </serial>
Jul 24 16:25:47 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:25:47 user nova-compute[70243]:     <video>
Jul 24 16:25:47 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:25:47 user nova-compute[70243]:     </video>
Jul 24 16:25:47 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:25:47 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:25:47 user nova-compute[70243]:     </rng>
Jul 24 16:25:47 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:25:47 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:25:47 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:25:47 user nova-compute[70243]:     </memballoon>
Jul 24 16:25:47 user nova-compute[70243]:   </devices>
Jul 24 16:25:47 user nova-compute[70243]: </domain>
Jul 24 16:25:47 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:25:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-305165087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-305165087',id=20,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqr4Sb1YiAbSsHxY/YCQVoIvx0BtmisaU3JoqCzarQMjncCNKMWQUfzzjinb/WTtTYj0jaZsWe6GxxviHHKByoit7MC06BJwyYNp7QiEzsbdQ26xq1MPIO2FeXV/7igXw==',key_name='tempest-keypair-751084804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21d8ae9e361c4588ac564ac242dcab21',ramdisk_id='',reservation_id='r-kztppkde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-130428048',owner_user_name='tempest-TaggedAttachmentsTest-130428048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:25:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='695787042f9f4e4eb0997bf72d169913',uuid=9e4e0f20-5488-44ce-ac82-e0e77b8a3e30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d441139a-506e-44b6-9bea-0825befacf40", "address": "fa:16:3e:61:2d:32", "network": {"id": "99dd3690-f380-4199-b2cd-a871694533f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1380968726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd441139a-50", "ovs_interfaceid": "d441139a-506e-44b6-9bea-0825befacf40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Converting VIF {"id": "d441139a-506e-44b6-9bea-0825befacf40", "address": "fa:16:3e:61:2d:32", "network": {"id": "99dd3690-f380-4199-b2cd-a871694533f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1380968726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd441139a-50", "ovs_interfaceid": "d441139a-506e-44b6-9bea-0825befacf40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:2d:32,bridge_name='br-int',has_traffic_filtering=True,id=d441139a-506e-44b6-9bea-0825befacf40,network=Network(99dd3690-f380-4199-b2cd-a871694533f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd441139a-50') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG os_vif [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:2d:32,bridge_name='br-int',has_traffic_filtering=True,id=d441139a-506e-44b6-9bea-0825befacf40,network=Network(99dd3690-f380-4199-b2cd-a871694533f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd441139a-50') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd441139a-50, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd441139a-50, col_values=(('external_ids', {'iface-id': 'd441139a-506e-44b6-9bea-0825befacf40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:2d:32', 'vm-uuid': '9e4e0f20-5488-44ce-ac82-e0e77b8a3e30'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:47 user nova-compute[70243]: INFO os_vif [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:2d:32,bridge_name='br-int',has_traffic_filtering=True,id=d441139a-506e-44b6-9bea-0825befacf40,network=Network(99dd3690-f380-4199-b2cd-a871694533f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd441139a-50')
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Updating instance_info_cache with network_info: [{"id": "e709e269-eff5-4ac2-8c2a-29048448a422", "address": "fa:16:3e:0a:84:99", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape709e269-ef", "ovs_interfaceid": "e709e269-eff5-4ac2-8c2a-29048448a422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-de22ea98-b041-4f3f-8986-435c43267a2e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215947.1724916, 50fecb3a-8f06-4822-8c84-76df51acfe50 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:25:47 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] VM Resumed (Lifecycle Event)
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] No BDM found with device name hda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] No VIF found with MAC fa:16:3e:61:2d:32, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:25:47 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Using config drive
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:25:47 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Instance spawned successfully.
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:47 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215947.1738276, 50fecb3a-8f06-4822-8c84-76df51acfe50 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:25:47 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] VM Started (Lifecycle Event)
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:25:47 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:25:47 user nova-compute[70243]: INFO nova.compute.manager [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Took 6.76 seconds to spawn the instance on the hypervisor.
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:25:47 user nova-compute[70243]: INFO nova.compute.manager [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Took 7.54 seconds to build instance.
Jul 24 16:25:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eb1eb9b9-1540-45cc-afd9-537bc7747335 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.664s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:47 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Creating config drive at /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk.config
Jul 24 16:25:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwka1h0yo {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwka1h0yo" returned: 0 in 0.056s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.network.neutron [req-0b4edeb2-f38d-4bb8-8f64-d20319b28031 req-05a42b86-5308-427d-bed8-c8a97da3e746 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Updated VIF entry in instance network info cache for port d441139a-506e-44b6-9bea-0825befacf40. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG nova.network.neutron [req-0b4edeb2-f38d-4bb8-8f64-d20319b28031 req-05a42b86-5308-427d-bed8-c8a97da3e746 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Updating instance_info_cache with network_info: [{"id": "d441139a-506e-44b6-9bea-0825befacf40", "address": "fa:16:3e:61:2d:32", "network": {"id": "99dd3690-f380-4199-b2cd-a871694533f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1380968726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd441139a-50", "ovs_interfaceid": "d441139a-506e-44b6-9bea-0825befacf40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0b4edeb2-f38d-4bb8-8f64-d20319b28031 req-05a42b86-5308-427d-bed8-c8a97da3e746 service nova] Releasing lock "refresh_cache-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:48 user nova-compute[70243]: DEBUG nova.compute.manager [req-ffea5531-8c0b-49bd-aaa1-466b7d7bcaff req-2500c95b-e620-4a98-bc1a-ec57c5d8ab53 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received event network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ffea5531-8c0b-49bd-aaa1-466b7d7bcaff req-2500c95b-e620-4a98-bc1a-ec57c5d8ab53 service nova] Acquiring lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ffea5531-8c0b-49bd-aaa1-466b7d7bcaff req-2500c95b-e620-4a98-bc1a-ec57c5d8ab53 service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ffea5531-8c0b-49bd-aaa1-466b7d7bcaff req-2500c95b-e620-4a98-bc1a-ec57c5d8ab53 service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:48 user nova-compute[70243]: DEBUG nova.compute.manager [req-ffea5531-8c0b-49bd-aaa1-466b7d7bcaff req-2500c95b-e620-4a98-bc1a-ec57c5d8ab53 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] No waiting events found dispatching network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:25:48 user nova-compute[70243]: WARNING nova.compute.manager [req-ffea5531-8c0b-49bd-aaa1-466b7d7bcaff req-2500c95b-e620-4a98-bc1a-ec57c5d8ab53 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received unexpected event network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 for instance with vm_state stopped and task_state powering-on.
Jul 24 16:25:48 user nova-compute[70243]: DEBUG nova.compute.manager [req-ffea5531-8c0b-49bd-aaa1-466b7d7bcaff req-2500c95b-e620-4a98-bc1a-ec57c5d8ab53 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received event network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ffea5531-8c0b-49bd-aaa1-466b7d7bcaff req-2500c95b-e620-4a98-bc1a-ec57c5d8ab53 service nova] Acquiring lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ffea5531-8c0b-49bd-aaa1-466b7d7bcaff req-2500c95b-e620-4a98-bc1a-ec57c5d8ab53 service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ffea5531-8c0b-49bd-aaa1-466b7d7bcaff req-2500c95b-e620-4a98-bc1a-ec57c5d8ab53 service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:48 user nova-compute[70243]: DEBUG nova.compute.manager [req-ffea5531-8c0b-49bd-aaa1-466b7d7bcaff req-2500c95b-e620-4a98-bc1a-ec57c5d8ab53 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] No waiting events found dispatching network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:25:48 user nova-compute[70243]: WARNING nova.compute.manager [req-ffea5531-8c0b-49bd-aaa1-466b7d7bcaff req-2500c95b-e620-4a98-bc1a-ec57c5d8ab53 service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received unexpected event network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 for instance with vm_state stopped and task_state powering-on.
Jul 24 16:25:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquiring lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquiring lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:49 user nova-compute[70243]: INFO nova.compute.manager [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Terminating instance
Jul 24 16:25:49 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:25:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:49 user nova-compute[70243]: DEBUG nova.compute.manager [req-4313d734-1066-48d9-8f1b-83ab8f62d18d req-459d3ee2-044f-48a5-a705-f47345d593c0 service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Received event network-vif-plugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4313d734-1066-48d9-8f1b-83ab8f62d18d req-459d3ee2-044f-48a5-a705-f47345d593c0 service nova] Acquiring lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4313d734-1066-48d9-8f1b-83ab8f62d18d req-459d3ee2-044f-48a5-a705-f47345d593c0 service nova] Lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4313d734-1066-48d9-8f1b-83ab8f62d18d req-459d3ee2-044f-48a5-a705-f47345d593c0 service nova] Lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:49 user nova-compute[70243]: DEBUG nova.compute.manager [req-4313d734-1066-48d9-8f1b-83ab8f62d18d req-459d3ee2-044f-48a5-a705-f47345d593c0 service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] No waiting events found dispatching network-vif-plugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:25:49 user nova-compute[70243]: WARNING nova.compute.manager [req-4313d734-1066-48d9-8f1b-83ab8f62d18d req-459d3ee2-044f-48a5-a705-f47345d593c0 service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Received unexpected event network-vif-plugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 for instance with vm_state building and task_state spawning.
Jul 24 16:25:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG nova.compute.manager [req-ec8d59ae-5d3f-4dfc-840f-dfff96210776 req-d65cd656-85a2-41a9-9d3e-a4af9358cafb service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Received event network-vif-plugged-d441139a-506e-44b6-9bea-0825befacf40 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ec8d59ae-5d3f-4dfc-840f-dfff96210776 req-d65cd656-85a2-41a9-9d3e-a4af9358cafb service nova] Acquiring lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ec8d59ae-5d3f-4dfc-840f-dfff96210776 req-d65cd656-85a2-41a9-9d3e-a4af9358cafb service nova] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ec8d59ae-5d3f-4dfc-840f-dfff96210776 req-d65cd656-85a2-41a9-9d3e-a4af9358cafb service nova] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG nova.compute.manager [req-ec8d59ae-5d3f-4dfc-840f-dfff96210776 req-d65cd656-85a2-41a9-9d3e-a4af9358cafb service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] No waiting events found dispatching network-vif-plugged-d441139a-506e-44b6-9bea-0825befacf40 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:25:50 user nova-compute[70243]: WARNING nova.compute.manager [req-ec8d59ae-5d3f-4dfc-840f-dfff96210776 req-d65cd656-85a2-41a9-9d3e-a4af9358cafb service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Received unexpected event network-vif-plugged-d441139a-506e-44b6-9bea-0825befacf40 for instance with vm_state building and task_state spawning.
Jul 24 16:25:50 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Instance destroyed successfully.
Jul 24 16:25:50 user nova-compute[70243]: DEBUG nova.objects.instance [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lazy-loading 'resources' on Instance uuid a13c243a-2b98-4ef1-b17c-e2e15ba005fd {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2052048387',display_name='tempest-ServerStableDeviceRescueTest-server-2052048387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2052048387',id=4,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxyg7GKQZgiFcqgBrRCAKYhBgpz6QF7p7ruGhqH37zaYL25ozkQKcEfngpDlxwde/ZCtd+vcFLzRscQnyUxcajhFeR/MGJHm2Mv330WuzoMeAS6WZFsRGOHNqib8c36Bw==',key_name='tempest-keypair-258761738',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:22:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c70a6d9bf46466da48267f2fc2e02d6',ramdisk_id='',reservation_id='r-yozkpi2d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1068915189',owner_user_name='tempest-ServerStableDeviceRescueTest-1068915189-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:23:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afda4138db34a6c95e974a5814ea26a',uuid=a13c243a-2b98-4ef1-b17c-e2e15ba005fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "address": "fa:16:3e:92:8d:42", "network": {"id": "69c0285e-5c28-41c5-893d-9d92e9626cb2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808448879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c70a6d9bf46466da48267f2fc2e02d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2943f763-29", "ovs_interfaceid": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Converting VIF {"id": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "address": "fa:16:3e:92:8d:42", "network": {"id": "69c0285e-5c28-41c5-893d-9d92e9626cb2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808448879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c70a6d9bf46466da48267f2fc2e02d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2943f763-29", "ovs_interfaceid": "2943f763-290c-46a8-90cf-f0e6b59a2be4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8d:42,bridge_name='br-int',has_traffic_filtering=True,id=2943f763-290c-46a8-90cf-f0e6b59a2be4,network=Network(69c0285e-5c28-41c5-893d-9d92e9626cb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2943f763-29') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG os_vif [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8d:42,bridge_name='br-int',has_traffic_filtering=True,id=2943f763-290c-46a8-90cf-f0e6b59a2be4,network=Network(69c0285e-5c28-41c5-893d-9d92e9626cb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2943f763-29') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2943f763-29, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:50 user nova-compute[70243]: INFO os_vif [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8d:42,bridge_name='br-int',has_traffic_filtering=True,id=2943f763-290c-46a8-90cf-f0e6b59a2be4,network=Network(69c0285e-5c28-41c5-893d-9d92e9626cb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2943f763-29')
Jul 24 16:25:50 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Deleting instance files /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd_del
Jul 24 16:25:50 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Deletion of /opt/stack/data/nova/instances/a13c243a-2b98-4ef1-b17c-e2e15ba005fd_del complete
Jul 24 16:25:50 user nova-compute[70243]: DEBUG nova.compute.manager [req-73d944ca-5cdf-4f0e-a09b-48221b2c3c72 req-1fff34d2-1327-4a89-9919-45fd38e6825d service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received event network-vif-unplugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-73d944ca-5cdf-4f0e-a09b-48221b2c3c72 req-1fff34d2-1327-4a89-9919-45fd38e6825d service nova] Acquiring lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-73d944ca-5cdf-4f0e-a09b-48221b2c3c72 req-1fff34d2-1327-4a89-9919-45fd38e6825d service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-73d944ca-5cdf-4f0e-a09b-48221b2c3c72 req-1fff34d2-1327-4a89-9919-45fd38e6825d service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG nova.compute.manager [req-73d944ca-5cdf-4f0e-a09b-48221b2c3c72 req-1fff34d2-1327-4a89-9919-45fd38e6825d service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] No waiting events found dispatching network-vif-unplugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG nova.compute.manager [req-73d944ca-5cdf-4f0e-a09b-48221b2c3c72 req-1fff34d2-1327-4a89-9919-45fd38e6825d service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received event network-vif-unplugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG nova.compute.manager [req-73d944ca-5cdf-4f0e-a09b-48221b2c3c72 req-1fff34d2-1327-4a89-9919-45fd38e6825d service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received event network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-73d944ca-5cdf-4f0e-a09b-48221b2c3c72 req-1fff34d2-1327-4a89-9919-45fd38e6825d service nova] Acquiring lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-73d944ca-5cdf-4f0e-a09b-48221b2c3c72 req-1fff34d2-1327-4a89-9919-45fd38e6825d service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-73d944ca-5cdf-4f0e-a09b-48221b2c3c72 req-1fff34d2-1327-4a89-9919-45fd38e6825d service nova] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG nova.compute.manager [req-73d944ca-5cdf-4f0e-a09b-48221b2c3c72 req-1fff34d2-1327-4a89-9919-45fd38e6825d service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] No waiting events found dispatching network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:25:50 user nova-compute[70243]: WARNING nova.compute.manager [req-73d944ca-5cdf-4f0e-a09b-48221b2c3c72 req-1fff34d2-1327-4a89-9919-45fd38e6825d service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received unexpected event network-vif-plugged-2943f763-290c-46a8-90cf-f0e6b59a2be4 for instance with vm_state active and task_state deleting.
Jul 24 16:25:50 user nova-compute[70243]: INFO nova.compute.manager [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Took 1.90 seconds to destroy the instance on the hypervisor.
Jul 24 16:25:50 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:25:50 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:25:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:51 user nova-compute[70243]: DEBUG nova.compute.manager [req-d0bc008f-ee26-4f4e-aafa-3d1d7041357e req-8f0edb7d-7526-4ed7-9a97-3a748ba67423 service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Received event network-vif-plugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d0bc008f-ee26-4f4e-aafa-3d1d7041357e req-8f0edb7d-7526-4ed7-9a97-3a748ba67423 service nova] Acquiring lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d0bc008f-ee26-4f4e-aafa-3d1d7041357e req-8f0edb7d-7526-4ed7-9a97-3a748ba67423 service nova] Lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d0bc008f-ee26-4f4e-aafa-3d1d7041357e req-8f0edb7d-7526-4ed7-9a97-3a748ba67423 service nova] Lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:51 user nova-compute[70243]: DEBUG nova.compute.manager [req-d0bc008f-ee26-4f4e-aafa-3d1d7041357e req-8f0edb7d-7526-4ed7-9a97-3a748ba67423 service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] No waiting events found dispatching network-vif-plugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:25:51 user nova-compute[70243]: WARNING nova.compute.manager [req-d0bc008f-ee26-4f4e-aafa-3d1d7041357e req-8f0edb7d-7526-4ed7-9a97-3a748ba67423 service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Received unexpected event network-vif-plugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 for instance with vm_state building and task_state spawning.
Jul 24 16:25:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:52 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Error from libvirt while getting description of instance-00000004: [Error Code 42] Domain not found: no domain with matching uuid 'a13c243a-2b98-4ef1-b17c-e2e15ba005fd' (instance-00000004): libvirt.libvirtError: Domain not found: no domain with matching uuid 'a13c243a-2b98-4ef1-b17c-e2e15ba005fd' (instance-00000004)
Jul 24 16:25:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:25:52 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Took 1.24 seconds to deallocate network for instance.
Jul 24 16:25:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.compute.manager [req-af7faa8c-621d-4c85-89fc-02941c319e9c req-b5c426a0-78b8-49ba-9904-91fd9337d1c1 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Received event network-vif-plugged-d441139a-506e-44b6-9bea-0825befacf40 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-af7faa8c-621d-4c85-89fc-02941c319e9c req-b5c426a0-78b8-49ba-9904-91fd9337d1c1 service nova] Acquiring lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-af7faa8c-621d-4c85-89fc-02941c319e9c req-b5c426a0-78b8-49ba-9904-91fd9337d1c1 service nova] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-af7faa8c-621d-4c85-89fc-02941c319e9c req-b5c426a0-78b8-49ba-9904-91fd9337d1c1 service nova] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.compute.manager [req-af7faa8c-621d-4c85-89fc-02941c319e9c req-b5c426a0-78b8-49ba-9904-91fd9337d1c1 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] No waiting events found dispatching network-vif-plugged-d441139a-506e-44b6-9bea-0825befacf40 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:25:52 user nova-compute[70243]: WARNING nova.compute.manager [req-af7faa8c-621d-4c85-89fc-02941c319e9c req-b5c426a0-78b8-49ba-9904-91fd9337d1c1 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Received unexpected event network-vif-plugged-d441139a-506e-44b6-9bea-0825befacf40 for instance with vm_state building and task_state spawning.
Jul 24 16:25:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215952.712673, ad611655-ba4d-4a66-b78e-a82c058f4414 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:25:52 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] VM Resumed (Lifecycle Event)
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.compute.manager [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:25:52 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Instance rebooted successfully.
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.compute.manager [None req-17320b21-2145-4d01-b1e1-323e6951b1d6 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:52 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215952.7210658, ad611655-ba4d-4a66-b78e-a82c058f4414 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:25:52 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] VM Started (Lifecycle Event)
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.compute.manager [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:25:52 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Instance spawned successfully.
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215952.7801516, 6f2258de-6b31-48af-81df-37b64da4ca99 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:25:52 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] VM Resumed (Lifecycle Event)
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:25:52 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Instance spawned successfully.
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.compute.manager [req-c8acf066-1248-45d2-8fce-0698c1e5df81 req-25dafa60-2c59-48d2-a376-6ff0b42f6587 service nova] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Received event network-vif-deleted-2943f763-290c-46a8-90cf-f0e6b59a2be4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:25:52 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:25:53 user nova-compute[70243]: INFO nova.compute.manager [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Took 11.48 seconds to spawn the instance on the hypervisor.
Jul 24 16:25:53 user nova-compute[70243]: DEBUG nova.compute.manager [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.707s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:25:53 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:25:53 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215952.780886, 6f2258de-6b31-48af-81df-37b64da4ca99 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:25:53 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] VM Started (Lifecycle Event)
Jul 24 16:25:53 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Deleted allocations for instance a13c243a-2b98-4ef1-b17c-e2e15ba005fd
Jul 24 16:25:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:25:53 user nova-compute[70243]: INFO nova.compute.manager [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Took 10.66 seconds to spawn the instance on the hypervisor.
Jul 24 16:25:53 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e92b1629-7011-4639-b5c8-b77c8578ad70 tempest-ServerStableDeviceRescueTest-1068915189 tempest-ServerStableDeviceRescueTest-1068915189-project-member] Lock "a13c243a-2b98-4ef1-b17c-e2e15ba005fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.152s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215952.9258673, 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:25:53 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] VM Resumed (Lifecycle Event)
Jul 24 16:25:53 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:25:53 user nova-compute[70243]: INFO nova.compute.manager [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Took 12.66 seconds to build instance.
Jul 24 16:25:53 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:25:53 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690215952.927193, 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:25:53 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] VM Started (Lifecycle Event)
Jul 24 16:25:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8d5298d2-229b-4311-92aa-380c7fb104ba tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "6f2258de-6b31-48af-81df-37b64da4ca99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.827s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:25:53 user nova-compute[70243]: INFO nova.compute.manager [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Took 11.86 seconds to build instance.
Jul 24 16:25:53 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f30a4e6a-da24-42dd-9a66-c2faec5c4de4 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.961s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:25:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:25:54 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:25:54 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:25:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=7945MB free_disk=24.311668395996094GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:25:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:25:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:25:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance de22ea98-b041-4f3f-8986-435c43267a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:25:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance ad611655-ba4d-4a66-b78e-a82c058f4414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:25:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance b0dd6065-3916-4f0e-841e-3df5ded2e2ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:25:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5f70528b-33db-4257-96fe-e5fad869a224 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:25:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:25:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 50fecb3a-8f06-4822-8c84-76df51acfe50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:25:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6f2258de-6b31-48af-81df-37b64da4ca99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:25:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:25:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:25:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:25:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:54 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:25:54 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:25:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:25:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.538s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:25:55 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:25:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:25:57 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690215942.5978553, 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:25:57 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] VM Stopped (Lifecycle Event)
Jul 24 16:25:57 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ce1f15e5-e220-492e-aa59-1b3b264f07ee None None] [instance: 66147ca4-6c90-4ed8-b6f4-6437d0e8c38b] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:25:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:05 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690215950.803988, a13c243a-2b98-4ef1-b17c-e2e15ba005fd => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:26:05 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] VM Stopped (Lifecycle Event)
Jul 24 16:26:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:05 user nova-compute[70243]: DEBUG nova.compute.manager [None req-a998e901-5db8-49e7-b91b-41d73e041dba None None] [instance: a13c243a-2b98-4ef1-b17c-e2e15ba005fd] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:26:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:26:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:26:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:26:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:26:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:26:20 user nova-compute[70243]: INFO nova.compute.manager [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Terminating instance
Jul 24 16:26:20 user nova-compute[70243]: DEBUG nova.compute.manager [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:26:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-4353f2f2-2560-493c-814c-9051f7814ffb req-beb28b4c-ac39-4ef0-9292-cd918ae8d2c1 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received event network-vif-unplugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:26:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4353f2f2-2560-493c-814c-9051f7814ffb req-beb28b4c-ac39-4ef0-9292-cd918ae8d2c1 service nova] Acquiring lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:26:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4353f2f2-2560-493c-814c-9051f7814ffb req-beb28b4c-ac39-4ef0-9292-cd918ae8d2c1 service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:26:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4353f2f2-2560-493c-814c-9051f7814ffb req-beb28b4c-ac39-4ef0-9292-cd918ae8d2c1 service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:26:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-4353f2f2-2560-493c-814c-9051f7814ffb req-beb28b4c-ac39-4ef0-9292-cd918ae8d2c1 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] No waiting events found dispatching network-vif-unplugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:26:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-4353f2f2-2560-493c-814c-9051f7814ffb req-beb28b4c-ac39-4ef0-9292-cd918ae8d2c1 service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received event network-vif-unplugged-809292ba-1131-47d4-8b1c-b7cef6888d76 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:26:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:21 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Instance destroyed successfully.
Jul 24 16:26:21 user nova-compute[70243]: DEBUG nova.objects.instance [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lazy-loading 'resources' on Instance uuid b0dd6065-3916-4f0e-841e-3df5ded2e2ee {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:26:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:21:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1754472195',display_name='tempest-TestMinimumBasicScenario-server-1754472195',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1754472195',id=12,image_ref='8228346d-44e7-4ff6-b55b-4929f4f18bca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzGIWh6T2nUwb11FT+HtBESAvQ3hfo4+kEpo2+0LOmZUrfs6OWjVXST2j/4MrpprDkytp9u/w90mIXmIV1/h+Jz0Mg6RkFV18VlGrbzGlqDpU/RgMYi9/VsCvHQTx94cw==',key_name='tempest-TestMinimumBasicScenario-386090327',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:21:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65ea0e23a23640a5b71e3269c6f1115c',ramdisk_id='',reservation_id='r-95m0c446',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8228346d-44e7-4ff6-b55b-4929f4f18bca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2131001827',owner_user_name='tempest-TestMinimumBasicScenario-2131001827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:23:41Z,user_data=None,user_id='83ec3411adf049b190874e4923f49472',uuid=b0dd6065-3916-4f0e-841e-3df5ded2e2ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "809292ba-1131-47d4-8b1c-b7cef6888d76", "address": "fa:16:3e:83:78:ca", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809292ba-11", "ovs_interfaceid": "809292ba-1131-47d4-8b1c-b7cef6888d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:26:21 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Converting VIF {"id": "809292ba-1131-47d4-8b1c-b7cef6888d76", "address": "fa:16:3e:83:78:ca", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809292ba-11", "ovs_interfaceid": "809292ba-1131-47d4-8b1c-b7cef6888d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:26:21 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=809292ba-1131-47d4-8b1c-b7cef6888d76,network=Network(8320b285-1c9b-4a9a-980a-5a37682cfde2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809292ba-11') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:26:21 user nova-compute[70243]: DEBUG os_vif [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=809292ba-1131-47d4-8b1c-b7cef6888d76,network=Network(8320b285-1c9b-4a9a-980a-5a37682cfde2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809292ba-11') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:26:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap809292ba-11, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:26:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:26:21 user nova-compute[70243]: INFO os_vif [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:78:ca,bridge_name='br-int',has_traffic_filtering=True,id=809292ba-1131-47d4-8b1c-b7cef6888d76,network=Network(8320b285-1c9b-4a9a-980a-5a37682cfde2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809292ba-11')
Jul 24 16:26:21 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Deleting instance files /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee_del
Jul 24 16:26:21 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Deletion of /opt/stack/data/nova/instances/b0dd6065-3916-4f0e-841e-3df5ded2e2ee_del complete
Jul 24 16:26:21 user nova-compute[70243]: INFO nova.compute.manager [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 24 16:26:21 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:26:21 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:26:21 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:26:21 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:26:21 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Took 0.68 seconds to deallocate network for instance.
Jul 24 16:26:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:26:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:26:22 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:26:22 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:26:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:26:22 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Deleted allocations for instance b0dd6065-3916-4f0e-841e-3df5ded2e2ee
Jul 24 16:26:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc04e56f-0c3f-477d-92fe-f29a7f1647ac tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.034s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:26:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-c5ce1b3c-e158-4798-a9d0-974075fb8dd5 req-732bcb32-9a26-4c6f-ba0f-55fd1f13b90f service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received event network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:26:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c5ce1b3c-e158-4798-a9d0-974075fb8dd5 req-732bcb32-9a26-4c6f-ba0f-55fd1f13b90f service nova] Acquiring lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:26:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c5ce1b3c-e158-4798-a9d0-974075fb8dd5 req-732bcb32-9a26-4c6f-ba0f-55fd1f13b90f service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:26:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c5ce1b3c-e158-4798-a9d0-974075fb8dd5 req-732bcb32-9a26-4c6f-ba0f-55fd1f13b90f service nova] Lock "b0dd6065-3916-4f0e-841e-3df5ded2e2ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:26:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-c5ce1b3c-e158-4798-a9d0-974075fb8dd5 req-732bcb32-9a26-4c6f-ba0f-55fd1f13b90f service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] No waiting events found dispatching network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:26:22 user nova-compute[70243]: WARNING nova.compute.manager [req-c5ce1b3c-e158-4798-a9d0-974075fb8dd5 req-732bcb32-9a26-4c6f-ba0f-55fd1f13b90f service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received unexpected event network-vif-plugged-809292ba-1131-47d4-8b1c-b7cef6888d76 for instance with vm_state deleted and task_state None.
Jul 24 16:26:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-c5ce1b3c-e158-4798-a9d0-974075fb8dd5 req-732bcb32-9a26-4c6f-ba0f-55fd1f13b90f service nova] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Received event network-vif-deleted-809292ba-1131-47d4-8b1c-b7cef6888d76 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:26:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:26:36 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690215981.1664693, b0dd6065-3916-4f0e-841e-3df5ded2e2ee => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:26:36 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] VM Stopped (Lifecycle Event)
Jul 24 16:26:36 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b15d0776-1fc9-48ed-bd01-4a2365cf0fef None None] [instance: b0dd6065-3916-4f0e-841e-3df5ded2e2ee] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:26:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:26:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:26:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:26:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:26:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:40 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:26:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:43 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:26:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:43 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:26:45 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:26:46 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:46 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:26:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "6ed1935d-3a60-418e-bc44-ed65452afc1a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:26:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:26:46 user nova-compute[70243]: DEBUG nova.compute.manager [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:26:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:26:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:26:46 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:26:46 user nova-compute[70243]: INFO nova.compute.claims [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Claim successful on node user
Jul 24 16:26:46 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG nova.network.neutron [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:26:47 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:26:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG nova.policy [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa3936255d31421184e585e2fd17d7ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebdb3cb079814db091227f80b2ed1b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:26:47 user nova-compute[70243]: INFO nova.virt.block_device [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Booting with volume 8d7390a0-1192-49ab-b8a9-9c449d89ecd8 at /dev/vda
Jul 24 16:26:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG os_brick.utils [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[df467f90-558a-4aa2-a2ca-ea9e86e7f3a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b41f80-90a6-4d20-bca9-7058039e48cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[992a6b56-4235-40bc-91b8-4ab0dcbcf009]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3f2e6a-7b90-471d-9229-c7e2664f8b8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:26:47 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:26:47 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[803d76e5-bbb3-4948-9c8e-422e87320a66]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG os_brick.utils [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:26:47 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Updating existing volume attachment record: 78577798-0671-43df-b484-0e0d60a62194 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:26:48 user nova-compute[70243]: DEBUG nova.network.neutron [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Successfully created port: 021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:26:48 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:26:48 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:26:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-ad611655-ba4d-4a66-b78e-a82c058f4414" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:26:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-ad611655-ba4d-4a66-b78e-a82c058f4414" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:26:48 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:26:49 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Updating instance_info_cache with network_info: [{"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:26:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-ad611655-ba4d-4a66-b78e-a82c058f4414" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:26:49 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:26:49 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG nova.network.neutron [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Successfully updated port: 021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "refresh_cache-6ed1935d-3a60-418e-bc44-ed65452afc1a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquired lock "refresh_cache-6ed1935d-3a60-418e-bc44-ed65452afc1a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG nova.network.neutron [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG nova.compute.manager [req-d5b8938e-84b2-4e21-829a-77661c60fc50 req-ecd68675-fee1-4f38-8451-450f909a4499 service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Received event network-changed-021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG nova.compute.manager [req-d5b8938e-84b2-4e21-829a-77661c60fc50 req-ecd68675-fee1-4f38-8451-450f909a4499 service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Refreshing instance network info cache due to event network-changed-021971db-1e79-467f-8f5b-5361f205fceb. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d5b8938e-84b2-4e21-829a-77661c60fc50 req-ecd68675-fee1-4f38-8451-450f909a4499 service nova] Acquiring lock "refresh_cache-6ed1935d-3a60-418e-bc44-ed65452afc1a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG nova.network.neutron [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG nova.network.neutron [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Updating instance_info_cache with network_info: [{"id": "021971db-1e79-467f-8f5b-5361f205fceb", "address": "fa:16:3e:4a:88:70", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021971db-1e", "ovs_interfaceid": "021971db-1e79-467f-8f5b-5361f205fceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Releasing lock "refresh_cache-6ed1935d-3a60-418e-bc44-ed65452afc1a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG nova.compute.manager [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Instance network_info: |[{"id": "021971db-1e79-467f-8f5b-5361f205fceb", "address": "fa:16:3e:4a:88:70", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021971db-1e", "ovs_interfaceid": "021971db-1e79-467f-8f5b-5361f205fceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d5b8938e-84b2-4e21-829a-77661c60fc50 req-ecd68675-fee1-4f38-8451-450f909a4499 service nova] Acquired lock "refresh_cache-6ed1935d-3a60-418e-bc44-ed65452afc1a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG nova.network.neutron [req-d5b8938e-84b2-4e21-829a-77661c60fc50 req-ecd68675-fee1-4f38-8451-450f909a4499 service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Refreshing network info cache for port 021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:51 user nova-compute[70243]: DEBUG nova.network.neutron [req-d5b8938e-84b2-4e21-829a-77661c60fc50 req-ecd68675-fee1-4f38-8451-450f909a4499 service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Updated VIF entry in instance network info cache for port 021971db-1e79-467f-8f5b-5361f205fceb. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:26:51 user nova-compute[70243]: DEBUG nova.network.neutron [req-d5b8938e-84b2-4e21-829a-77661c60fc50 req-ecd68675-fee1-4f38-8451-450f909a4499 service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Updating instance_info_cache with network_info: [{"id": "021971db-1e79-467f-8f5b-5361f205fceb", "address": "fa:16:3e:4a:88:70", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021971db-1e", "ovs_interfaceid": "021971db-1e79-467f-8f5b-5361f205fceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:26:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d5b8938e-84b2-4e21-829a-77661c60fc50 req-ecd68675-fee1-4f38-8451-450f909a4499 service nova] Releasing lock "refresh_cache-6ed1935d-3a60-418e-bc44-ed65452afc1a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:26:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:51 user nova-compute[70243]: DEBUG nova.compute.manager [req-39db197f-c24c-43f4-ab39-9693e0a42fc5 req-9a108e36-d0ba-44af-aa92-175bfe2dc3af service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Received event network-changed-bc944a2d-ab8f-475a-b276-485ab373860a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:26:51 user nova-compute[70243]: DEBUG nova.compute.manager [req-39db197f-c24c-43f4-ab39-9693e0a42fc5 req-9a108e36-d0ba-44af-aa92-175bfe2dc3af service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Refreshing instance network info cache due to event network-changed-bc944a2d-ab8f-475a-b276-485ab373860a. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:26:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-39db197f-c24c-43f4-ab39-9693e0a42fc5 req-9a108e36-d0ba-44af-aa92-175bfe2dc3af service nova] Acquiring lock "refresh_cache-9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:26:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-39db197f-c24c-43f4-ab39-9693e0a42fc5 req-9a108e36-d0ba-44af-aa92-175bfe2dc3af service nova] Acquired lock "refresh_cache-9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:26:51 user nova-compute[70243]: DEBUG nova.network.neutron [req-39db197f-c24c-43f4-ab39-9693e0a42fc5 req-9a108e36-d0ba-44af-aa92-175bfe2dc3af service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Refreshing network info cache for port bc944a2d-ab8f-475a-b276-485ab373860a {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:26:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "5f70528b-33db-4257-96fe-e5fad869a224" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "5f70528b-33db-4257-96fe-e5fad869a224" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "5f70528b-33db-4257-96fe-e5fad869a224-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:26:52 user nova-compute[70243]: INFO nova.compute.manager [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Terminating instance
Jul 24 16:26:52 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG nova.compute.manager [req-3b285a8c-dea0-472a-a1dc-4410d44cc22e req-9382aec1-d9c6-4634-b86b-1a8b7ba5c6f2 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received event network-vif-unplugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3b285a8c-dea0-472a-a1dc-4410d44cc22e req-9382aec1-d9c6-4634-b86b-1a8b7ba5c6f2 service nova] Acquiring lock "5f70528b-33db-4257-96fe-e5fad869a224-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3b285a8c-dea0-472a-a1dc-4410d44cc22e req-9382aec1-d9c6-4634-b86b-1a8b7ba5c6f2 service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3b285a8c-dea0-472a-a1dc-4410d44cc22e req-9382aec1-d9c6-4634-b86b-1a8b7ba5c6f2 service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG nova.compute.manager [req-3b285a8c-dea0-472a-a1dc-4410d44cc22e req-9382aec1-d9c6-4634-b86b-1a8b7ba5c6f2 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] No waiting events found dispatching network-vif-unplugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG nova.compute.manager [req-3b285a8c-dea0-472a-a1dc-4410d44cc22e req-9382aec1-d9c6-4634-b86b-1a8b7ba5c6f2 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received event network-vif-unplugged-66249aa8-373c-45b2-940f-74f7e6228bce for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG nova.network.neutron [req-39db197f-c24c-43f4-ab39-9693e0a42fc5 req-9a108e36-d0ba-44af-aa92-175bfe2dc3af service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Updated VIF entry in instance network info cache for port bc944a2d-ab8f-475a-b276-485ab373860a. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG nova.network.neutron [req-39db197f-c24c-43f4-ab39-9693e0a42fc5 req-9a108e36-d0ba-44af-aa92-175bfe2dc3af service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Updating instance_info_cache with network_info: [{"id": "bc944a2d-ab8f-475a-b276-485ab373860a", "address": "fa:16:3e:de:36:b6", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc944a2d-ab", "ovs_interfaceid": "bc944a2d-ab8f-475a-b276-485ab373860a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-39db197f-c24c-43f4-ab39-9693e0a42fc5 req-9a108e36-d0ba-44af-aa92-175bfe2dc3af service nova] Releasing lock "refresh_cache-9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:26:53 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Instance destroyed successfully.
Jul 24 16:26:53 user nova-compute[70243]: DEBUG nova.objects.instance [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lazy-loading 'resources' on Instance uuid 5f70528b-33db-4257-96fe-e5fad869a224 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1291679900',display_name='tempest-ServerActionsTestOtherB-server-1291679900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1291679900',id=6,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqymb2uus6Bkqa8Jv1s5ZbibCwJHiHaRW+MVWVRPkPu9Fm+8ajStg97Lu5Oh0gjEFACHSPElKL2d/v4nyEqxN0n8bX7piloSV6v2kR0JjimuB49HIj2A6fdu+bprtip6w==',key_name='tempest-keypair-692701',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:24:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5385c4cfc8d84d1abd728c11d75c003d',ramdisk_id='',reservation_id='r-tutxnqyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-485175328',owner_user_name='tempest-ServerActionsTestOtherB-485175328-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:24:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9db33a574c334a2d91afc72b21ef15e6',uuid=5f70528b-33db-4257-96fe-e5fad869a224,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Converting VIF {"id": "66249aa8-373c-45b2-940f-74f7e6228bce", "address": "fa:16:3e:b0:61:6c", "network": {"id": "109feefe-8734-40ee-a8b8-2defa6e83853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1518946588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5385c4cfc8d84d1abd728c11d75c003d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66249aa8-37", "ovs_interfaceid": "66249aa8-373c-45b2-940f-74f7e6228bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=66249aa8-373c-45b2-940f-74f7e6228bce,network=Network(109feefe-8734-40ee-a8b8-2defa6e83853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66249aa8-37') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG os_vif [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=66249aa8-373c-45b2-940f-74f7e6228bce,network=Network(109feefe-8734-40ee-a8b8-2defa6e83853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66249aa8-37') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66249aa8-37, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:26:53 user nova-compute[70243]: INFO os_vif [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=66249aa8-373c-45b2-940f-74f7e6228bce,network=Network(109feefe-8734-40ee-a8b8-2defa6e83853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66249aa8-37')
Jul 24 16:26:53 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:26:53 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:26:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=7644MB free_disk=24.37704086303711GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OARbsQWM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:26:53 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:26:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[448fcc01-4297-47b3-890a-a48a40ee10c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:26:53 user nova-compute[70243]: No targets found.
Jul 24 16:26:53 user nova-compute[70243]: iSNS:
Jul 24 16:26:53 user nova-compute[70243]: No targets found.
Jul 24 16:26:53 user nova-compute[70243]: STATIC:
Jul 24 16:26:53 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b
Jul 24 16:26:53 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:26:53 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:26:53 user nova-compute[70243]: FIRMWARE:
Jul 24 16:26:53 user nova-compute[70243]: No targets found.
Jul 24 16:26:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:26:53 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:26:53 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f563321a-a914-44e4-a36a-4d44b5b02d28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[184a55a7-5bf9-475a-b31e-73b54b13917f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:26:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b (non-flash)
Jul 24 16:26:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc7b5990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b'): ({'sdb'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Removing single pathed devices sdb {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d813d86-124c-4daf-913c-ded62ca40cad]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[de486fcd-9de6-4320-866b-1c2f710d8390]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Flushing IO for device /dev/sdb {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance de22ea98-b041-4f3f-8986-435c43267a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance ad611655-ba4d-4a66-b78e-a82c058f4414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5f70528b-33db-4257-96fe-e5fad869a224 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 50fecb3a-8f06-4822-8c84-76df51acfe50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6f2258de-6b31-48af-81df-37b64da4ca99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6ed1935d-3a60-418e-bc44-ed65452afc1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57c5fd4-f222-402e-ae37-c094a77a2fe1]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6664213d-5acb-4657-b069-613363d8eb62]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[831a47e9-f22e-4d18-a19c-49df03631341]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff825220-1c71-46a6-827c-2073150eb44a]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260]
Jul 24 16:26:53 user nova-compute[70243]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b, portal: 172.16.0.220,3260] successful.
Jul 24 16:26:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d0447c3-66c4-4105-9a6f-9187ae43f96b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[779e3604-4e09-409a-8a9c-51d2553075f3]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] <== disconnect_volume: return (323ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:26:53 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Deleting instance files /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224_del
Jul 24 16:26:53 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Deletion of /opt/stack/data/nova/instances/5f70528b-33db-4257-96fe-e5fad869a224_del complete
Jul 24 16:26:53 user nova-compute[70243]: INFO nova.compute.manager [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Took 1.75 seconds to destroy the instance on the hypervisor.
Jul 24 16:26:53 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:26:53 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:26:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:26:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:26:54 user nova-compute[70243]: DEBUG nova.compute.manager [req-1cb5c779-aab9-4f69-b029-dad2fd43f711 req-1df2fe81-7158-4053-9ab0-85143915d3de service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received event network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:26:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1cb5c779-aab9-4f69-b029-dad2fd43f711 req-1df2fe81-7158-4053-9ab0-85143915d3de service nova] Acquiring lock "5f70528b-33db-4257-96fe-e5fad869a224-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:26:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1cb5c779-aab9-4f69-b029-dad2fd43f711 req-1df2fe81-7158-4053-9ab0-85143915d3de service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:26:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1cb5c779-aab9-4f69-b029-dad2fd43f711 req-1df2fe81-7158-4053-9ab0-85143915d3de service nova] Lock "5f70528b-33db-4257-96fe-e5fad869a224-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:26:54 user nova-compute[70243]: DEBUG nova.compute.manager [req-1cb5c779-aab9-4f69-b029-dad2fd43f711 req-1df2fe81-7158-4053-9ab0-85143915d3de service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] No waiting events found dispatching network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:26:54 user nova-compute[70243]: WARNING nova.compute.manager [req-1cb5c779-aab9-4f69-b029-dad2fd43f711 req-1df2fe81-7158-4053-9ab0-85143915d3de service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received unexpected event network-vif-plugged-66249aa8-373c-45b2-940f-74f7e6228bce for instance with vm_state active and task_state deleting.
Jul 24 16:26:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:55 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:26:55 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Took 1.09 seconds to deallocate network for instance.
Jul 24 16:26:55 user nova-compute[70243]: DEBUG nova.compute.manager [req-316058e4-9ed1-4a09-be24-17b9dceb9e13 req-97891dc0-b8e8-4b32-92b6-67424210ce01 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Received event network-vif-deleted-66249aa8-373c-45b2-940f-74f7e6228bce {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:26:55 user nova-compute[70243]: INFO nova.compute.manager [req-316058e4-9ed1-4a09-be24-17b9dceb9e13 req-97891dc0-b8e8-4b32-92b6-67424210ce01 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Neutron deleted interface 66249aa8-373c-45b2-940f-74f7e6228bce; detaching it from the instance and deleting it from the info cache
Jul 24 16:26:55 user nova-compute[70243]: DEBUG nova.network.neutron [req-316058e4-9ed1-4a09-be24-17b9dceb9e13 req-97891dc0-b8e8-4b32-92b6-67424210ce01 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:26:55 user nova-compute[70243]: DEBUG nova.compute.manager [req-316058e4-9ed1-4a09-be24-17b9dceb9e13 req-97891dc0-b8e8-4b32-92b6-67424210ce01 service nova] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Detach interface failed, port_id=66249aa8-373c-45b2-940f-74f7e6228bce, reason: Instance 5f70528b-33db-4257-96fe-e5fad869a224 could not be found. {{(pid=70243) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 16:26:55 user nova-compute[70243]: INFO nova.compute.manager [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Took 0.80 seconds to detach 1 volumes for instance.
Jul 24 16:26:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:26:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:26:56 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Deleted allocations for instance 5f70528b-33db-4257-96fe-e5fad869a224
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ed0d1660-138c-491b-bcf0-d2041614826c tempest-ServerActionsTestOtherB-485175328 tempest-ServerActionsTestOtherB-485175328-project-member] Lock "5f70528b-33db-4257-96fe-e5fad869a224" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.168s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:26:56 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Creating image(s)
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Did not create local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Ensure instance console log exists: /opt/stack/data/nova/instances/6ed1935d-3a60-418e-bc44-ed65452afc1a/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Start _get_guest_xml network_info=[{"id": "021971db-1e79-467f-8f5b-5361f205fceb", "address": "fa:16:3e:4a:88:70", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021971db-1e", "ovs_interfaceid": "021971db-1e79-467f-8f5b-5361f205fceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVOWQZzq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6ed1935d-3a60-418e-bc44-ed65452afc1a', 'attached_at': '', 'detached_at': '', 'volume_id': '8d7390a0-1192-49ab-b8a9-9c449d89ecd8', 'serial': '8d7390a0-1192-49ab-b8a9-9c449d89ecd8'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '78577798-0671-43df-b484-0e0d60a62194', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:26:56 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:26:56 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVOWQZzq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:26:56 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:26:56 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:26:56 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b5f3c9-848c-48e5-866d-f49bc28581d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:26:56 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fd9029-9c1a-4c8e-8c71-97c967b9e616]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8] added
Jul 24 16:26:56 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba730466-4f8b-4267-bda9-8785a785729b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[076ffd56-0789-4356-a776-71c6383f5267]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TVOWQZzq {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG nova.objects.instance [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lazy-loading 'flavor' on Instance uuid 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TVOWQZzq" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6f0438-7a17-4d90-96a2-24b60fb9fe1f]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TVOWQZzq'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d493cf20-a5e3-4f92-936e-4ac6ea622826]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c1baf4-80cc-4413-9b43-8b29643ada0a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 16:26:56 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 16:26:56 user nova-compute[70243]:  {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:26:56 user nova-compute[70243]: WARNING os_brick.initiator.connectors.iscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 16:26:56 user nova-compute[70243]: 
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[41613915-897f-4a21-a436-78e1e73cd871]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8, portal: 172.16.0.220,3260]
Jul 24 16:26:56 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8, portal: 172.16.0.220,3260] successful.
Jul 24 16:26:56 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe169c4a-f857-4ef0-8a22-b10d81ade7d3]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f345f9cd-81e2-4613-8577-bfd8de1a2d9b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:26:56 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:26:56 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d83b13-157b-40b5-b526-f86799304bd8]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVOWQZzq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:26:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:26:56 user nova-compute[70243]: INFO nova.compute.manager [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Attaching volume 5f2d6460-46f7-4822-8755-5bf5545555e3 to /dev/vdb
Jul 24 16:26:57 user nova-compute[70243]: DEBUG os_brick.utils [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8c1227-58c6-4b61-978e-4ec3826d4566]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[138c792d-df12-4551-ad95-0fa58916640d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[79816a9c-2d99-4314-bdaf-50b79f81aace]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[261ec60a-a34a-4a95-ab0d-24dc0efe7f51]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:26:57 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:26:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[efec4215-2acb-48ae-ae99-b379344325a7]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG os_brick.utils [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Updating existing volume attachment record: 4ea878d9-ad19-4667-a904-b82ca19b0ec9 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26562303032373133', 'path': '/dev/sdb'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562303032373133', 'path': '/dev/sdb'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:26:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1036526617',display_name='tempest-ServerActionsTestOtherA-server-1036526617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1036526617',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNt4ywOtyDbY3gzVxioiadq0RHvp3ujVzU7+egeM9QHVtvP6DGqg4hSRwxq8r4OyAFnfBqKPWEeStDLSLwfjx+5dISRxZesWLAiccd5P+5WMBwka91+aa63O7dxU+RVwA==',key_name='tempest-keypair-283031417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebdb3cb079814db091227f80b2ed1b9d',ramdisk_id='',reservation_id='r-bvklrqc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-39125821',owner_user_name='tempest-ServerActionsTestOtherA-39125821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:26:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa3936255d31421184e585e2fd17d7ef',uuid=6ed1935d-3a60-418e-bc44-ed65452afc1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "021971db-1e79-467f-8f5b-5361f205fceb", "address": "fa:16:3e:4a:88:70", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021971db-1e", "ovs_interfaceid": "021971db-1e79-467f-8f5b-5361f205fceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converting VIF {"id": "021971db-1e79-467f-8f5b-5361f205fceb", "address": "fa:16:3e:4a:88:70", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021971db-1e", "ovs_interfaceid": "021971db-1e79-467f-8f5b-5361f205fceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:88:70,bridge_name='br-int',has_traffic_filtering=True,id=021971db-1e79-467f-8f5b-5361f205fceb,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021971db-1e') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG nova.objects.instance [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ed1935d-3a60-418e-bc44-ed65452afc1a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:26:57 user nova-compute[70243]:   <uuid>6ed1935d-3a60-418e-bc44-ed65452afc1a</uuid>
Jul 24 16:26:57 user nova-compute[70243]:   <name>instance-00000015</name>
Jul 24 16:26:57 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:26:57 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:26:57 user nova-compute[70243]:   <metadata>
Jul 24 16:26:57 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:26:57 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:26:57 user nova-compute[70243]:       <nova:name>tempest-ServerActionsTestOtherA-server-1036526617</nova:name>
Jul 24 16:26:57 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:26:56</nova:creationTime>
Jul 24 16:26:57 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:26:57 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:26:57 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:26:57 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:26:57 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:26:57 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:26:57 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:26:57 user nova-compute[70243]:       <nova:owner>
Jul 24 16:26:57 user nova-compute[70243]:         <nova:user uuid="aa3936255d31421184e585e2fd17d7ef">tempest-ServerActionsTestOtherA-39125821-project-member</nova:user>
Jul 24 16:26:57 user nova-compute[70243]:         <nova:project uuid="ebdb3cb079814db091227f80b2ed1b9d">tempest-ServerActionsTestOtherA-39125821</nova:project>
Jul 24 16:26:57 user nova-compute[70243]:       </nova:owner>
Jul 24 16:26:57 user nova-compute[70243]:       <nova:ports>
Jul 24 16:26:57 user nova-compute[70243]:         <nova:port uuid="021971db-1e79-467f-8f5b-5361f205fceb">
Jul 24 16:26:57 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 24 16:26:57 user nova-compute[70243]:         </nova:port>
Jul 24 16:26:57 user nova-compute[70243]:       </nova:ports>
Jul 24 16:26:57 user nova-compute[70243]:     </nova:instance>
Jul 24 16:26:57 user nova-compute[70243]:   </metadata>
Jul 24 16:26:57 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:26:57 user nova-compute[70243]:     <system>
Jul 24 16:26:57 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:26:57 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:26:57 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:26:57 user nova-compute[70243]:       <entry name="serial">6ed1935d-3a60-418e-bc44-ed65452afc1a</entry>
Jul 24 16:26:57 user nova-compute[70243]:       <entry name="uuid">6ed1935d-3a60-418e-bc44-ed65452afc1a</entry>
Jul 24 16:26:57 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:26:57 user nova-compute[70243]:     </system>
Jul 24 16:26:57 user nova-compute[70243]:   </sysinfo>
Jul 24 16:26:57 user nova-compute[70243]:   <os>
Jul 24 16:26:57 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:26:57 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:26:57 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:26:57 user nova-compute[70243]:   </os>
Jul 24 16:26:57 user nova-compute[70243]:   <features>
Jul 24 16:26:57 user nova-compute[70243]:     <acpi/>
Jul 24 16:26:57 user nova-compute[70243]:     <apic/>
Jul 24 16:26:57 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:26:57 user nova-compute[70243]:   </features>
Jul 24 16:26:57 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:26:57 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:26:57 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:26:57 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:26:57 user nova-compute[70243]:   </clock>
Jul 24 16:26:57 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:26:57 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:26:57 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:26:57 user nova-compute[70243]:   </cpu>
Jul 24 16:26:57 user nova-compute[70243]:   <devices>
Jul 24 16:26:57 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:26:57 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:26:57 user nova-compute[70243]:       <source dev="/dev/sdb"/>
Jul 24 16:26:57 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:26:57 user nova-compute[70243]:       <serial>8d7390a0-1192-49ab-b8a9-9c449d89ecd8</serial>
Jul 24 16:26:57 user nova-compute[70243]:     </disk>
Jul 24 16:26:57 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:26:57 user nova-compute[70243]:       <mac address="fa:16:3e:4a:88:70"/>
Jul 24 16:26:57 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:26:57 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:26:57 user nova-compute[70243]:       <target dev="tap021971db-1e"/>
Jul 24 16:26:57 user nova-compute[70243]:     </interface>
Jul 24 16:26:57 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:26:57 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/6ed1935d-3a60-418e-bc44-ed65452afc1a/console.log" append="off"/>
Jul 24 16:26:57 user nova-compute[70243]:     </serial>
Jul 24 16:26:57 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:26:57 user nova-compute[70243]:     <video>
Jul 24 16:26:57 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:26:57 user nova-compute[70243]:     </video>
Jul 24 16:26:57 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:26:57 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:26:57 user nova-compute[70243]:     </rng>
Jul 24 16:26:57 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:26:57 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:26:57 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:26:57 user nova-compute[70243]:     </memballoon>
Jul 24 16:26:57 user nova-compute[70243]:   </devices>
Jul 24 16:26:57 user nova-compute[70243]: </domain>
Jul 24 16:26:57 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:26:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1036526617',display_name='tempest-ServerActionsTestOtherA-server-1036526617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1036526617',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNt4ywOtyDbY3gzVxioiadq0RHvp3ujVzU7+egeM9QHVtvP6DGqg4hSRwxq8r4OyAFnfBqKPWEeStDLSLwfjx+5dISRxZesWLAiccd5P+5WMBwka91+aa63O7dxU+RVwA==',key_name='tempest-keypair-283031417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebdb3cb079814db091227f80b2ed1b9d',ramdisk_id='',reservation_id='r-bvklrqc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-39125821',owner_user_name='tempest-ServerActionsTestOtherA-39125821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:26:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa3936255d31421184e585e2fd17d7ef',uuid=6ed1935d-3a60-418e-bc44-ed65452afc1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "021971db-1e79-467f-8f5b-5361f205fceb", "address": "fa:16:3e:4a:88:70", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021971db-1e", "ovs_interfaceid": "021971db-1e79-467f-8f5b-5361f205fceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converting VIF {"id": "021971db-1e79-467f-8f5b-5361f205fceb", "address": "fa:16:3e:4a:88:70", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021971db-1e", "ovs_interfaceid": "021971db-1e79-467f-8f5b-5361f205fceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:88:70,bridge_name='br-int',has_traffic_filtering=True,id=021971db-1e79-467f-8f5b-5361f205fceb,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021971db-1e') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG os_vif [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:88:70,bridge_name='br-int',has_traffic_filtering=True,id=021971db-1e79-467f-8f5b-5361f205fceb,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021971db-1e') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap021971db-1e, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap021971db-1e, col_values=(('external_ids', {'iface-id': '021971db-1e79-467f-8f5b-5361f205fceb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:88:70', 'vm-uuid': '6ed1935d-3a60-418e-bc44-ed65452afc1a'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:26:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:57 user nova-compute[70243]: INFO os_vif [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:88:70,bridge_name='br-int',has_traffic_filtering=True,id=021971db-1e79-467f-8f5b-5361f205fceb,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021971db-1e')
Jul 24 16:26:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:26:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] No VIF found with MAC fa:16:3e:4a:88:70, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:26:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:59 user nova-compute[70243]: DEBUG nova.compute.manager [req-e520283c-c0c8-41a8-ba03-3dd34bb07dd7 req-7d942367-538c-4054-a106-8720947e9a4d service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Received event network-vif-plugged-021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:26:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e520283c-c0c8-41a8-ba03-3dd34bb07dd7 req-7d942367-538c-4054-a106-8720947e9a4d service nova] Acquiring lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:26:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e520283c-c0c8-41a8-ba03-3dd34bb07dd7 req-7d942367-538c-4054-a106-8720947e9a4d service nova] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:26:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e520283c-c0c8-41a8-ba03-3dd34bb07dd7 req-7d942367-538c-4054-a106-8720947e9a4d service nova] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:26:59 user nova-compute[70243]: DEBUG nova.compute.manager [req-e520283c-c0c8-41a8-ba03-3dd34bb07dd7 req-7d942367-538c-4054-a106-8720947e9a4d service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] No waiting events found dispatching network-vif-plugged-021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:26:59 user nova-compute[70243]: WARNING nova.compute.manager [req-e520283c-c0c8-41a8-ba03-3dd34bb07dd7 req-7d942367-538c-4054-a106-8720947e9a4d service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Received unexpected event network-vif-plugged-021971db-1e79-467f-8f5b-5361f205fceb for instance with vm_state building and task_state spawning.
Jul 24 16:26:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:26:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:01 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216021.4155097, 6ed1935d-3a60-418e-bc44-ed65452afc1a => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:27:01 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] VM Resumed (Lifecycle Event)
Jul 24 16:27:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:27:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:27:01 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Instance spawned successfully.
Jul 24 16:27:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:27:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:27:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:27:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:27:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:27:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:27:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:27:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:27:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:27:01 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:27:01 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216021.4173353, 6ed1935d-3a60-418e-bc44-ed65452afc1a => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:27:01 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] VM Started (Lifecycle Event)
Jul 24 16:27:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:27:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:27:01 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:27:01 user nova-compute[70243]: INFO nova.compute.manager [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Took 5.03 seconds to spawn the instance on the hypervisor.
Jul 24 16:27:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:27:01 user nova-compute[70243]: DEBUG nova.compute.manager [req-a695251c-1d53-4e1b-8dfe-a98debd8c909 req-78e3493a-f7c0-4e52-92f2-c7ec4c3d12fc service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Received event network-vif-plugged-021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a695251c-1d53-4e1b-8dfe-a98debd8c909 req-78e3493a-f7c0-4e52-92f2-c7ec4c3d12fc service nova] Acquiring lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a695251c-1d53-4e1b-8dfe-a98debd8c909 req-78e3493a-f7c0-4e52-92f2-c7ec4c3d12fc service nova] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a695251c-1d53-4e1b-8dfe-a98debd8c909 req-78e3493a-f7c0-4e52-92f2-c7ec4c3d12fc service nova] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:01 user nova-compute[70243]: DEBUG nova.compute.manager [req-a695251c-1d53-4e1b-8dfe-a98debd8c909 req-78e3493a-f7c0-4e52-92f2-c7ec4c3d12fc service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] No waiting events found dispatching network-vif-plugged-021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:27:01 user nova-compute[70243]: WARNING nova.compute.manager [req-a695251c-1d53-4e1b-8dfe-a98debd8c909 req-78e3493a-f7c0-4e52-92f2-c7ec4c3d12fc service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Received unexpected event network-vif-plugged-021971db-1e79-467f-8f5b-5361f205fceb for instance with vm_state building and task_state spawning.
Jul 24 16:27:01 user nova-compute[70243]: INFO nova.compute.manager [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Took 15.05 seconds to build instance.
Jul 24 16:27:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-51a63773-dc92-4cf1-8886-27bad8e48496 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.152s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "abcd54bc-02d4-4872-8227-43cb93d27491" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "abcd54bc-02d4-4872-8227-43cb93d27491" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:02 user nova-compute[70243]: INFO nova.compute.manager [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Unshelving
Jul 24 16:27:02 user nova-compute[70243]: INFO nova.virt.block_device [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Booting with volume eb7c1819-e8e1-41be-983c-8322cd613c9c at /dev/vdc
Jul 24 16:27:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:02 user nova-compute[70243]: DEBUG os_brick.utils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:27:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e12b71-a68d-4672-8bfa-b9e754106595]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d28860a-df81-44c5-8b7c-75df772e4a8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d88bb5-e749-4081-9e2b-c75b09c54d58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[971c5501-27b4-47d6-b7d3-b1ab240f0339]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:27:03 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:27:03 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de7bddb-5ed9-42ee-b05d-bef5a2eace1d]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG os_brick.utils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Updating existing volume attachment record: 9c3f86c5-6e0a-44a2-affe-8129807011ab {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQAmYBxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:27:03 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:27:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:27:03 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:27:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:27:03 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:27:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ffb0b0-00fc-4e4c-bb6d-bc2d77ed9883]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:27:03 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[138f2f12-7adb-450b-bf21-a66e34504370]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3] added
Jul 24 16:27:04 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[10971f88-6508-4949-b59d-a84bde131507]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[39660634-9350-4792-bf69-29252139ebca]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LQAmYBxh {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LQAmYBxh" returned: 0 in 0.031s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffb4887-9b22-494e-acb6-ee90ac4072c7]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LQAmYBxh'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[796ddee5-123a-4d31-a61a-bef881903245]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c2e268-2abb-4aac-a7cd-095843b3035f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:27:04 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:27:04 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf20f304-ef55-4f43-9fa6-ebf585ad2491]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3, portal: 172.16.0.220,3260]
Jul 24 16:27:04 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3, portal: 172.16.0.220,3260] successful.
Jul 24 16:27:04 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e983f2-8f40-444f-a9d2-39e5fb667c15]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff55697-cb6d-42f6-9b51-60a4b39af1d8]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:27:04 user nova-compute[70243]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:27:04 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:27:04 user nova-compute[70243]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:27:04 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c29a2c-d279-4e29-ac5f-89347db11011]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQAmYBxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:27:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:27:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23364623939356166', 'path': '/dev/sdc'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:27:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364623939356166', 'path': '/dev/sdc'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:27:05 user nova-compute[70243]: DEBUG nova.objects.instance [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lazy-loading 'flavor' on Instance uuid 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:27:05 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:27:05 user nova-compute[70243]:   <source dev="/dev/sdc"/>
Jul 24 16:27:05 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:27:05 user nova-compute[70243]:   <serial>5f2d6460-46f7-4822-8755-5bf5545555e3</serial>
Jul 24 16:27:05 user nova-compute[70243]: </disk>
Jul 24 16:27:05 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:27:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:27:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:27:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] No VIF found with MAC fa:16:3e:de:36:b6, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:27:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f0a03788-abb2-483f-b3f8-d3a63e558488 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.999s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:08 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216013.0127325, 5f70528b-33db-4257-96fe-e5fad869a224 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:27:08 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] VM Stopped (Lifecycle Event)
Jul 24 16:27:08 user nova-compute[70243]: DEBUG nova.compute.manager [None req-4afa1b45-1b8f-4e90-a20f-68bd1082dfb5 None None] [instance: 5f70528b-33db-4257-96fe-e5fad869a224] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:27:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "5a84c738-68d3-463f-8cb4-170be05abbdf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "5a84c738-68d3-463f-8cb4-170be05abbdf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:09 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:27:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:09 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:27:09 user nova-compute[70243]: INFO nova.compute.claims [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Claim successful on node user
Jul 24 16:27:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:09 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:27:09 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:27:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:09 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:27:09 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:27:09 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:27:09 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:27:09 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG nova.policy [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8df18929107a458194a9c528d9bdfeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e819e22e590947478d513e1b9ad39494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:27:10 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Creating image(s)
Jul 24 16:27:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a84c738-68d3-463f-8cb4-170be05abbdf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "/opt/stack/data/nova/instances/5a84c738-68d3-463f-8cb4-170be05abbdf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "/opt/stack/data/nova/instances/5a84c738-68d3-463f-8cb4-170be05abbdf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.174s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/5a84c738-68d3-463f-8cb4-170be05abbdf/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/5a84c738-68d3-463f-8cb4-170be05abbdf/disk 1073741824" returned: 0 in 0.069s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG nova.objects.instance [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'pci_requests' on Instance uuid abcd54bc-02d4-4872-8227-43cb93d27491 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG nova.objects.instance [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'numa_topology' on Instance uuid abcd54bc-02d4-4872-8227-43cb93d27491 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:27:10 user nova-compute[70243]: INFO nova.compute.claims [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Claim successful on node user
Jul 24 16:27:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.194s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a84c738-68d3-463f-8cb4-170be05abbdf/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a84c738-68d3-463f-8cb4-170be05abbdf/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Successfully created port: 453c83f8-79fe-4453-8cbc-440b6b14bb62 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a84c738-68d3-463f-8cb4-170be05abbdf/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Cannot resize image /opt/stack/data/nova/instances/5a84c738-68d3-463f-8cb4-170be05abbdf/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG nova.objects.instance [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lazy-loading 'migration_context' on Instance uuid 5a84c738-68d3-463f-8cb4-170be05abbdf {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Ensure instance console log exists: /opt/stack/data/nova/instances/5a84c738-68d3-463f-8cb4-170be05abbdf/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:11 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:27:11 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:27:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:11 user nova-compute[70243]: INFO nova.network.neutron [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Updating port b7b407a6-851a-4096-b6d4-d60d5e1d40d0 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 24 16:27:12 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Successfully updated port: 453c83f8-79fe-4453-8cbc-440b6b14bb62 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:27:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "refresh_cache-5a84c738-68d3-463f-8cb4-170be05abbdf" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:27:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquired lock "refresh_cache-5a84c738-68d3-463f-8cb4-170be05abbdf" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:27:12 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:27:12 user nova-compute[70243]: DEBUG nova.compute.manager [req-09bdedc6-6144-43a3-9c5e-417687a14f67 req-7bf39167-11ec-41e4-9529-5e0fb68d702a service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Received event network-changed-453c83f8-79fe-4453-8cbc-440b6b14bb62 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:12 user nova-compute[70243]: DEBUG nova.compute.manager [req-09bdedc6-6144-43a3-9c5e-417687a14f67 req-7bf39167-11ec-41e4-9529-5e0fb68d702a service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Refreshing instance network info cache due to event network-changed-453c83f8-79fe-4453-8cbc-440b6b14bb62. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:27:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-09bdedc6-6144-43a3-9c5e-417687a14f67 req-7bf39167-11ec-41e4-9529-5e0fb68d702a service nova] Acquiring lock "refresh_cache-5a84c738-68d3-463f-8cb4-170be05abbdf" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:27:12 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:27:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "refresh_cache-abcd54bc-02d4-4872-8227-43cb93d27491" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquired lock "refresh_cache-abcd54bc-02d4-4872-8227-43cb93d27491" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.network.neutron [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Updating instance_info_cache with network_info: [{"id": "453c83f8-79fe-4453-8cbc-440b6b14bb62", "address": "fa:16:3e:e6:79:dd", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap453c83f8-79", "ovs_interfaceid": "453c83f8-79fe-4453-8cbc-440b6b14bb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Releasing lock "refresh_cache-5a84c738-68d3-463f-8cb4-170be05abbdf" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Instance network_info: |[{"id": "453c83f8-79fe-4453-8cbc-440b6b14bb62", "address": "fa:16:3e:e6:79:dd", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap453c83f8-79", "ovs_interfaceid": "453c83f8-79fe-4453-8cbc-440b6b14bb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-09bdedc6-6144-43a3-9c5e-417687a14f67 req-7bf39167-11ec-41e4-9529-5e0fb68d702a service nova] Acquired lock "refresh_cache-5a84c738-68d3-463f-8cb4-170be05abbdf" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.network.neutron [req-09bdedc6-6144-43a3-9c5e-417687a14f67 req-7bf39167-11ec-41e4-9529-5e0fb68d702a service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Refreshing network info cache for port 453c83f8-79fe-4453-8cbc-440b6b14bb62 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Start _get_guest_xml network_info=[{"id": "453c83f8-79fe-4453-8cbc-440b6b14bb62", "address": "fa:16:3e:e6:79:dd", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap453c83f8-79", "ovs_interfaceid": "453c83f8-79fe-4453-8cbc-440b6b14bb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:27:13 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:27:13 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:27:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-988401357',display_name='tempest-AttachVolumeNegativeTest-server-988401357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-988401357',id=22,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVVp4Y1CP8XCaR1AkYIPM+0MpNM1jtsn2ta7kg1Al3u5WjcFkhv8L1g6ecOfEGOG6wgbg/dCFqdvxMQxtM2mC1fL8tLstcGnDQlwHQPDsJCBSAz1rp2fl8Y7Mh6AxPYKw==',key_name='tempest-keypair-1555637312',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e819e22e590947478d513e1b9ad39494',ramdisk_id='',reservation_id='r-qxfusx97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1152214105',owner_user_name='tempest-AttachVolumeNegativeTest-1152214105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:27:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df18929107a458194a9c528d9bdfeac',uuid=5a84c738-68d3-463f-8cb4-170be05abbdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "453c83f8-79fe-4453-8cbc-440b6b14bb62", "address": "fa:16:3e:e6:79:dd", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap453c83f8-79", "ovs_interfaceid": "453c83f8-79fe-4453-8cbc-440b6b14bb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converting VIF {"id": "453c83f8-79fe-4453-8cbc-440b6b14bb62", "address": "fa:16:3e:e6:79:dd", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap453c83f8-79", "ovs_interfaceid": "453c83f8-79fe-4453-8cbc-440b6b14bb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:79:dd,bridge_name='br-int',has_traffic_filtering=True,id=453c83f8-79fe-4453-8cbc-440b6b14bb62,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap453c83f8-79') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.objects.instance [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a84c738-68d3-463f-8cb4-170be05abbdf {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:27:13 user nova-compute[70243]:   <uuid>5a84c738-68d3-463f-8cb4-170be05abbdf</uuid>
Jul 24 16:27:13 user nova-compute[70243]:   <name>instance-00000016</name>
Jul 24 16:27:13 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:27:13 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:27:13 user nova-compute[70243]:   <metadata>
Jul 24 16:27:13 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:27:13 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:27:13 user nova-compute[70243]:       <nova:name>tempest-AttachVolumeNegativeTest-server-988401357</nova:name>
Jul 24 16:27:13 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:27:13</nova:creationTime>
Jul 24 16:27:13 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:27:13 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:27:13 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:27:13 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:27:13 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:27:13 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:27:13 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:27:13 user nova-compute[70243]:       <nova:owner>
Jul 24 16:27:13 user nova-compute[70243]:         <nova:user uuid="8df18929107a458194a9c528d9bdfeac">tempest-AttachVolumeNegativeTest-1152214105-project-member</nova:user>
Jul 24 16:27:13 user nova-compute[70243]:         <nova:project uuid="e819e22e590947478d513e1b9ad39494">tempest-AttachVolumeNegativeTest-1152214105</nova:project>
Jul 24 16:27:13 user nova-compute[70243]:       </nova:owner>
Jul 24 16:27:13 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:27:13 user nova-compute[70243]:       <nova:ports>
Jul 24 16:27:13 user nova-compute[70243]:         <nova:port uuid="453c83f8-79fe-4453-8cbc-440b6b14bb62">
Jul 24 16:27:13 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 24 16:27:13 user nova-compute[70243]:         </nova:port>
Jul 24 16:27:13 user nova-compute[70243]:       </nova:ports>
Jul 24 16:27:13 user nova-compute[70243]:     </nova:instance>
Jul 24 16:27:13 user nova-compute[70243]:   </metadata>
Jul 24 16:27:13 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:27:13 user nova-compute[70243]:     <system>
Jul 24 16:27:13 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:27:13 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:27:13 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:27:13 user nova-compute[70243]:       <entry name="serial">5a84c738-68d3-463f-8cb4-170be05abbdf</entry>
Jul 24 16:27:13 user nova-compute[70243]:       <entry name="uuid">5a84c738-68d3-463f-8cb4-170be05abbdf</entry>
Jul 24 16:27:13 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:27:13 user nova-compute[70243]:     </system>
Jul 24 16:27:13 user nova-compute[70243]:   </sysinfo>
Jul 24 16:27:13 user nova-compute[70243]:   <os>
Jul 24 16:27:13 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:27:13 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:27:13 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:27:13 user nova-compute[70243]:   </os>
Jul 24 16:27:13 user nova-compute[70243]:   <features>
Jul 24 16:27:13 user nova-compute[70243]:     <acpi/>
Jul 24 16:27:13 user nova-compute[70243]:     <apic/>
Jul 24 16:27:13 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:27:13 user nova-compute[70243]:   </features>
Jul 24 16:27:13 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:27:13 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:27:13 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:27:13 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:27:13 user nova-compute[70243]:   </clock>
Jul 24 16:27:13 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:27:13 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:27:13 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:27:13 user nova-compute[70243]:   </cpu>
Jul 24 16:27:13 user nova-compute[70243]:   <devices>
Jul 24 16:27:13 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:27:13 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:27:13 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/5a84c738-68d3-463f-8cb4-170be05abbdf/disk"/>
Jul 24 16:27:13 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:27:13 user nova-compute[70243]:     </disk>
Jul 24 16:27:13 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:27:13 user nova-compute[70243]:       <mac address="fa:16:3e:e6:79:dd"/>
Jul 24 16:27:13 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:27:13 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:27:13 user nova-compute[70243]:       <target dev="tap453c83f8-79"/>
Jul 24 16:27:13 user nova-compute[70243]:     </interface>
Jul 24 16:27:13 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:27:13 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/5a84c738-68d3-463f-8cb4-170be05abbdf/console.log" append="off"/>
Jul 24 16:27:13 user nova-compute[70243]:     </serial>
Jul 24 16:27:13 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:27:13 user nova-compute[70243]:     <video>
Jul 24 16:27:13 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:27:13 user nova-compute[70243]:     </video>
Jul 24 16:27:13 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:27:13 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:27:13 user nova-compute[70243]:     </rng>
Jul 24 16:27:13 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:27:13 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:27:13 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:27:13 user nova-compute[70243]:     </memballoon>
Jul 24 16:27:13 user nova-compute[70243]:   </devices>
Jul 24 16:27:13 user nova-compute[70243]: </domain>
Jul 24 16:27:13 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:27:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-988401357',display_name='tempest-AttachVolumeNegativeTest-server-988401357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-988401357',id=22,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVVp4Y1CP8XCaR1AkYIPM+0MpNM1jtsn2ta7kg1Al3u5WjcFkhv8L1g6ecOfEGOG6wgbg/dCFqdvxMQxtM2mC1fL8tLstcGnDQlwHQPDsJCBSAz1rp2fl8Y7Mh6AxPYKw==',key_name='tempest-keypair-1555637312',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e819e22e590947478d513e1b9ad39494',ramdisk_id='',reservation_id='r-qxfusx97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1152214105',owner_user_name='tempest-AttachVolumeNegativeTest-1152214105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:27:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df18929107a458194a9c528d9bdfeac',uuid=5a84c738-68d3-463f-8cb4-170be05abbdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "453c83f8-79fe-4453-8cbc-440b6b14bb62", "address": "fa:16:3e:e6:79:dd", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap453c83f8-79", "ovs_interfaceid": "453c83f8-79fe-4453-8cbc-440b6b14bb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converting VIF {"id": "453c83f8-79fe-4453-8cbc-440b6b14bb62", "address": "fa:16:3e:e6:79:dd", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap453c83f8-79", "ovs_interfaceid": "453c83f8-79fe-4453-8cbc-440b6b14bb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:79:dd,bridge_name='br-int',has_traffic_filtering=True,id=453c83f8-79fe-4453-8cbc-440b6b14bb62,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap453c83f8-79') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG os_vif [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:79:dd,bridge_name='br-int',has_traffic_filtering=True,id=453c83f8-79fe-4453-8cbc-440b6b14bb62,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap453c83f8-79') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap453c83f8-79, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap453c83f8-79, col_values=(('external_ids', {'iface-id': '453c83f8-79fe-4453-8cbc-440b6b14bb62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:79:dd', 'vm-uuid': '5a84c738-68d3-463f-8cb4-170be05abbdf'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:13 user nova-compute[70243]: INFO os_vif [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:79:dd,bridge_name='br-int',has_traffic_filtering=True,id=453c83f8-79fe-4453-8cbc-440b6b14bb62,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap453c83f8-79')
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:27:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] No VIF found with MAC fa:16:3e:e6:79:dd, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:27:14 user nova-compute[70243]: DEBUG nova.network.neutron [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Updating instance_info_cache with network_info: [{"id": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "address": "fa:16:3e:11:51:64", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b407a6-85", "ovs_interfaceid": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:27:14 user nova-compute[70243]: DEBUG nova.network.neutron [req-09bdedc6-6144-43a3-9c5e-417687a14f67 req-7bf39167-11ec-41e4-9529-5e0fb68d702a service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Updated VIF entry in instance network info cache for port 453c83f8-79fe-4453-8cbc-440b6b14bb62. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:27:14 user nova-compute[70243]: DEBUG nova.network.neutron [req-09bdedc6-6144-43a3-9c5e-417687a14f67 req-7bf39167-11ec-41e4-9529-5e0fb68d702a service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Updating instance_info_cache with network_info: [{"id": "453c83f8-79fe-4453-8cbc-440b6b14bb62", "address": "fa:16:3e:e6:79:dd", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap453c83f8-79", "ovs_interfaceid": "453c83f8-79fe-4453-8cbc-440b6b14bb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:27:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-09bdedc6-6144-43a3-9c5e-417687a14f67 req-7bf39167-11ec-41e4-9529-5e0fb68d702a service nova] Releasing lock "refresh_cache-5a84c738-68d3-463f-8cb4-170be05abbdf" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:27:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Releasing lock "refresh_cache-abcd54bc-02d4-4872-8227-43cb93d27491" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:27:14 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:27:14 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Creating image(s)
Jul 24 16:27:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "/opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "/opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "/opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:14 user nova-compute[70243]: DEBUG nova.objects.instance [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'trusted_certs' on Instance uuid abcd54bc-02d4-4872-8227-43cb93d27491 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "9e39b984ab3b7b937ca13a44f7790f42e2e78d61" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "9e39b984ab3b7b937ca13a44f7790f42e2e78d61" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e39b984ab3b7b937ca13a44f7790f42e2e78d61.part --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:15 user nova-compute[70243]: DEBUG nova.compute.manager [req-3d2734f0-d6f1-4943-a15a-85985ed185d6 req-f10cc6b7-b788-4dee-a6dc-8e505ce584f7 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Received event network-changed-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:15 user nova-compute[70243]: DEBUG nova.compute.manager [req-3d2734f0-d6f1-4943-a15a-85985ed185d6 req-f10cc6b7-b788-4dee-a6dc-8e505ce584f7 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Refreshing instance network info cache due to event network-changed-b7b407a6-851a-4096-b6d4-d60d5e1d40d0. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:27:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3d2734f0-d6f1-4943-a15a-85985ed185d6 req-f10cc6b7-b788-4dee-a6dc-8e505ce584f7 service nova] Acquiring lock "refresh_cache-abcd54bc-02d4-4872-8227-43cb93d27491" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:27:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3d2734f0-d6f1-4943-a15a-85985ed185d6 req-f10cc6b7-b788-4dee-a6dc-8e505ce584f7 service nova] Acquired lock "refresh_cache-abcd54bc-02d4-4872-8227-43cb93d27491" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:27:15 user nova-compute[70243]: DEBUG nova.network.neutron [req-3d2734f0-d6f1-4943-a15a-85985ed185d6 req-f10cc6b7-b788-4dee-a6dc-8e505ce584f7 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Refreshing network info cache for port b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:27:15 user nova-compute[70243]: DEBUG nova.compute.manager [req-96006b32-e841-4eb1-9367-956150377d37 req-7f708e75-0a0d-4da9-96c0-825c21ce4dc9 service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Received event network-vif-plugged-453c83f8-79fe-4453-8cbc-440b6b14bb62 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-96006b32-e841-4eb1-9367-956150377d37 req-7f708e75-0a0d-4da9-96c0-825c21ce4dc9 service nova] Acquiring lock "5a84c738-68d3-463f-8cb4-170be05abbdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-96006b32-e841-4eb1-9367-956150377d37 req-7f708e75-0a0d-4da9-96c0-825c21ce4dc9 service nova] Lock "5a84c738-68d3-463f-8cb4-170be05abbdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-96006b32-e841-4eb1-9367-956150377d37 req-7f708e75-0a0d-4da9-96c0-825c21ce4dc9 service nova] Lock "5a84c738-68d3-463f-8cb4-170be05abbdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:15 user nova-compute[70243]: DEBUG nova.compute.manager [req-96006b32-e841-4eb1-9367-956150377d37 req-7f708e75-0a0d-4da9-96c0-825c21ce4dc9 service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] No waiting events found dispatching network-vif-plugged-453c83f8-79fe-4453-8cbc-440b6b14bb62 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:27:15 user nova-compute[70243]: WARNING nova.compute.manager [req-96006b32-e841-4eb1-9367-956150377d37 req-7f708e75-0a0d-4da9-96c0-825c21ce4dc9 service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Received unexpected event network-vif-plugged-453c83f8-79fe-4453-8cbc-440b6b14bb62 for instance with vm_state building and task_state spawning.
Jul 24 16:27:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "4c394c36-5163-4739-964a-7350ee4814ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "4c394c36-5163-4739-964a-7350ee4814ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:27:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e39b984ab3b7b937ca13a44f7790f42e2e78d61.part --force-share --output=json" returned: 0 in 0.150s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:15 user nova-compute[70243]: DEBUG nova.virt.images [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] 9437ed8b-aed0-44ce-a0b8-369ce0e846cc was qcow2, converting to raw {{(pid=70243) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 16:27:15 user nova-compute[70243]: DEBUG nova.privsep.utils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70243) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 16:27:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9e39b984ab3b7b937ca13a44f7790f42e2e78d61.part /opt/stack/data/nova/instances/_base/9e39b984ab3b7b937ca13a44f7790f42e2e78d61.converted {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:15 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:27:15 user nova-compute[70243]: INFO nova.compute.claims [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Claim successful on node user
Jul 24 16:27:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9e39b984ab3b7b937ca13a44f7790f42e2e78d61.part /opt/stack/data/nova/instances/_base/9e39b984ab3b7b937ca13a44f7790f42e2e78d61.converted" returned: 0 in 0.847s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e39b984ab3b7b937ca13a44f7790f42e2e78d61.converted --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:16 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:27:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e39b984ab3b7b937ca13a44f7790f42e2e78d61.converted --force-share --output=json" returned: 0 in 0.147s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "9e39b984ab3b7b937ca13a44f7790f42e2e78d61" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.553s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e39b984ab3b7b937ca13a44f7790f42e2e78d61 --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:16 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:27:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.031s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:27:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e39b984ab3b7b937ca13a44f7790f42e2e78d61 --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "9e39b984ab3b7b937ca13a44f7790f42e2e78d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "9e39b984ab3b7b937ca13a44f7790f42e2e78d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e39b984ab3b7b937ca13a44f7790f42e2e78d61 --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG nova.network.neutron [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:27:17 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:27:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e39b984ab3b7b937ca13a44f7790f42e2e78d61 --force-share --output=json" returned: 0 in 0.131s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9e39b984ab3b7b937ca13a44f7790f42e2e78d61,backing_fmt=raw /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG nova.compute.manager [req-2ff0b2e0-e22f-4e99-becb-ae26eaeb5c34 req-302d4e55-550d-414d-acdf-0bbba5370d87 service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Received event network-vif-plugged-453c83f8-79fe-4453-8cbc-440b6b14bb62 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2ff0b2e0-e22f-4e99-becb-ae26eaeb5c34 req-302d4e55-550d-414d-acdf-0bbba5370d87 service nova] Acquiring lock "5a84c738-68d3-463f-8cb4-170be05abbdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2ff0b2e0-e22f-4e99-becb-ae26eaeb5c34 req-302d4e55-550d-414d-acdf-0bbba5370d87 service nova] Lock "5a84c738-68d3-463f-8cb4-170be05abbdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2ff0b2e0-e22f-4e99-becb-ae26eaeb5c34 req-302d4e55-550d-414d-acdf-0bbba5370d87 service nova] Lock "5a84c738-68d3-463f-8cb4-170be05abbdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG nova.compute.manager [req-2ff0b2e0-e22f-4e99-becb-ae26eaeb5c34 req-302d4e55-550d-414d-acdf-0bbba5370d87 service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] No waiting events found dispatching network-vif-plugged-453c83f8-79fe-4453-8cbc-440b6b14bb62 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:27:17 user nova-compute[70243]: WARNING nova.compute.manager [req-2ff0b2e0-e22f-4e99-becb-ae26eaeb5c34 req-302d4e55-550d-414d-acdf-0bbba5370d87 service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Received unexpected event network-vif-plugged-453c83f8-79fe-4453-8cbc-440b6b14bb62 for instance with vm_state building and task_state spawning.
Jul 24 16:27:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9e39b984ab3b7b937ca13a44f7790f42e2e78d61,backing_fmt=raw /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk 1073741824" returned: 0 in 0.066s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "9e39b984ab3b7b937ca13a44f7790f42e2e78d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e39b984ab3b7b937ca13a44f7790f42e2e78d61 --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:27:17 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Creating image(s)
Jul 24 16:27:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "/opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "/opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "3b0852f2e2af03b1592db129e9a7c586e83d9983" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "3b0852f2e2af03b1592db129e9a7c586e83d9983" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b0852f2e2af03b1592db129e9a7c586e83d9983.part --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG nova.policy [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83ec3411adf049b190874e4923f49472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65ea0e23a23640a5b71e3269c6f1115c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e39b984ab3b7b937ca13a44f7790f42e2e78d61 --force-share --output=json" returned: 0 in 0.672s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG nova.objects.instance [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'migration_context' on Instance uuid abcd54bc-02d4-4872-8227-43cb93d27491 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:17 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Rebasing disk image.
Jul 24 16:27:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216037.8958855, 5a84c738-68d3-463f-8cb4-170be05abbdf => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:27:17 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] VM Resumed (Lifecycle Event)
Jul 24 16:27:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:27:17 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Instance spawned successfully.
Jul 24 16:27:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b0852f2e2af03b1592db129e9a7c586e83d9983.part --force-share --output=json" returned: 0 in 0.173s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG nova.virt.images [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] 8f8fd556-f664-448f-b667-80b448018026 was qcow2, converting to raw {{(pid=70243) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG nova.privsep.utils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70243) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 16:27:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3b0852f2e2af03b1592db129e9a7c586e83d9983.part /opt/stack/data/nova/instances/_base/3b0852f2e2af03b1592db129e9a7c586e83d9983.converted {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.146s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d -F raw /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:27:18 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:27:18 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216037.897268, 5a84c738-68d3-463f-8cb4-170be05abbdf => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:27:18 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] VM Started (Lifecycle Event)
Jul 24 16:27:18 user nova-compute[70243]: DEBUG nova.network.neutron [req-3d2734f0-d6f1-4943-a15a-85985ed185d6 req-f10cc6b7-b788-4dee-a6dc-8e505ce584f7 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Updated VIF entry in instance network info cache for port b7b407a6-851a-4096-b6d4-d60d5e1d40d0. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG nova.network.neutron [req-3d2734f0-d6f1-4943-a15a-85985ed185d6 req-f10cc6b7-b788-4dee-a6dc-8e505ce584f7 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Updating instance_info_cache with network_info: [{"id": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "address": "fa:16:3e:11:51:64", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b407a6-85", "ovs_interfaceid": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3d2734f0-d6f1-4943-a15a-85985ed185d6 req-f10cc6b7-b788-4dee-a6dc-8e505ce584f7 service nova] Releasing lock "refresh_cache-abcd54bc-02d4-4872-8227-43cb93d27491" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3b0852f2e2af03b1592db129e9a7c586e83d9983.part /opt/stack/data/nova/instances/_base/3b0852f2e2af03b1592db129e9a7c586e83d9983.converted" returned: 0 in 0.256s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b0852f2e2af03b1592db129e9a7c586e83d9983.converted --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:18 user nova-compute[70243]: INFO nova.compute.manager [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Took 8.23 seconds to spawn the instance on the hypervisor.
Jul 24 16:27:18 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b0852f2e2af03b1592db129e9a7c586e83d9983.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "3b0852f2e2af03b1592db129e9a7c586e83d9983" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.208s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b0852f2e2af03b1592db129e9a7c586e83d9983 --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:27:18 user nova-compute[70243]: INFO nova.compute.manager [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Took 9.09 seconds to build instance.
Jul 24 16:27:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b03f1a3-3bec-47fe-9f0d-1c5f7b6d9ddc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "5a84c738-68d3-463f-8cb4-170be05abbdf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.224s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b0852f2e2af03b1592db129e9a7c586e83d9983 --force-share --output=json" returned: 0 in 0.173s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "3b0852f2e2af03b1592db129e9a7c586e83d9983" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "3b0852f2e2af03b1592db129e9a7c586e83d9983" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b0852f2e2af03b1592db129e9a7c586e83d9983 --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b0852f2e2af03b1592db129e9a7c586e83d9983 --force-share --output=json" returned: 0 in 0.174s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3b0852f2e2af03b1592db129e9a7c586e83d9983,backing_fmt=raw /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3b0852f2e2af03b1592db129e9a7c586e83d9983,backing_fmt=raw /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk 1073741824" returned: 0 in 0.060s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "3b0852f2e2af03b1592db129e9a7c586e83d9983" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b0852f2e2af03b1592db129e9a7c586e83d9983 --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:18 user nova-compute[70243]: DEBUG nova.network.neutron [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Successfully created port: 7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:27:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b0852f2e2af03b1592db129e9a7c586e83d9983 --force-share --output=json" returned: 0 in 0.171s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:19 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:27:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:19 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Cannot resize image /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:27:19 user nova-compute[70243]: DEBUG nova.objects.instance [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lazy-loading 'migration_context' on Instance uuid 4c394c36-5163-4739-964a-7350ee4814ae {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:27:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Ensure instance console log exists: /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:27:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:20 user nova-compute[70243]: DEBUG nova.network.neutron [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Successfully updated port: 7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:27:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-e6bb7016-1cd4-4e1b-9fc9-938f8f72aeb4 req-2623fcf3-4026-494a-b1d9-37a02df38b53 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Received event network-changed-7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-e6bb7016-1cd4-4e1b-9fc9-938f8f72aeb4 req-2623fcf3-4026-494a-b1d9-37a02df38b53 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Refreshing instance network info cache due to event network-changed-7d075a00-69b3-4a37-8752-46f3c3a35cb5. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:27:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e6bb7016-1cd4-4e1b-9fc9-938f8f72aeb4 req-2623fcf3-4026-494a-b1d9-37a02df38b53 service nova] Acquiring lock "refresh_cache-4c394c36-5163-4739-964a-7350ee4814ae" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:27:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e6bb7016-1cd4-4e1b-9fc9-938f8f72aeb4 req-2623fcf3-4026-494a-b1d9-37a02df38b53 service nova] Acquired lock "refresh_cache-4c394c36-5163-4739-964a-7350ee4814ae" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:27:20 user nova-compute[70243]: DEBUG nova.network.neutron [req-e6bb7016-1cd4-4e1b-9fc9-938f8f72aeb4 req-2623fcf3-4026-494a-b1d9-37a02df38b53 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Refreshing network info cache for port 7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:27:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "refresh_cache-4c394c36-5163-4739-964a-7350ee4814ae" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:27:20 user nova-compute[70243]: DEBUG nova.network.neutron [req-e6bb7016-1cd4-4e1b-9fc9-938f8f72aeb4 req-2623fcf3-4026-494a-b1d9-37a02df38b53 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:27:20 user nova-compute[70243]: DEBUG nova.network.neutron [req-e6bb7016-1cd4-4e1b-9fc9-938f8f72aeb4 req-2623fcf3-4026-494a-b1d9-37a02df38b53 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:27:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e6bb7016-1cd4-4e1b-9fc9-938f8f72aeb4 req-2623fcf3-4026-494a-b1d9-37a02df38b53 service nova] Releasing lock "refresh_cache-4c394c36-5163-4739-964a-7350ee4814ae" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:27:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquired lock "refresh_cache-4c394c36-5163-4739-964a-7350ee4814ae" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:27:20 user nova-compute[70243]: DEBUG nova.network.neutron [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:27:20 user nova-compute[70243]: DEBUG nova.network.neutron [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d -F raw /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk" returned: 0 in 3.175s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Ensure instance console log exists: /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Start _get_guest_xml network_info=[{"id": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "address": "fa:16:3e:11:51:64", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b407a6-85", "ovs_interfaceid": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='80e1b8dde3605df453a4f27834860948',container_format='bare',created_at=2023-07-24T16:25:10Z,direct_url=<?>,disk_format='qcow2',id=9437ed8b-aed0-44ce-a0b8-369ce0e846cc,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-81833196-shelved',owner='9fcf70d1092145a2bda67106833fe84d',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-24T16:25:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kZYsAwEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'abcd54bc-02d4-4872-8227-43cb93d27491', 'attached_at': '', 'detached_at': '', 'volume_id': 'eb7c1819-e8e1-41be-983c-8322cd613c9c', 'serial': 'eb7c1819-e8e1-41be-983c-8322cd613c9c'}, 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '9c3f86c5-6e0a-44a2-affe-8129807011ab', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:27:21 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:27:21 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='80e1b8dde3605df453a4f27834860948',container_format='bare',created_at=2023-07-24T16:25:10Z,direct_url=<?>,disk_format='qcow2',id=9437ed8b-aed0-44ce-a0b8-369ce0e846cc,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-81833196-shelved',owner='9fcf70d1092145a2bda67106833fe84d',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-24T16:25:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.objects.instance [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'vcpu_model' on Instance uuid abcd54bc-02d4-4872-8227-43cb93d27491 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kZYsAwEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:27:21 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:27:21 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:27:21 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9b252b-fe72-46d8-a2ff-5a2611abb511]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:27:21 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.058s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f0cf5d-2818-45cb-9f91-2b4407773720]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c] added
Jul 24 16:27:21 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83655b3-6c33-4965-902d-bb5def3feb95]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a50278-abb9-434e-8ec6-48a54198aa69]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kZYsAwEi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.network.neutron [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Updating instance_info_cache with network_info: [{"id": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "address": "fa:16:3e:56:fb:e8", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d075a00-69", "ovs_interfaceid": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kZYsAwEi" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1803b4a-6a2c-4e57-954e-da48e96c205c]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kZYsAwEi'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Releasing lock "refresh_cache-4c394c36-5163-4739-964a-7350ee4814ae" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.compute.manager [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Instance network_info: |[{"id": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "address": "fa:16:3e:56:fb:e8", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d075a00-69", "ovs_interfaceid": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Start _get_guest_xml network_info=[{"id": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "address": "fa:16:3e:56:fb:e8", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d075a00-69", "ovs_interfaceid": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:27:12Z,direct_url=<?>,disk_format='qcow2',id=8f8fd556-f664-448f-b667-80b448018026,min_disk=0,min_ram=0,name='tempest-scenario-img--347813118',owner='65ea0e23a23640a5b71e3269c6f1115c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:27:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '8f8fd556-f664-448f-b667-80b448018026'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:27:21 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:27:21 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db5b339-5850-4d1b-9280-fda08b094e07]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:27:12Z,direct_url=<?>,disk_format='qcow2',id=8f8fd556-f664-448f-b667-80b448018026,min_disk=0,min_ram=0,name='tempest-scenario-img--347813118',owner='65ea0e23a23640a5b71e3269c6f1115c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:27:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:27:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1003531418',display_name='tempest-TestMinimumBasicScenario-server-1003531418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1003531418',id=23,image_ref='8f8fd556-f664-448f-b667-80b448018026',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNkjb5r2/g/V5n55dyM7qTp72KvMoMWkUbOP/7Xr3UKE06R1edaMfwJPZBKwpYmD1+1bZ1ekXUYg1HJSnh00XC2vLaS4f/AR/5e9eyxfwb4gUOfLcXs+sna9q/7Iw0kmg==',key_name='tempest-TestMinimumBasicScenario-1308615724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65ea0e23a23640a5b71e3269c6f1115c',ramdisk_id='',reservation_id='r-sdnbs626',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8f8fd556-f664-448f-b667-80b448018026',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2131001827',owner_user_name='tempest-TestMinimumBasicScenario-2131001827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:27:17Z,user_data=None,user_id='83ec3411adf049b190874e4923f49472',uuid=4c394c36-5163-4739-964a-7350ee4814ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "address": "fa:16:3e:56:fb:e8", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d075a00-69", "ovs_interfaceid": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Converting VIF {"id": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "address": "fa:16:3e:56:fb:e8", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d075a00-69", "ovs_interfaceid": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:fb:e8,bridge_name='br-int',has_traffic_filtering=True,id=7d075a00-69b3-4a37-8752-46f3c3a35cb5,network=Network(8320b285-1c9b-4a9a-980a-5a37682cfde2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d075a00-69') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.objects.instance [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c394c36-5163-4739-964a-7350ee4814ae {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6e0692-e673-45ce-938a-b8e433267223]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:27:21 user nova-compute[70243]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:27:21 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:27:21 user nova-compute[70243]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:27:21 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:27:21 user nova-compute[70243]:   <uuid>4c394c36-5163-4739-964a-7350ee4814ae</uuid>
Jul 24 16:27:21 user nova-compute[70243]:   <name>instance-00000017</name>
Jul 24 16:27:21 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:27:21 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:27:21 user nova-compute[70243]:   <metadata>
Jul 24 16:27:21 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:27:21 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:27:21 user nova-compute[70243]:       <nova:name>tempest-TestMinimumBasicScenario-server-1003531418</nova:name>
Jul 24 16:27:21 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:27:21</nova:creationTime>
Jul 24 16:27:21 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:27:21 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:27:21 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:27:21 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:27:21 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:27:21 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:27:21 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:27:21 user nova-compute[70243]:       <nova:owner>
Jul 24 16:27:21 user nova-compute[70243]:         <nova:user uuid="83ec3411adf049b190874e4923f49472">tempest-TestMinimumBasicScenario-2131001827-project-member</nova:user>
Jul 24 16:27:21 user nova-compute[70243]:         <nova:project uuid="65ea0e23a23640a5b71e3269c6f1115c">tempest-TestMinimumBasicScenario-2131001827</nova:project>
Jul 24 16:27:21 user nova-compute[70243]:       </nova:owner>
Jul 24 16:27:21 user nova-compute[70243]:       <nova:root type="image" uuid="8f8fd556-f664-448f-b667-80b448018026"/>
Jul 24 16:27:21 user nova-compute[70243]:       <nova:ports>
Jul 24 16:27:21 user nova-compute[70243]:         <nova:port uuid="7d075a00-69b3-4a37-8752-46f3c3a35cb5">
Jul 24 16:27:21 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 24 16:27:21 user nova-compute[70243]:         </nova:port>
Jul 24 16:27:21 user nova-compute[70243]:       </nova:ports>
Jul 24 16:27:21 user nova-compute[70243]:     </nova:instance>
Jul 24 16:27:21 user nova-compute[70243]:   </metadata>
Jul 24 16:27:21 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:27:21 user nova-compute[70243]:     <system>
Jul 24 16:27:21 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:27:21 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:27:21 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:27:21 user nova-compute[70243]:       <entry name="serial">4c394c36-5163-4739-964a-7350ee4814ae</entry>
Jul 24 16:27:21 user nova-compute[70243]:       <entry name="uuid">4c394c36-5163-4739-964a-7350ee4814ae</entry>
Jul 24 16:27:21 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:27:21 user nova-compute[70243]:     </system>
Jul 24 16:27:21 user nova-compute[70243]:   </sysinfo>
Jul 24 16:27:21 user nova-compute[70243]:   <os>
Jul 24 16:27:21 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:27:21 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:27:21 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:27:21 user nova-compute[70243]:   </os>
Jul 24 16:27:21 user nova-compute[70243]:   <features>
Jul 24 16:27:21 user nova-compute[70243]:     <acpi/>
Jul 24 16:27:21 user nova-compute[70243]:     <apic/>
Jul 24 16:27:21 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:27:21 user nova-compute[70243]:   </features>
Jul 24 16:27:21 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:27:21 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:27:21 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:27:21 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:27:21 user nova-compute[70243]:   </clock>
Jul 24 16:27:21 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:27:21 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:27:21 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:27:21 user nova-compute[70243]:   </cpu>
Jul 24 16:27:21 user nova-compute[70243]:   <devices>
Jul 24 16:27:21 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:27:21 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:27:21 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk"/>
Jul 24 16:27:21 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:27:21 user nova-compute[70243]:     </disk>
Jul 24 16:27:21 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:27:21 user nova-compute[70243]:       <mac address="fa:16:3e:56:fb:e8"/>
Jul 24 16:27:21 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:27:21 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:27:21 user nova-compute[70243]:       <target dev="tap7d075a00-69"/>
Jul 24 16:27:21 user nova-compute[70243]:     </interface>
Jul 24 16:27:21 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:27:21 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/console.log" append="off"/>
Jul 24 16:27:21 user nova-compute[70243]:     </serial>
Jul 24 16:27:21 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:27:21 user nova-compute[70243]:     <video>
Jul 24 16:27:21 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:27:21 user nova-compute[70243]:     </video>
Jul 24 16:27:21 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:27:21 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:27:21 user nova-compute[70243]:     </rng>
Jul 24 16:27:21 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:27:21 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:27:21 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:27:21 user nova-compute[70243]:     </memballoon>
Jul 24 16:27:21 user nova-compute[70243]:   </devices>
Jul 24 16:27:21 user nova-compute[70243]: </domain>
Jul 24 16:27:21 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:27:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1003531418',display_name='tempest-TestMinimumBasicScenario-server-1003531418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1003531418',id=23,image_ref='8f8fd556-f664-448f-b667-80b448018026',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNkjb5r2/g/V5n55dyM7qTp72KvMoMWkUbOP/7Xr3UKE06R1edaMfwJPZBKwpYmD1+1bZ1ekXUYg1HJSnh00XC2vLaS4f/AR/5e9eyxfwb4gUOfLcXs+sna9q/7Iw0kmg==',key_name='tempest-TestMinimumBasicScenario-1308615724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65ea0e23a23640a5b71e3269c6f1115c',ramdisk_id='',reservation_id='r-sdnbs626',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8f8fd556-f664-448f-b667-80b448018026',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2131001827',owner_user_name='tempest-TestMinimumBasicScenario-2131001827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:27:17Z,user_data=None,user_id='83ec3411adf049b190874e4923f49472',uuid=4c394c36-5163-4739-964a-7350ee4814ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "address": "fa:16:3e:56:fb:e8", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d075a00-69", "ovs_interfaceid": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Converting VIF {"id": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "address": "fa:16:3e:56:fb:e8", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d075a00-69", "ovs_interfaceid": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:fb:e8,bridge_name='br-int',has_traffic_filtering=True,id=7d075a00-69b3-4a37-8752-46f3c3a35cb5,network=Network(8320b285-1c9b-4a9a-980a-5a37682cfde2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d075a00-69') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_vif [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:fb:e8,bridge_name='br-int',has_traffic_filtering=True,id=7d075a00-69b3-4a37-8752-46f3c3a35cb5,network=Network(8320b285-1c9b-4a9a-980a-5a37682cfde2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d075a00-69') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d075a00-69, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7d075a00-69, col_values=(('external_ids', {'iface-id': '7d075a00-69b3-4a37-8752-46f3c3a35cb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:fb:e8', 'vm-uuid': '4c394c36-5163-4739-964a-7350ee4814ae'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:21 user nova-compute[70243]: INFO os_vif [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:fb:e8,bridge_name='br-int',has_traffic_filtering=True,id=7d075a00-69b3-4a37-8752-46f3c3a35cb5,network=Network(8320b285-1c9b-4a9a-980a-5a37682cfde2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d075a00-69')
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c2a827-ec2f-4b24-b341-ad8e0726f6e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c, portal: 172.16.0.220,3260]
Jul 24 16:27:21 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c, portal: 172.16.0.220,3260] successful.
Jul 24 16:27:21 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b57a7d-b167-410e-b655-f9fc093ec67b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] No VIF found with MAC fa:16:3e:56:fb:e8, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d307a0-f854-4136-8626-87952d3858ed]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:27:21 user nova-compute[70243]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:27:21 user nova-compute[70243]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)
Jul 24 16:27:21 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:27:21 user nova-compute[70243]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:27:21 user nova-compute[70243]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)
Jul 24 16:27:21 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[32203960-9586-4424-87e6-4ab23a1de945]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:27:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kZYsAwEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:27:22 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:27:22 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '23234663639333430', 'path': '/dev/sdd'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:27:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234663639333430', 'path': '/dev/sdd'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:27:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T16:23:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-81833196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-81833196',id=15,image_ref='9437ed8b-aed0-44ce-a0b8-369ce0e846cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-146229776',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:23:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9fcf70d1092145a2bda67106833fe84d',ramdisk_id='',reservation_id='r-i86lveuw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-372850833',owner_user_name='tempest-AttachVolumeShelveTestJSON-372850833-project-member',shelved_at='2023-07-24T16:25:14.345223',shelved_host='user',shelved_image_id='9437ed8b-aed0-44ce-a0b8-369ce0e846cc'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:27:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62f8a994029a48608bfdcb15f14b2067',uuid=abcd54bc-02d4-4872-8227-43cb93d27491,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "address": "fa:16:3e:11:51:64", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b407a6-85", "ovs_interfaceid": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:27:22 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converting VIF {"id": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "address": "fa:16:3e:11:51:64", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b407a6-85", "ovs_interfaceid": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:27:22 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:51:64,bridge_name='br-int',has_traffic_filtering=True,id=b7b407a6-851a-4096-b6d4-d60d5e1d40d0,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b407a6-85') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:27:22 user nova-compute[70243]: DEBUG nova.objects.instance [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'pci_devices' on Instance uuid abcd54bc-02d4-4872-8227-43cb93d27491 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:27:22 user nova-compute[70243]:   <uuid>abcd54bc-02d4-4872-8227-43cb93d27491</uuid>
Jul 24 16:27:22 user nova-compute[70243]:   <name>instance-0000000f</name>
Jul 24 16:27:22 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:27:22 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:27:22 user nova-compute[70243]:   <metadata>
Jul 24 16:27:22 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:27:22 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:27:22 user nova-compute[70243]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-81833196</nova:name>
Jul 24 16:27:22 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:27:21</nova:creationTime>
Jul 24 16:27:22 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:27:22 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:27:22 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:27:22 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:27:22 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:27:22 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:27:22 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:27:22 user nova-compute[70243]:       <nova:owner>
Jul 24 16:27:22 user nova-compute[70243]:         <nova:user uuid="62f8a994029a48608bfdcb15f14b2067">tempest-AttachVolumeShelveTestJSON-372850833-project-member</nova:user>
Jul 24 16:27:22 user nova-compute[70243]:         <nova:project uuid="9fcf70d1092145a2bda67106833fe84d">tempest-AttachVolumeShelveTestJSON-372850833</nova:project>
Jul 24 16:27:22 user nova-compute[70243]:       </nova:owner>
Jul 24 16:27:22 user nova-compute[70243]:       <nova:root type="image" uuid="9437ed8b-aed0-44ce-a0b8-369ce0e846cc"/>
Jul 24 16:27:22 user nova-compute[70243]:       <nova:ports>
Jul 24 16:27:22 user nova-compute[70243]:         <nova:port uuid="b7b407a6-851a-4096-b6d4-d60d5e1d40d0">
Jul 24 16:27:22 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 24 16:27:22 user nova-compute[70243]:         </nova:port>
Jul 24 16:27:22 user nova-compute[70243]:       </nova:ports>
Jul 24 16:27:22 user nova-compute[70243]:     </nova:instance>
Jul 24 16:27:22 user nova-compute[70243]:   </metadata>
Jul 24 16:27:22 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:27:22 user nova-compute[70243]:     <system>
Jul 24 16:27:22 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:27:22 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:27:22 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:27:22 user nova-compute[70243]:       <entry name="serial">abcd54bc-02d4-4872-8227-43cb93d27491</entry>
Jul 24 16:27:22 user nova-compute[70243]:       <entry name="uuid">abcd54bc-02d4-4872-8227-43cb93d27491</entry>
Jul 24 16:27:22 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:27:22 user nova-compute[70243]:     </system>
Jul 24 16:27:22 user nova-compute[70243]:   </sysinfo>
Jul 24 16:27:22 user nova-compute[70243]:   <os>
Jul 24 16:27:22 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:27:22 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:27:22 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:27:22 user nova-compute[70243]:   </os>
Jul 24 16:27:22 user nova-compute[70243]:   <features>
Jul 24 16:27:22 user nova-compute[70243]:     <acpi/>
Jul 24 16:27:22 user nova-compute[70243]:     <apic/>
Jul 24 16:27:22 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:27:22 user nova-compute[70243]:   </features>
Jul 24 16:27:22 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:27:22 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:27:22 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:27:22 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:27:22 user nova-compute[70243]:   </clock>
Jul 24 16:27:22 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:27:22 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:27:22 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:27:22 user nova-compute[70243]:   </cpu>
Jul 24 16:27:22 user nova-compute[70243]:   <devices>
Jul 24 16:27:22 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:27:22 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:27:22 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk"/>
Jul 24 16:27:22 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:27:22 user nova-compute[70243]:     </disk>
Jul 24 16:27:22 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:27:22 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:27:22 user nova-compute[70243]:       <source dev="/dev/sdd"/>
Jul 24 16:27:22 user nova-compute[70243]:       <target dev="vdc" bus="virtio"/>
Jul 24 16:27:22 user nova-compute[70243]:       <serial>eb7c1819-e8e1-41be-983c-8322cd613c9c</serial>
Jul 24 16:27:22 user nova-compute[70243]:     </disk>
Jul 24 16:27:22 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:27:22 user nova-compute[70243]:       <mac address="fa:16:3e:11:51:64"/>
Jul 24 16:27:22 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:27:22 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:27:22 user nova-compute[70243]:       <target dev="tapb7b407a6-85"/>
Jul 24 16:27:22 user nova-compute[70243]:     </interface>
Jul 24 16:27:22 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:27:22 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/console.log" append="off"/>
Jul 24 16:27:22 user nova-compute[70243]:     </serial>
Jul 24 16:27:22 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:27:22 user nova-compute[70243]:     <video>
Jul 24 16:27:22 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:27:22 user nova-compute[70243]:     </video>
Jul 24 16:27:22 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:27:22 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:27:22 user nova-compute[70243]:     </rng>
Jul 24 16:27:22 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:27:22 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:27:22 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:27:22 user nova-compute[70243]:     </memballoon>
Jul 24 16:27:22 user nova-compute[70243]:   </devices>
Jul 24 16:27:22 user nova-compute[70243]: </domain>
Jul 24 16:27:22 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:27:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T16:23:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-81833196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-81833196',id=15,image_ref='9437ed8b-aed0-44ce-a0b8-369ce0e846cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-146229776',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:23:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9fcf70d1092145a2bda67106833fe84d',ramdisk_id='',reservation_id='r-i86lveuw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-372850833',owner_user_name='tempest-AttachVolumeShelveTestJSON-372850833-project-member',shelved_at='2023-07-24T16:25:14.345223',shelved_host='user',shelved_image_id='9437ed8b-aed0-44ce-a0b8-369ce0e846cc'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:27:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62f8a994029a48608bfdcb15f14b2067',uuid=abcd54bc-02d4-4872-8227-43cb93d27491,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "address": "fa:16:3e:11:51:64", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b407a6-85", "ovs_interfaceid": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:27:22 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converting VIF {"id": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "address": "fa:16:3e:11:51:64", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b407a6-85", "ovs_interfaceid": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:27:22 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:51:64,bridge_name='br-int',has_traffic_filtering=True,id=b7b407a6-851a-4096-b6d4-d60d5e1d40d0,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b407a6-85') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:27:22 user nova-compute[70243]: DEBUG os_vif [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:51:64,bridge_name='br-int',has_traffic_filtering=True,id=b7b407a6-851a-4096-b6d4-d60d5e1d40d0,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b407a6-85') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:27:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:27:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:27:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7b407a6-85, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:27:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb7b407a6-85, col_values=(('external_ids', {'iface-id': 'b7b407a6-851a-4096-b6d4-d60d5e1d40d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:51:64', 'vm-uuid': 'abcd54bc-02d4-4872-8227-43cb93d27491'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:27:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:27:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:22 user nova-compute[70243]: INFO os_vif [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:51:64,bridge_name='br-int',has_traffic_filtering=True,id=b7b407a6-851a-4096-b6d4-d60d5e1d40d0,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b407a6-85')
Jul 24 16:27:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:27:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:27:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] No VIF found with MAC fa:16:3e:11:51:64, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:27:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:23 user nova-compute[70243]: DEBUG nova.compute.manager [req-74e50bca-b84c-4e42-913d-4acd2f2648f7 req-25d775e7-d488-4806-8d04-1df01325dc15 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Received event network-vif-plugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-74e50bca-b84c-4e42-913d-4acd2f2648f7 req-25d775e7-d488-4806-8d04-1df01325dc15 service nova] Acquiring lock "4c394c36-5163-4739-964a-7350ee4814ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-74e50bca-b84c-4e42-913d-4acd2f2648f7 req-25d775e7-d488-4806-8d04-1df01325dc15 service nova] Lock "4c394c36-5163-4739-964a-7350ee4814ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-74e50bca-b84c-4e42-913d-4acd2f2648f7 req-25d775e7-d488-4806-8d04-1df01325dc15 service nova] Lock "4c394c36-5163-4739-964a-7350ee4814ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:23 user nova-compute[70243]: DEBUG nova.compute.manager [req-74e50bca-b84c-4e42-913d-4acd2f2648f7 req-25d775e7-d488-4806-8d04-1df01325dc15 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] No waiting events found dispatching network-vif-plugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:27:23 user nova-compute[70243]: WARNING nova.compute.manager [req-74e50bca-b84c-4e42-913d-4acd2f2648f7 req-25d775e7-d488-4806-8d04-1df01325dc15 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Received unexpected event network-vif-plugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 for instance with vm_state building and task_state spawning.
Jul 24 16:27:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:25 user nova-compute[70243]: DEBUG nova.compute.manager [req-91be483e-7ff8-40e1-951b-4db2d0e83b82 req-7f78d246-fe1b-4d9e-8bdc-39b0bb0f9322 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Received event network-vif-plugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-91be483e-7ff8-40e1-951b-4db2d0e83b82 req-7f78d246-fe1b-4d9e-8bdc-39b0bb0f9322 service nova] Acquiring lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-91be483e-7ff8-40e1-951b-4db2d0e83b82 req-7f78d246-fe1b-4d9e-8bdc-39b0bb0f9322 service nova] Lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-91be483e-7ff8-40e1-951b-4db2d0e83b82 req-7f78d246-fe1b-4d9e-8bdc-39b0bb0f9322 service nova] Lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:25 user nova-compute[70243]: DEBUG nova.compute.manager [req-91be483e-7ff8-40e1-951b-4db2d0e83b82 req-7f78d246-fe1b-4d9e-8bdc-39b0bb0f9322 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] No waiting events found dispatching network-vif-plugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:27:25 user nova-compute[70243]: WARNING nova.compute.manager [req-91be483e-7ff8-40e1-951b-4db2d0e83b82 req-7f78d246-fe1b-4d9e-8bdc-39b0bb0f9322 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Received unexpected event network-vif-plugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 24 16:27:25 user nova-compute[70243]: DEBUG nova.compute.manager [req-eaac6f86-7195-4b3a-a3b6-32d5803ec56d req-a1594181-b2b8-4506-a598-63cb543e1155 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Received event network-vif-plugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-eaac6f86-7195-4b3a-a3b6-32d5803ec56d req-a1594181-b2b8-4506-a598-63cb543e1155 service nova] Acquiring lock "4c394c36-5163-4739-964a-7350ee4814ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-eaac6f86-7195-4b3a-a3b6-32d5803ec56d req-a1594181-b2b8-4506-a598-63cb543e1155 service nova] Lock "4c394c36-5163-4739-964a-7350ee4814ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-eaac6f86-7195-4b3a-a3b6-32d5803ec56d req-a1594181-b2b8-4506-a598-63cb543e1155 service nova] Lock "4c394c36-5163-4739-964a-7350ee4814ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:25 user nova-compute[70243]: DEBUG nova.compute.manager [req-eaac6f86-7195-4b3a-a3b6-32d5803ec56d req-a1594181-b2b8-4506-a598-63cb543e1155 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] No waiting events found dispatching network-vif-plugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:27:25 user nova-compute[70243]: WARNING nova.compute.manager [req-eaac6f86-7195-4b3a-a3b6-32d5803ec56d req-a1594181-b2b8-4506-a598-63cb543e1155 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Received unexpected event network-vif-plugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 for instance with vm_state building and task_state spawning.
Jul 24 16:27:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.compute.manager [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216047.3080842, 4c394c36-5163-4739-964a-7350ee4814ae => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:27:27 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] VM Resumed (Lifecycle Event)
Jul 24 16:27:27 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Instance spawned successfully.
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:27:27 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216047.308214, 4c394c36-5163-4739-964a-7350ee4814ae => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:27:27 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] VM Started (Lifecycle Event)
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:27:27 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:27:27 user nova-compute[70243]: INFO nova.compute.manager [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Took 10.42 seconds to spawn the instance on the hypervisor.
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.compute.manager [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:27:27 user nova-compute[70243]: INFO nova.compute.manager [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Took 11.92 seconds to build instance.
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216047.8033, abcd54bc-02d4-4872-8227-43cb93d27491 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:27:27 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] VM Resumed (Lifecycle Event)
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.compute.manager [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.compute.manager [req-44251297-c154-4bf6-bd65-830f338756fb req-22e7adf8-d2e1-4328-aaa0-5d2fcc0de956 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Received event network-vif-plugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-44251297-c154-4bf6-bd65-830f338756fb req-22e7adf8-d2e1-4328-aaa0-5d2fcc0de956 service nova] Acquiring lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-44251297-c154-4bf6-bd65-830f338756fb req-22e7adf8-d2e1-4328-aaa0-5d2fcc0de956 service nova] Lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-44251297-c154-4bf6-bd65-830f338756fb req-22e7adf8-d2e1-4328-aaa0-5d2fcc0de956 service nova] Lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.compute.manager [req-44251297-c154-4bf6-bd65-830f338756fb req-22e7adf8-d2e1-4328-aaa0-5d2fcc0de956 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] No waiting events found dispatching network-vif-plugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:27:27 user nova-compute[70243]: WARNING nova.compute.manager [req-44251297-c154-4bf6-bd65-830f338756fb req-22e7adf8-d2e1-4328-aaa0-5d2fcc0de956 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Received unexpected event network-vif-plugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 24 16:27:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-776d77d4-2c66-460b-923e-108ad1fd22d8 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "4c394c36-5163-4739-964a-7350ee4814ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.083s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:27:27 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Instance spawned successfully.
Jul 24 16:27:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:27:27 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216047.805494, abcd54bc-02d4-4872-8227-43cb93d27491 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:27:27 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] VM Started (Lifecycle Event)
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:27:27 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:27:27 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:27:28 user nova-compute[70243]: DEBUG nova.compute.manager [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:27:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-06e674a9-4e98-4e62-9f83-9af7f150e567 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "abcd54bc-02d4-4872-8227-43cb93d27491" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.453s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:30 user nova-compute[70243]: INFO nova.compute.manager [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Rescuing
Jul 24 16:27:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "refresh_cache-6f2258de-6b31-48af-81df-37b64da4ca99" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:27:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquired lock "refresh_cache-6f2258de-6b31-48af-81df-37b64da4ca99" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:27:30 user nova-compute[70243]: DEBUG nova.network.neutron [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:27:31 user nova-compute[70243]: DEBUG nova.network.neutron [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Updating instance_info_cache with network_info: [{"id": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "address": "fa:16:3e:d4:bf:cd", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a2f7cb-1b", "ovs_interfaceid": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:27:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Releasing lock "refresh_cache-6f2258de-6b31-48af-81df-37b64da4ca99" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:27:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:32 user nova-compute[70243]: DEBUG nova.compute.manager [req-f6d3c542-f1e4-45aa-bc77-1dc3565928ae req-477af8cd-efbc-4b3b-a9a2-d1076682e751 service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Received event network-vif-unplugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f6d3c542-f1e4-45aa-bc77-1dc3565928ae req-477af8cd-efbc-4b3b-a9a2-d1076682e751 service nova] Acquiring lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f6d3c542-f1e4-45aa-bc77-1dc3565928ae req-477af8cd-efbc-4b3b-a9a2-d1076682e751 service nova] Lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f6d3c542-f1e4-45aa-bc77-1dc3565928ae req-477af8cd-efbc-4b3b-a9a2-d1076682e751 service nova] Lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:32 user nova-compute[70243]: DEBUG nova.compute.manager [req-f6d3c542-f1e4-45aa-bc77-1dc3565928ae req-477af8cd-efbc-4b3b-a9a2-d1076682e751 service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] No waiting events found dispatching network-vif-unplugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:27:32 user nova-compute[70243]: WARNING nova.compute.manager [req-f6d3c542-f1e4-45aa-bc77-1dc3565928ae req-477af8cd-efbc-4b3b-a9a2-d1076682e751 service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Received unexpected event network-vif-unplugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 for instance with vm_state active and task_state rescuing.
Jul 24 16:27:32 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:32 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:32 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Instance destroyed successfully.
Jul 24 16:27:32 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Attempting rescue
Jul 24 16:27:32 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70243) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 24 16:27:32 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Instance directory exists: not creating {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 16:27:32 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Creating image(s)
Jul 24 16:27:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "/opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "/opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:32 user nova-compute[70243]: DEBUG nova.objects.instance [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6f2258de-6b31-48af-81df-37b64da4ca99 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:32 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.155s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue" returned: 0 in 0.061s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:32 user nova-compute[70243]: DEBUG nova.objects.instance [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'migration_context' on Instance uuid 6f2258de-6b31-48af-81df-37b64da4ca99 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:32 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:27:32 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Start _get_guest_xml network_info=[{"id": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "address": "fa:16:3e:d4:bf:cd", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "vif_mac": "fa:16:3e:d4:bf:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a2f7cb-1b", "ovs_interfaceid": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.objects.instance [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'resources' on Instance uuid 6f2258de-6b31-48af-81df-37b64da4ca99 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.objects.instance [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'numa_topology' on Instance uuid 6f2258de-6b31-48af-81df-37b64da4ca99 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:33 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:27:33 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.objects.instance [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6f2258de-6b31-48af-81df-37b64da4ca99 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:25:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-394931060',display_name='tempest-ServerRescueNegativeTestJSON-server-394931060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-394931060',id=19,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:25:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c25474ae9fb49cb92c611e77f2dbc79',ramdisk_id='',reservation_id='r-s6khqx0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1414931075',owner_user_name='tempest-ServerRescueNegativeTestJSON-1414931075-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:25:53Z,user_data=None,user_id='fcb7fb5c11bb4d65b9c39923840685c6',uuid=6f2258de-6b31-48af-81df-37b64da4ca99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "address": "fa:16:3e:d4:bf:cd", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "vif_mac": "fa:16:3e:d4:bf:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a2f7cb-1b", "ovs_interfaceid": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converting VIF {"id": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "address": "fa:16:3e:d4:bf:cd", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "vif_mac": "fa:16:3e:d4:bf:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a2f7cb-1b", "ovs_interfaceid": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:bf:cd,bridge_name='br-int',has_traffic_filtering=True,id=38a2f7cb-1b7b-48c1-8bb5-2ae805783d61,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a2f7cb-1b') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.objects.instance [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f2258de-6b31-48af-81df-37b64da4ca99 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:27:33 user nova-compute[70243]:   <uuid>6f2258de-6b31-48af-81df-37b64da4ca99</uuid>
Jul 24 16:27:33 user nova-compute[70243]:   <name>instance-00000013</name>
Jul 24 16:27:33 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:27:33 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:27:33 user nova-compute[70243]:   <metadata>
Jul 24 16:27:33 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:27:33 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:27:33 user nova-compute[70243]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-394931060</nova:name>
Jul 24 16:27:33 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:27:33</nova:creationTime>
Jul 24 16:27:33 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:27:33 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:27:33 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:27:33 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:27:33 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:27:33 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:27:33 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:27:33 user nova-compute[70243]:       <nova:owner>
Jul 24 16:27:33 user nova-compute[70243]:         <nova:user uuid="fcb7fb5c11bb4d65b9c39923840685c6">tempest-ServerRescueNegativeTestJSON-1414931075-project-member</nova:user>
Jul 24 16:27:33 user nova-compute[70243]:         <nova:project uuid="9c25474ae9fb49cb92c611e77f2dbc79">tempest-ServerRescueNegativeTestJSON-1414931075</nova:project>
Jul 24 16:27:33 user nova-compute[70243]:       </nova:owner>
Jul 24 16:27:33 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:27:33 user nova-compute[70243]:       <nova:ports>
Jul 24 16:27:33 user nova-compute[70243]:         <nova:port uuid="38a2f7cb-1b7b-48c1-8bb5-2ae805783d61">
Jul 24 16:27:33 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 24 16:27:33 user nova-compute[70243]:         </nova:port>
Jul 24 16:27:33 user nova-compute[70243]:       </nova:ports>
Jul 24 16:27:33 user nova-compute[70243]:     </nova:instance>
Jul 24 16:27:33 user nova-compute[70243]:   </metadata>
Jul 24 16:27:33 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:27:33 user nova-compute[70243]:     <system>
Jul 24 16:27:33 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:27:33 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:27:33 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:27:33 user nova-compute[70243]:       <entry name="serial">6f2258de-6b31-48af-81df-37b64da4ca99</entry>
Jul 24 16:27:33 user nova-compute[70243]:       <entry name="uuid">6f2258de-6b31-48af-81df-37b64da4ca99</entry>
Jul 24 16:27:33 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:27:33 user nova-compute[70243]:     </system>
Jul 24 16:27:33 user nova-compute[70243]:   </sysinfo>
Jul 24 16:27:33 user nova-compute[70243]:   <os>
Jul 24 16:27:33 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:27:33 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:27:33 user nova-compute[70243]:   </os>
Jul 24 16:27:33 user nova-compute[70243]:   <features>
Jul 24 16:27:33 user nova-compute[70243]:     <acpi/>
Jul 24 16:27:33 user nova-compute[70243]:     <apic/>
Jul 24 16:27:33 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:27:33 user nova-compute[70243]:   </features>
Jul 24 16:27:33 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:27:33 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:27:33 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:27:33 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:27:33 user nova-compute[70243]:   </clock>
Jul 24 16:27:33 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:27:33 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:27:33 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:27:33 user nova-compute[70243]:   </cpu>
Jul 24 16:27:33 user nova-compute[70243]:   <devices>
Jul 24 16:27:33 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:27:33 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:27:33 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue"/>
Jul 24 16:27:33 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:27:33 user nova-compute[70243]:     </disk>
Jul 24 16:27:33 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:27:33 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:27:33 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk"/>
Jul 24 16:27:33 user nova-compute[70243]:       <target dev="vdb" bus="virtio"/>
Jul 24 16:27:33 user nova-compute[70243]:     </disk>
Jul 24 16:27:33 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:27:33 user nova-compute[70243]:       <mac address="fa:16:3e:d4:bf:cd"/>
Jul 24 16:27:33 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:27:33 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:27:33 user nova-compute[70243]:       <target dev="tap38a2f7cb-1b"/>
Jul 24 16:27:33 user nova-compute[70243]:     </interface>
Jul 24 16:27:33 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:27:33 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/console.log" append="off"/>
Jul 24 16:27:33 user nova-compute[70243]:     </serial>
Jul 24 16:27:33 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:27:33 user nova-compute[70243]:     <video>
Jul 24 16:27:33 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:27:33 user nova-compute[70243]:     </video>
Jul 24 16:27:33 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:27:33 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:27:33 user nova-compute[70243]:     </rng>
Jul 24 16:27:33 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:27:33 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:27:33 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:27:33 user nova-compute[70243]:     </memballoon>
Jul 24 16:27:33 user nova-compute[70243]:   </devices>
Jul 24 16:27:33 user nova-compute[70243]: </domain>
Jul 24 16:27:33 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:27:33 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Instance destroyed successfully.
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] No VIF found with MAC fa:16:3e:d4:bf:cd, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.compute.manager [req-e5ae40f6-839d-4c4f-8842-c33ce5dcd7f7 req-fee7cb04-702e-4967-80f3-5db1ea7c9a21 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Received event network-changed-d441139a-506e-44b6-9bea-0825befacf40 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.compute.manager [req-e5ae40f6-839d-4c4f-8842-c33ce5dcd7f7 req-fee7cb04-702e-4967-80f3-5db1ea7c9a21 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Refreshing instance network info cache due to event network-changed-d441139a-506e-44b6-9bea-0825befacf40. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e5ae40f6-839d-4c4f-8842-c33ce5dcd7f7 req-fee7cb04-702e-4967-80f3-5db1ea7c9a21 service nova] Acquiring lock "refresh_cache-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e5ae40f6-839d-4c4f-8842-c33ce5dcd7f7 req-fee7cb04-702e-4967-80f3-5db1ea7c9a21 service nova] Acquired lock "refresh_cache-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:27:33 user nova-compute[70243]: DEBUG nova.network.neutron [req-e5ae40f6-839d-4c4f-8842-c33ce5dcd7f7 req-fee7cb04-702e-4967-80f3-5db1ea7c9a21 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Refreshing network info cache for port d441139a-506e-44b6-9bea-0825befacf40 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:27:34 user nova-compute[70243]: DEBUG nova.compute.manager [req-77971635-4844-4c2f-b4e6-a6f95335e990 req-e9b789d7-0465-4c99-96d7-21d99c39e012 service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Received event network-vif-plugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-77971635-4844-4c2f-b4e6-a6f95335e990 req-e9b789d7-0465-4c99-96d7-21d99c39e012 service nova] Acquiring lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-77971635-4844-4c2f-b4e6-a6f95335e990 req-e9b789d7-0465-4c99-96d7-21d99c39e012 service nova] Lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-77971635-4844-4c2f-b4e6-a6f95335e990 req-e9b789d7-0465-4c99-96d7-21d99c39e012 service nova] Lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:34 user nova-compute[70243]: DEBUG nova.compute.manager [req-77971635-4844-4c2f-b4e6-a6f95335e990 req-e9b789d7-0465-4c99-96d7-21d99c39e012 service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] No waiting events found dispatching network-vif-plugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:27:34 user nova-compute[70243]: WARNING nova.compute.manager [req-77971635-4844-4c2f-b4e6-a6f95335e990 req-e9b789d7-0465-4c99-96d7-21d99c39e012 service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Received unexpected event network-vif-plugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 for instance with vm_state active and task_state rescuing.
Jul 24 16:27:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Acquiring lock "interface-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "interface-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:34 user nova-compute[70243]: DEBUG nova.objects.instance [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lazy-loading 'flavor' on Instance uuid 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:34 user nova-compute[70243]: DEBUG nova.network.neutron [req-e5ae40f6-839d-4c4f-8842-c33ce5dcd7f7 req-fee7cb04-702e-4967-80f3-5db1ea7c9a21 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Updated VIF entry in instance network info cache for port d441139a-506e-44b6-9bea-0825befacf40. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:27:34 user nova-compute[70243]: DEBUG nova.network.neutron [req-e5ae40f6-839d-4c4f-8842-c33ce5dcd7f7 req-fee7cb04-702e-4967-80f3-5db1ea7c9a21 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Updating instance_info_cache with network_info: [{"id": "d441139a-506e-44b6-9bea-0825befacf40", "address": "fa:16:3e:61:2d:32", "network": {"id": "99dd3690-f380-4199-b2cd-a871694533f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1380968726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd441139a-50", "ovs_interfaceid": "d441139a-506e-44b6-9bea-0825befacf40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:27:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e5ae40f6-839d-4c4f-8842-c33ce5dcd7f7 req-fee7cb04-702e-4967-80f3-5db1ea7c9a21 service nova] Releasing lock "refresh_cache-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:27:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:34 user nova-compute[70243]: DEBUG nova.objects.instance [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lazy-loading 'pci_requests' on Instance uuid 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:34 user nova-compute[70243]: DEBUG nova.network.neutron [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:27:34 user nova-compute[70243]: DEBUG nova.policy [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '695787042f9f4e4eb0997bf72d169913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d8ae9e361c4588ac564ac242dcab21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "ad611655-ba4d-4a66-b78e-a82c058f4414" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:35 user nova-compute[70243]: INFO nova.compute.manager [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Terminating instance
Jul 24 16:27:35 user nova-compute[70243]: DEBUG nova.compute.manager [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-0b1ce10d-9e23-48ef-8263-8e0e8d1f784f req-9899e76b-6cb3-4854-8551-b48fc64dad6f service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received event network-vif-unplugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0b1ce10d-9e23-48ef-8263-8e0e8d1f784f req-9899e76b-6cb3-4854-8551-b48fc64dad6f service nova] Acquiring lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0b1ce10d-9e23-48ef-8263-8e0e8d1f784f req-9899e76b-6cb3-4854-8551-b48fc64dad6f service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0b1ce10d-9e23-48ef-8263-8e0e8d1f784f req-9899e76b-6cb3-4854-8551-b48fc64dad6f service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-0b1ce10d-9e23-48ef-8263-8e0e8d1f784f req-9899e76b-6cb3-4854-8551-b48fc64dad6f service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] No waiting events found dispatching network-vif-unplugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-0b1ce10d-9e23-48ef-8263-8e0e8d1f784f req-9899e76b-6cb3-4854-8551-b48fc64dad6f service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received event network-vif-unplugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:27:35 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Instance destroyed successfully.
Jul 24 16:27:35 user nova-compute[70243]: DEBUG nova.objects.instance [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'resources' on Instance uuid ad611655-ba4d-4a66-b78e-a82c058f4414 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1592531500',display_name='tempest-AttachVolumeTestJSON-server-1592531500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1592531500',id=5,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyqJB6onbLaD2r1QfVtdarKDSnujLrUpKPczrv1sRKzUEbnqnXysxM1e2pVM0BKjCFI6X1To86Tx81MPL8yxdaUKlyWRVQ/8A7Y/aJ/EGuRxG0ZYo3tQwvjAcenmDrEEg==',key_name='tempest-keypair-810229109',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:18:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d099632b940545b9bbe000e5cc323ec1',ramdisk_id='',reservation_id='r-6lakmpdh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1836925262',owner_user_name='tempest-AttachVolumeTestJSON-1836925262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:25:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7de0cd9dd23d4569939884728bde772c',uuid=ad611655-ba4d-4a66-b78e-a82c058f4414,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converting VIF {"id": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "address": "fa:16:3e:0e:d8:8a", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8e7d11-46", "ovs_interfaceid": "ef8e7d11-464b-421b-bfc9-0d5a17f610d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:d8:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef8e7d11-464b-421b-bfc9-0d5a17f610d4,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8e7d11-46') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG os_vif [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:d8:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef8e7d11-464b-421b-bfc9-0d5a17f610d4,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8e7d11-46') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef8e7d11-46, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:27:35 user nova-compute[70243]: INFO os_vif [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:d8:8a,bridge_name='br-int',has_traffic_filtering=True,id=ef8e7d11-464b-421b-bfc9-0d5a17f610d4,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8e7d11-46')
Jul 24 16:27:35 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Deleting instance files /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414_del
Jul 24 16:27:35 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Deletion of /opt/stack/data/nova/instances/ad611655-ba4d-4a66-b78e-a82c058f4414_del complete
Jul 24 16:27:36 user nova-compute[70243]: INFO nova.compute.manager [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Took 1.00 seconds to destroy the instance on the hypervisor.
Jul 24 16:27:36 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:27:36 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:27:36 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:27:36 user nova-compute[70243]: DEBUG nova.compute.manager [req-327b69df-a58c-4f01-8270-9aaaf97b0a53 req-1a55b558-2812-44d4-9c3d-6ea91a9efec6 service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Received event network-vif-plugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-327b69df-a58c-4f01-8270-9aaaf97b0a53 req-1a55b558-2812-44d4-9c3d-6ea91a9efec6 service nova] Acquiring lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-327b69df-a58c-4f01-8270-9aaaf97b0a53 req-1a55b558-2812-44d4-9c3d-6ea91a9efec6 service nova] Lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-327b69df-a58c-4f01-8270-9aaaf97b0a53 req-1a55b558-2812-44d4-9c3d-6ea91a9efec6 service nova] Lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:36 user nova-compute[70243]: DEBUG nova.compute.manager [req-327b69df-a58c-4f01-8270-9aaaf97b0a53 req-1a55b558-2812-44d4-9c3d-6ea91a9efec6 service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] No waiting events found dispatching network-vif-plugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:27:36 user nova-compute[70243]: WARNING nova.compute.manager [req-327b69df-a58c-4f01-8270-9aaaf97b0a53 req-1a55b558-2812-44d4-9c3d-6ea91a9efec6 service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Received unexpected event network-vif-plugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 for instance with vm_state active and task_state rescuing.
Jul 24 16:27:36 user nova-compute[70243]: DEBUG nova.compute.manager [req-327b69df-a58c-4f01-8270-9aaaf97b0a53 req-1a55b558-2812-44d4-9c3d-6ea91a9efec6 service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Received event network-vif-plugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-327b69df-a58c-4f01-8270-9aaaf97b0a53 req-1a55b558-2812-44d4-9c3d-6ea91a9efec6 service nova] Acquiring lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-327b69df-a58c-4f01-8270-9aaaf97b0a53 req-1a55b558-2812-44d4-9c3d-6ea91a9efec6 service nova] Lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-327b69df-a58c-4f01-8270-9aaaf97b0a53 req-1a55b558-2812-44d4-9c3d-6ea91a9efec6 service nova] Lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:36 user nova-compute[70243]: DEBUG nova.compute.manager [req-327b69df-a58c-4f01-8270-9aaaf97b0a53 req-1a55b558-2812-44d4-9c3d-6ea91a9efec6 service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] No waiting events found dispatching network-vif-plugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:27:36 user nova-compute[70243]: WARNING nova.compute.manager [req-327b69df-a58c-4f01-8270-9aaaf97b0a53 req-1a55b558-2812-44d4-9c3d-6ea91a9efec6 service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Received unexpected event network-vif-plugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 for instance with vm_state active and task_state rescuing.
Jul 24 16:27:36 user nova-compute[70243]: DEBUG nova.network.neutron [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Successfully created port: 72e59011-e2ab-4330-8826-c5de17daf617 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:27:37 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:27:37 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Took 1.24 seconds to deallocate network for instance.
Jul 24 16:27:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Removed pending event for 6f2258de-6b31-48af-81df-37b64da4ca99 due to event {{(pid=70243) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 16:27:37 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216057.4302511, 6f2258de-6b31-48af-81df-37b64da4ca99 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:27:37 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] VM Resumed (Lifecycle Event)
Jul 24 16:27:37 user nova-compute[70243]: DEBUG nova.compute.manager [None req-4f0deb08-de80-42dc-9753-ed29c454f019 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:27:37 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:27:37 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:27:37 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 24 16:27:37 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216057.4311643, 6f2258de-6b31-48af-81df-37b64da4ca99 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:27:37 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] VM Started (Lifecycle Event)
Jul 24 16:27:37 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:27:37 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:27:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-7c9654f9-fc6f-4afa-b9de-19cc8c85082b req-b39bcbe0-9dee-4564-841e-d6bc8fbc13fb service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received event network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7c9654f9-fc6f-4afa-b9de-19cc8c85082b req-b39bcbe0-9dee-4564-841e-d6bc8fbc13fb service nova] Acquiring lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7c9654f9-fc6f-4afa-b9de-19cc8c85082b req-b39bcbe0-9dee-4564-841e-d6bc8fbc13fb service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7c9654f9-fc6f-4afa-b9de-19cc8c85082b req-b39bcbe0-9dee-4564-841e-d6bc8fbc13fb service nova] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-7c9654f9-fc6f-4afa-b9de-19cc8c85082b req-b39bcbe0-9dee-4564-841e-d6bc8fbc13fb service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] No waiting events found dispatching network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:27:37 user nova-compute[70243]: WARNING nova.compute.manager [req-7c9654f9-fc6f-4afa-b9de-19cc8c85082b req-b39bcbe0-9dee-4564-841e-d6bc8fbc13fb service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received unexpected event network-vif-plugged-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 for instance with vm_state deleted and task_state None.
Jul 24 16:27:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-7c9654f9-fc6f-4afa-b9de-19cc8c85082b req-b39bcbe0-9dee-4564-841e-d6bc8fbc13fb service nova] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Received event network-vif-deleted-ef8e7d11-464b-421b-bfc9-0d5a17f610d4 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:37 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:27:37 user nova-compute[70243]: DEBUG nova.network.neutron [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Successfully updated port: 72e59011-e2ab-4330-8826-c5de17daf617 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:27:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Acquiring lock "refresh_cache-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:27:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Acquired lock "refresh_cache-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:27:37 user nova-compute[70243]: DEBUG nova.network.neutron [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:27:37 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:27:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:37 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Deleted allocations for instance ad611655-ba4d-4a66-b78e-a82c058f4414
Jul 24 16:27:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-505be213-5b0d-4a9c-8520-3a699ab371da tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "ad611655-ba4d-4a66-b78e-a82c058f4414" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.012s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:38 user nova-compute[70243]: DEBUG nova.network.neutron [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Updating instance_info_cache with network_info: [{"id": "d441139a-506e-44b6-9bea-0825befacf40", "address": "fa:16:3e:61:2d:32", "network": {"id": "99dd3690-f380-4199-b2cd-a871694533f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1380968726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd441139a-50", "ovs_interfaceid": "d441139a-506e-44b6-9bea-0825befacf40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72e59011-e2ab-4330-8826-c5de17daf617", "address": "fa:16:3e:c4:dd:3e", "network": {"id": "86683aa8-6178-4e82-add6-ad9ae6b723ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2084262809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e59011-e2", "ovs_interfaceid": "72e59011-e2ab-4330-8826-c5de17daf617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:27:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Releasing lock "refresh_cache-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:27:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:25:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-305165087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-305165087',id=20,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqr4Sb1YiAbSsHxY/YCQVoIvx0BtmisaU3JoqCzarQMjncCNKMWQUfzzjinb/WTtTYj0jaZsWe6GxxviHHKByoit7MC06BJwyYNp7QiEzsbdQ26xq1MPIO2FeXV/7igXw==',key_name='tempest-keypair-751084804',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:25:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='21d8ae9e361c4588ac564ac242dcab21',ramdisk_id='',reservation_id='r-kztppkde',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-130428048',owner_user_name='tempest-TaggedAttachmentsTest-130428048-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:25:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='695787042f9f4e4eb0997bf72d169913',uuid=9e4e0f20-5488-44ce-ac82-e0e77b8a3e30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72e59011-e2ab-4330-8826-c5de17daf617", "address": "fa:16:3e:c4:dd:3e", "network": {"id": "86683aa8-6178-4e82-add6-ad9ae6b723ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2084262809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e59011-e2", "ovs_interfaceid": "72e59011-e2ab-4330-8826-c5de17daf617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:27:38 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Converting VIF {"id": "72e59011-e2ab-4330-8826-c5de17daf617", "address": "fa:16:3e:c4:dd:3e", "network": {"id": "86683aa8-6178-4e82-add6-ad9ae6b723ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2084262809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e59011-e2", "ovs_interfaceid": "72e59011-e2ab-4330-8826-c5de17daf617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:27:38 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:dd:3e,bridge_name='br-int',has_traffic_filtering=True,id=72e59011-e2ab-4330-8826-c5de17daf617,network=Network(86683aa8-6178-4e82-add6-ad9ae6b723ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e59011-e2') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:27:38 user nova-compute[70243]: DEBUG os_vif [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:dd:3e,bridge_name='br-int',has_traffic_filtering=True,id=72e59011-e2ab-4330-8826-c5de17daf617,network=Network(86683aa8-6178-4e82-add6-ad9ae6b723ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e59011-e2') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:27:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:27:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:27:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72e59011-e2, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:27:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72e59011-e2, col_values=(('external_ids', {'iface-id': '72e59011-e2ab-4330-8826-c5de17daf617', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:dd:3e', 'vm-uuid': '9e4e0f20-5488-44ce-ac82-e0e77b8a3e30'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:27:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:27:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:38 user nova-compute[70243]: INFO os_vif [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:dd:3e,bridge_name='br-int',has_traffic_filtering=True,id=72e59011-e2ab-4330-8826-c5de17daf617,network=Network(86683aa8-6178-4e82-add6-ad9ae6b723ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e59011-e2')
Jul 24 16:27:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:25:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-305165087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-305165087',id=20,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqr4Sb1YiAbSsHxY/YCQVoIvx0BtmisaU3JoqCzarQMjncCNKMWQUfzzjinb/WTtTYj0jaZsWe6GxxviHHKByoit7MC06BJwyYNp7QiEzsbdQ26xq1MPIO2FeXV/7igXw==',key_name='tempest-keypair-751084804',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:25:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='21d8ae9e361c4588ac564ac242dcab21',ramdisk_id='',reservation_id='r-kztppkde',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-130428048',owner_user_name='tempest-TaggedAttachmentsTest-130428048-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:25:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='695787042f9f4e4eb0997bf72d169913',uuid=9e4e0f20-5488-44ce-ac82-e0e77b8a3e30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72e59011-e2ab-4330-8826-c5de17daf617", "address": "fa:16:3e:c4:dd:3e", "network": {"id": "86683aa8-6178-4e82-add6-ad9ae6b723ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2084262809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e59011-e2", "ovs_interfaceid": "72e59011-e2ab-4330-8826-c5de17daf617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:27:38 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Converting VIF {"id": "72e59011-e2ab-4330-8826-c5de17daf617", "address": "fa:16:3e:c4:dd:3e", "network": {"id": "86683aa8-6178-4e82-add6-ad9ae6b723ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2084262809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e59011-e2", "ovs_interfaceid": "72e59011-e2ab-4330-8826-c5de17daf617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:27:38 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:dd:3e,bridge_name='br-int',has_traffic_filtering=True,id=72e59011-e2ab-4330-8826-c5de17daf617,network=Network(86683aa8-6178-4e82-add6-ad9ae6b723ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e59011-e2') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:27:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] attach device xml: <interface type="ethernet">
Jul 24 16:27:38 user nova-compute[70243]:   <mac address="fa:16:3e:c4:dd:3e"/>
Jul 24 16:27:38 user nova-compute[70243]:   <model type="virtio"/>
Jul 24 16:27:38 user nova-compute[70243]:   <mtu size="1442"/>
Jul 24 16:27:38 user nova-compute[70243]:   <target dev="tap72e59011-e2"/>
Jul 24 16:27:38 user nova-compute[70243]: </interface>
Jul 24 16:27:38 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:27:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG nova.compute.manager [req-abbba03b-0db9-4a53-8dd4-3a25c5445e9f req-75e14c8d-14ad-46ca-a5d1-b1020a4b3af5 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Received event network-vif-plugged-72e59011-e2ab-4330-8826-c5de17daf617 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-abbba03b-0db9-4a53-8dd4-3a25c5445e9f req-75e14c8d-14ad-46ca-a5d1-b1020a4b3af5 service nova] Acquiring lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-abbba03b-0db9-4a53-8dd4-3a25c5445e9f req-75e14c8d-14ad-46ca-a5d1-b1020a4b3af5 service nova] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-abbba03b-0db9-4a53-8dd4-3a25c5445e9f req-75e14c8d-14ad-46ca-a5d1-b1020a4b3af5 service nova] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG nova.compute.manager [req-abbba03b-0db9-4a53-8dd4-3a25c5445e9f req-75e14c8d-14ad-46ca-a5d1-b1020a4b3af5 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] No waiting events found dispatching network-vif-plugged-72e59011-e2ab-4330-8826-c5de17daf617 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:27:39 user nova-compute[70243]: WARNING nova.compute.manager [req-abbba03b-0db9-4a53-8dd4-3a25c5445e9f req-75e14c8d-14ad-46ca-a5d1-b1020a4b3af5 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Received unexpected event network-vif-plugged-72e59011-e2ab-4330-8826-c5de17daf617 for instance with vm_state active and task_state None.
Jul 24 16:27:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] No BDM found with device name hda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] No VIF found with MAC fa:16:3e:61:2d:32, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:27:39 user nova-compute[70243]:   <nova:package version="0.0.0"/>
Jul 24 16:27:39 user nova-compute[70243]:   <nova:name>tempest-device-tagging-server-305165087</nova:name>
Jul 24 16:27:39 user nova-compute[70243]:   <nova:creationTime>2023-07-24 16:27:39</nova:creationTime>
Jul 24 16:27:39 user nova-compute[70243]:   <nova:flavor name="m1.tiny">
Jul 24 16:27:39 user nova-compute[70243]:     <nova:memory>512</nova:memory>
Jul 24 16:27:39 user nova-compute[70243]:     <nova:disk>1</nova:disk>
Jul 24 16:27:39 user nova-compute[70243]:     <nova:swap>0</nova:swap>
Jul 24 16:27:39 user nova-compute[70243]:     <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:27:39 user nova-compute[70243]:     <nova:vcpus>1</nova:vcpus>
Jul 24 16:27:39 user nova-compute[70243]:   </nova:flavor>
Jul 24 16:27:39 user nova-compute[70243]:   <nova:owner>
Jul 24 16:27:39 user nova-compute[70243]:     <nova:user uuid="695787042f9f4e4eb0997bf72d169913">tempest-TaggedAttachmentsTest-130428048-project-member</nova:user>
Jul 24 16:27:39 user nova-compute[70243]:     <nova:project uuid="21d8ae9e361c4588ac564ac242dcab21">tempest-TaggedAttachmentsTest-130428048</nova:project>
Jul 24 16:27:39 user nova-compute[70243]:   </nova:owner>
Jul 24 16:27:39 user nova-compute[70243]:   <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:27:39 user nova-compute[70243]:   <nova:ports>
Jul 24 16:27:39 user nova-compute[70243]:     <nova:port uuid="d441139a-506e-44b6-9bea-0825befacf40">
Jul 24 16:27:39 user nova-compute[70243]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 24 16:27:39 user nova-compute[70243]:     </nova:port>
Jul 24 16:27:39 user nova-compute[70243]:     <nova:port uuid="72e59011-e2ab-4330-8826-c5de17daf617">
Jul 24 16:27:39 user nova-compute[70243]:       <nova:ip type="fixed" address="10.10.10.86" ipVersion="4"/>
Jul 24 16:27:39 user nova-compute[70243]:     </nova:port>
Jul 24 16:27:39 user nova-compute[70243]:   </nova:ports>
Jul 24 16:27:39 user nova-compute[70243]: </nova:instance>
Jul 24 16:27:39 user nova-compute[70243]:  {{(pid=70243) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-84ab88d8-47d1-4099-960e-6e16ea7b189f tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "interface-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.850s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG nova.compute.manager [req-b91aa3b1-b5e0-473e-9499-ad37687e718c req-7cdf948a-016e-4198-9d50-8317b253d3b9 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Received event network-changed-72e59011-e2ab-4330-8826-c5de17daf617 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG nova.compute.manager [req-b91aa3b1-b5e0-473e-9499-ad37687e718c req-7cdf948a-016e-4198-9d50-8317b253d3b9 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Refreshing instance network info cache due to event network-changed-72e59011-e2ab-4330-8826-c5de17daf617. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b91aa3b1-b5e0-473e-9499-ad37687e718c req-7cdf948a-016e-4198-9d50-8317b253d3b9 service nova] Acquiring lock "refresh_cache-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b91aa3b1-b5e0-473e-9499-ad37687e718c req-7cdf948a-016e-4198-9d50-8317b253d3b9 service nova] Acquired lock "refresh_cache-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG nova.network.neutron [req-b91aa3b1-b5e0-473e-9499-ad37687e718c req-7cdf948a-016e-4198-9d50-8317b253d3b9 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Refreshing network info cache for port 72e59011-e2ab-4330-8826-c5de17daf617 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Acquiring lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG nova.objects.instance [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lazy-loading 'flavor' on Instance uuid 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Acquiring lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:40 user nova-compute[70243]: INFO nova.compute.manager [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Attaching volume e251afc8-4641-42ad-af35-3667cbce69ba to /dev/vdb
Jul 24 16:27:40 user nova-compute[70243]: DEBUG os_brick.utils [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9d3a09-60c1-4144-b54f-b4919b3bdea8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[514e6f57-563f-4b1d-bcc9-54d90094a409]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4ab8d7-9755-485e-8a93-8b0001ee790b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a13782-a364-4cb9-82df-f700159a5b4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG nova.network.neutron [req-b91aa3b1-b5e0-473e-9499-ad37687e718c req-7cdf948a-016e-4198-9d50-8317b253d3b9 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Updated VIF entry in instance network info cache for port 72e59011-e2ab-4330-8826-c5de17daf617. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG nova.network.neutron [req-b91aa3b1-b5e0-473e-9499-ad37687e718c req-7cdf948a-016e-4198-9d50-8317b253d3b9 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Updating instance_info_cache with network_info: [{"id": "d441139a-506e-44b6-9bea-0825befacf40", "address": "fa:16:3e:61:2d:32", "network": {"id": "99dd3690-f380-4199-b2cd-a871694533f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1380968726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd441139a-50", "ovs_interfaceid": "d441139a-506e-44b6-9bea-0825befacf40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72e59011-e2ab-4330-8826-c5de17daf617", "address": "fa:16:3e:c4:dd:3e", "network": {"id": "86683aa8-6178-4e82-add6-ad9ae6b723ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2084262809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e59011-e2", "ovs_interfaceid": "72e59011-e2ab-4330-8826-c5de17daf617", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:27:40 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:27:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15825eb-dedf-4ca7-a70f-aa6cbb69411a]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG os_brick.utils [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Updating existing volume attachment record: 6573cf18-f8b1-4759-8833-b551fd68bfb9 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:27:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b91aa3b1-b5e0-473e-9499-ad37687e718c req-7cdf948a-016e-4198-9d50-8317b253d3b9 service nova] Releasing lock "refresh_cache-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:27:41 user nova-compute[70243]: DEBUG nova.compute.manager [req-74fb1757-662b-4ac8-953b-daf3b72b9363 req-5deb9063-2e06-4a94-910d-5b75bee6148d service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Received event network-vif-plugged-72e59011-e2ab-4330-8826-c5de17daf617 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-74fb1757-662b-4ac8-953b-daf3b72b9363 req-5deb9063-2e06-4a94-910d-5b75bee6148d service nova] Acquiring lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-74fb1757-662b-4ac8-953b-daf3b72b9363 req-5deb9063-2e06-4a94-910d-5b75bee6148d service nova] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-74fb1757-662b-4ac8-953b-daf3b72b9363 req-5deb9063-2e06-4a94-910d-5b75bee6148d service nova] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:41 user nova-compute[70243]: DEBUG nova.compute.manager [req-74fb1757-662b-4ac8-953b-daf3b72b9363 req-5deb9063-2e06-4a94-910d-5b75bee6148d service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] No waiting events found dispatching network-vif-plugged-72e59011-e2ab-4330-8826-c5de17daf617 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:27:41 user nova-compute[70243]: WARNING nova.compute.manager [req-74fb1757-662b-4ac8-953b-daf3b72b9363 req-5deb9063-2e06-4a94-910d-5b75bee6148d service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Received unexpected event network-vif-plugged-72e59011-e2ab-4330-8826-c5de17daf617 for instance with vm_state active and task_state None.
Jul 24 16:27:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:46 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:27:46 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:27:46 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:27:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:27:48 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:27:48 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:27:48 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:27:48 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:27:48 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:27:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:48 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:27:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:27:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a84c738-68d3-463f-8cb4-170be05abbdf/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a84c738-68d3-463f-8cb4-170be05abbdf/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a84c738-68d3-463f-8cb4-170be05abbdf/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a84c738-68d3-463f-8cb4-170be05abbdf/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKurVTCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:27:50 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:27:50 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:27:50 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df71c73-9f30-4893-be7f-5edd0e4692a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:27:50 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[672a189e-6bc4-4fb9-8510-4ab109055e8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba] added
Jul 24 16:27:50 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c1fe7f-5be5-4fce-89db-ba3df3c09728]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce59cdf-3979-4891-bd1f-4ce067daba95]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKurVTCZ {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKurVTCZ" returned: 0 in 0.028s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d964ecf0-f46b-4fc6-85bc-faa1426b23f3]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zKurVTCZ'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67af040-1a59-4c1c-88b1-21ca1a7f530a]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1065cba-8b0c-4d6f-b50b-4c518ff2b862]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:27:50 user nova-compute[70243]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:27:50 user nova-compute[70243]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)
Jul 24 16:27:50 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:27:50 user nova-compute[70243]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:27:50 user nova-compute[70243]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)
Jul 24 16:27:50 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[aceea595-805b-4d48-8062-f48e9abb1552]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba, portal: 172.16.0.220,3260]
Jul 24 16:27:50 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba, portal: 172.16.0.220,3260] successful.
Jul 24 16:27:50 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[215bde48-0007-4232-9412-578825223e42]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[df029759-0d23-4289-99d5-9bf200af5d19]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:27:50 user nova-compute[70243]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:27:50 user nova-compute[70243]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)
Jul 24 16:27:50 user nova-compute[70243]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba (non-flash)
Jul 24 16:27:50 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:27:50 user nova-compute[70243]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:27:50 user nova-compute[70243]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)
Jul 24 16:27:50 user nova-compute[70243]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba (non-flash)
Jul 24 16:27:50 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.413s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[db207f26-f895-4ff9-9cbb-9c21e375807d]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKurVTCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:50 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216055.8694856, ad611655-ba4d-4a66-b78e-a82c058f4414 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:27:50 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] VM Stopped (Lifecycle Event)
Jul 24 16:27:50 user nova-compute[70243]: DEBUG nova.compute.manager [None req-534a4d2d-cb86-4b6d-b534-0035ac21613c None None] [instance: ad611655-ba4d-4a66-b78e-a82c058f4414] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:27:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.472s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:27:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] <== connect_volume: return (1477ms) {'type': 'block', 'scsi_wwn': '23763333930623330', 'path': '/dev/sde'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:27:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763333930623330', 'path': '/dev/sde'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:27:51 user nova-compute[70243]: DEBUG nova.objects.instance [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lazy-loading 'flavor' on Instance uuid 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:27:51 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:27:51 user nova-compute[70243]:   <source dev="/dev/sde"/>
Jul 24 16:27:51 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:27:51 user nova-compute[70243]:   <serial>e251afc8-4641-42ad-af35-3667cbce69ba</serial>
Jul 24 16:27:51 user nova-compute[70243]: </disk>
Jul 24 16:27:51 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:27:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:52 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:27:52 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:27:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=7350MB free_disk=24.307571411132812GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:27:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:27:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] No BDM found with device name hda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:27:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] No VIF found with MAC fa:16:3e:61:2d:32, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:27:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance de22ea98-b041-4f3f-8986-435c43267a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:27:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:27:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 50fecb3a-8f06-4822-8c84-76df51acfe50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:27:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6f2258de-6b31-48af-81df-37b64da4ca99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:27:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:27:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6ed1935d-3a60-418e-bc44-ed65452afc1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:27:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance abcd54bc-02d4-4872-8227-43cb93d27491 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:27:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5a84c738-68d3-463f-8cb4-170be05abbdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:27:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 4c394c36-5163-4739-964a-7350ee4814ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:27:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:27:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:27:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cf6303fe-dc37-4c7f-994f-e576f1a2c66a tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.506s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:53 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:27:53 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:27:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:27:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.629s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Acquiring lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:54 user nova-compute[70243]: INFO nova.compute.manager [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Detaching volume e251afc8-4641-42ad-af35-3667cbce69ba
Jul 24 16:27:54 user nova-compute[70243]: INFO nova.virt.block_device [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Attempting to driver detach volume e251afc8-4641-42ad-af35-3667cbce69ba from mountpoint /dev/vdb
Jul 24 16:27:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Attempting to detach device vdb from instance 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:27:54 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:27:54 user nova-compute[70243]:   <source dev="/dev/sde"/>
Jul 24 16:27:54 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:27:54 user nova-compute[70243]:   <serial>e251afc8-4641-42ad-af35-3667cbce69ba</serial>
Jul 24 16:27:54 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 24 16:27:54 user nova-compute[70243]: </disk>
Jul 24 16:27:54 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:27:54 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Successfully detached device vdb from instance 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 from the persistent domain config.
Jul 24 16:27:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:27:54 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:27:54 user nova-compute[70243]:   <source dev="/dev/sde"/>
Jul 24 16:27:54 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:27:54 user nova-compute[70243]:   <serial>e251afc8-4641-42ad-af35-3667cbce69ba</serial>
Jul 24 16:27:54 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 24 16:27:54 user nova-compute[70243]: </disk>
Jul 24 16:27:54 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690216074.843687, 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:27:54 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Successfully detached device vdb from instance 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 from the live domain config.
Jul 24 16:27:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKurVTCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:27:54 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:27:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cfe5bd-2fb0-4e00-a474-3001a8a35ce3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:27:54 user nova-compute[70243]: No targets found.
Jul 24 16:27:54 user nova-compute[70243]: iSNS:
Jul 24 16:27:54 user nova-compute[70243]: No targets found.
Jul 24 16:27:54 user nova-compute[70243]: STATIC:
Jul 24 16:27:54 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8
Jul 24 16:27:54 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:27:54 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:27:54 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3
Jul 24 16:27:54 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:27:54 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:27:54 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba
Jul 24 16:27:54 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:27:54 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:27:54 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c
Jul 24 16:27:54 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:27:54 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:27:54 user nova-compute[70243]: FIRMWARE:
Jul 24 16:27:54 user nova-compute[70243]: No targets found.
Jul 24 16:27:54 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:27:54 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:27:54 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0276d24d-6a07-4f98-9c25-f4c7c7aaf3fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c40393-68c9-419c-be68-08c188136ffb]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:27:54 user nova-compute[70243]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:27:54 user nova-compute[70243]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)
Jul 24 16:27:54 user nova-compute[70243]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba (non-flash)
Jul 24 16:27:54 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:27:54 user nova-compute[70243]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:27:54 user nova-compute[70243]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)
Jul 24 16:27:54 user nova-compute[70243]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba (non-flash)
Jul 24 16:27:54 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc13e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba'): ({'sde'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Removing single pathed devices sde {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc711855-1cc4-483b-9d3c-04c57428e8e4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8d4c2b-d3a6-47f6-a870-964cd38c1f09]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Flushing IO for device /dev/sde {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:27:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4779949a-d52b-4fee-a914-b1e9393d12c7]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b88b2a7-2f02-43ea-82d1-d3cff56a3541]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] SCSI volumes sde have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fb2ab8-d4e2-4595-a97b-faf911aa9c5e]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7fa118-ac78-40bd-b46c-c68890ec0d51]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba, portal: 172.16.0.220,3260]
Jul 24 16:27:55 user nova-compute[70243]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba, portal: 172.16.0.220,3260] successful.
Jul 24 16:27:55 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e251afc8-4641-42ad-af35-3667cbce69ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8604cc83-b2c7-42af-b949-86a51c221adc]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] <== disconnect_volume: return (333ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Updating instance_info_cache with network_info: [{"id": "bc944a2d-ab8f-475a-b276-485ab373860a", "address": "fa:16:3e:de:36:b6", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc944a2d-ab", "ovs_interfaceid": "bc944a2d-ab8f-475a-b276-485ab373860a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:27:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:27:56 user nova-compute[70243]: DEBUG nova.objects.instance [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lazy-loading 'flavor' on Instance uuid 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cccee2a8-320c-4aff-a713-5aaf05e08e50 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.846s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Acquiring lock "interface-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-72e59011-e2ab-4330-8826-c5de17daf617" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "interface-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-72e59011-e2ab-4330-8826-c5de17daf617" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:56 user nova-compute[70243]: DEBUG nova.objects.instance [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lazy-loading 'flavor' on Instance uuid 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:25:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-305165087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-305165087',id=20,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqr4Sb1YiAbSsHxY/YCQVoIvx0BtmisaU3JoqCzarQMjncCNKMWQUfzzjinb/WTtTYj0jaZsWe6GxxviHHKByoit7MC06BJwyYNp7QiEzsbdQ26xq1MPIO2FeXV/7igXw==',key_name='tempest-keypair-751084804',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:25:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21d8ae9e361c4588ac564ac242dcab21',ramdisk_id='',reservation_id='r-kztppkde',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-130428048',owner_user_name='tempest-TaggedAttachmentsTest-130428048-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:25:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='695787042f9f4e4eb0997bf72d169913',uuid=9e4e0f20-5488-44ce-ac82-e0e77b8a3e30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72e59011-e2ab-4330-8826-c5de17daf617", "address": "fa:16:3e:c4:dd:3e", "network": {"id": "86683aa8-6178-4e82-add6-ad9ae6b723ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2084262809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e59011-e2", "ovs_interfaceid": "72e59011-e2ab-4330-8826-c5de17daf617", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:27:56 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Converting VIF {"id": "72e59011-e2ab-4330-8826-c5de17daf617", "address": "fa:16:3e:c4:dd:3e", "network": {"id": "86683aa8-6178-4e82-add6-ad9ae6b723ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2084262809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e59011-e2", "ovs_interfaceid": "72e59011-e2ab-4330-8826-c5de17daf617", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:27:56 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:dd:3e,bridge_name='br-int',has_traffic_filtering=True,id=72e59011-e2ab-4330-8826-c5de17daf617,network=Network(86683aa8-6178-4e82-add6-ad9ae6b723ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e59011-e2') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:27:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c4:dd:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap72e59011-e2"/></interface> {{(pid=70243) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 24 16:27:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c4:dd:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap72e59011-e2"/></interface> {{(pid=70243) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 24 16:27:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Attempting to detach device tap72e59011-e2 from instance 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:27:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] detach device xml: <interface type="ethernet">
Jul 24 16:27:56 user nova-compute[70243]:   <mac address="fa:16:3e:c4:dd:3e"/>
Jul 24 16:27:56 user nova-compute[70243]:   <model type="virtio"/>
Jul 24 16:27:56 user nova-compute[70243]:   <mtu size="1442"/>
Jul 24 16:27:56 user nova-compute[70243]:   <target dev="tap72e59011-e2"/>
Jul 24 16:27:56 user nova-compute[70243]: </interface>
Jul 24 16:27:56 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:27:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c4:dd:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap72e59011-e2"/></interface> {{(pid=70243) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 24 16:27:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c4:dd:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap72e59011-e2"/></interface>not found in domain: <domain type='kvm' id='29'>
Jul 24 16:27:56 user nova-compute[70243]:   <name>instance-00000014</name>
Jul 24 16:27:56 user nova-compute[70243]:   <uuid>9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</uuid>
Jul 24 16:27:56 user nova-compute[70243]:   <metadata>
Jul 24 16:27:56 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:27:56 user nova-compute[70243]:   <nova:package version="0.0.0"/>
Jul 24 16:27:56 user nova-compute[70243]:   <nova:name>tempest-device-tagging-server-305165087</nova:name>
Jul 24 16:27:56 user nova-compute[70243]:   <nova:creationTime>2023-07-24 16:27:39</nova:creationTime>
Jul 24 16:27:56 user nova-compute[70243]:   <nova:flavor name="m1.tiny">
Jul 24 16:27:56 user nova-compute[70243]:     <nova:memory>512</nova:memory>
Jul 24 16:27:56 user nova-compute[70243]:     <nova:disk>1</nova:disk>
Jul 24 16:27:56 user nova-compute[70243]:     <nova:swap>0</nova:swap>
Jul 24 16:27:56 user nova-compute[70243]:     <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:27:56 user nova-compute[70243]:     <nova:vcpus>1</nova:vcpus>
Jul 24 16:27:56 user nova-compute[70243]:   </nova:flavor>
Jul 24 16:27:56 user nova-compute[70243]:   <nova:owner>
Jul 24 16:27:56 user nova-compute[70243]:     <nova:user uuid="695787042f9f4e4eb0997bf72d169913">tempest-TaggedAttachmentsTest-130428048-project-member</nova:user>
Jul 24 16:27:56 user nova-compute[70243]:     <nova:project uuid="21d8ae9e361c4588ac564ac242dcab21">tempest-TaggedAttachmentsTest-130428048</nova:project>
Jul 24 16:27:56 user nova-compute[70243]:   </nova:owner>
Jul 24 16:27:56 user nova-compute[70243]:   <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:27:56 user nova-compute[70243]:   <nova:ports>
Jul 24 16:27:56 user nova-compute[70243]:     <nova:port uuid="d441139a-506e-44b6-9bea-0825befacf40">
Jul 24 16:27:56 user nova-compute[70243]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 24 16:27:56 user nova-compute[70243]:     </nova:port>
Jul 24 16:27:56 user nova-compute[70243]:     <nova:port uuid="72e59011-e2ab-4330-8826-c5de17daf617">
Jul 24 16:27:56 user nova-compute[70243]:       <nova:ip type="fixed" address="10.10.10.86" ipVersion="4"/>
Jul 24 16:27:56 user nova-compute[70243]:     </nova:port>
Jul 24 16:27:56 user nova-compute[70243]:   </nova:ports>
Jul 24 16:27:56 user nova-compute[70243]: </nova:instance>
Jul 24 16:27:56 user nova-compute[70243]:   </metadata>
Jul 24 16:27:56 user nova-compute[70243]:   <memory unit='KiB'>524288</memory>
Jul 24 16:27:56 user nova-compute[70243]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 24 16:27:56 user nova-compute[70243]:   <vcpu placement='static'>1</vcpu>
Jul 24 16:27:56 user nova-compute[70243]:   <resource>
Jul 24 16:27:56 user nova-compute[70243]:     <partition>/machine</partition>
Jul 24 16:27:56 user nova-compute[70243]:   </resource>
Jul 24 16:27:56 user nova-compute[70243]:   <sysinfo type='smbios'>
Jul 24 16:27:56 user nova-compute[70243]:     <system>
Jul 24 16:27:56 user nova-compute[70243]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 24 16:27:56 user nova-compute[70243]:       <entry name='product'>OpenStack Nova</entry>
Jul 24 16:27:56 user nova-compute[70243]:       <entry name='version'>0.0.0</entry>
Jul 24 16:27:56 user nova-compute[70243]:       <entry name='serial'>9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</entry>
Jul 24 16:27:56 user nova-compute[70243]:       <entry name='uuid'>9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</entry>
Jul 24 16:27:56 user nova-compute[70243]:       <entry name='family'>Virtual Machine</entry>
Jul 24 16:27:56 user nova-compute[70243]:     </system>
Jul 24 16:27:56 user nova-compute[70243]:   </sysinfo>
Jul 24 16:27:56 user nova-compute[70243]:   <os>
Jul 24 16:27:56 user nova-compute[70243]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 24 16:27:56 user nova-compute[70243]:     <boot dev='hd'/>
Jul 24 16:27:56 user nova-compute[70243]:     <smbios mode='sysinfo'/>
Jul 24 16:27:56 user nova-compute[70243]:   </os>
Jul 24 16:27:56 user nova-compute[70243]:   <features>
Jul 24 16:27:56 user nova-compute[70243]:     <acpi/>
Jul 24 16:27:56 user nova-compute[70243]:     <apic/>
Jul 24 16:27:56 user nova-compute[70243]:     <vmcoreinfo state='on'/>
Jul 24 16:27:56 user nova-compute[70243]:   </features>
Jul 24 16:27:56 user nova-compute[70243]:   <cpu mode='custom' match='exact' check='full'>
Jul 24 16:27:56 user nova-compute[70243]:     <model fallback='forbid'>Nehalem</model>
Jul 24 16:27:56 user nova-compute[70243]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 24 16:27:56 user nova-compute[70243]:     <feature policy='require' name='vme'/>
Jul 24 16:27:56 user nova-compute[70243]:     <feature policy='require' name='x2apic'/>
Jul 24 16:27:56 user nova-compute[70243]:     <feature policy='require' name='hypervisor'/>
Jul 24 16:27:56 user nova-compute[70243]:   </cpu>
Jul 24 16:27:56 user nova-compute[70243]:   <clock offset='utc'>
Jul 24 16:27:56 user nova-compute[70243]:     <timer name='pit' tickpolicy='delay'/>
Jul 24 16:27:56 user nova-compute[70243]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 24 16:27:56 user nova-compute[70243]:     <timer name='hpet' present='no'/>
Jul 24 16:27:56 user nova-compute[70243]:   </clock>
Jul 24 16:27:56 user nova-compute[70243]:   <on_poweroff>destroy</on_poweroff>
Jul 24 16:27:56 user nova-compute[70243]:   <on_reboot>restart</on_reboot>
Jul 24 16:27:56 user nova-compute[70243]:   <on_crash>destroy</on_crash>
Jul 24 16:27:56 user nova-compute[70243]:   <devices>
Jul 24 16:27:56 user nova-compute[70243]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 24 16:27:56 user nova-compute[70243]:     <disk type='file' device='disk'>
Jul 24 16:27:56 user nova-compute[70243]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 24 16:27:56 user nova-compute[70243]:       <source file='/opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk' index='2'/>
Jul 24 16:27:56 user nova-compute[70243]:       <backingStore type='file' index='3'>
Jul 24 16:27:56 user nova-compute[70243]:         <format type='raw'/>
Jul 24 16:27:56 user nova-compute[70243]:         <source file='/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d'/>
Jul 24 16:27:56 user nova-compute[70243]:         <backingStore/>
Jul 24 16:27:56 user nova-compute[70243]:       </backingStore>
Jul 24 16:27:56 user nova-compute[70243]:       <target dev='vda' bus='virtio'/>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='virtio-disk0'/>
Jul 24 16:27:56 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </disk>
Jul 24 16:27:56 user nova-compute[70243]:     <disk type='file' device='cdrom'>
Jul 24 16:27:56 user nova-compute[70243]:       <driver name='qemu' type='raw' cache='none'/>
Jul 24 16:27:56 user nova-compute[70243]:       <source file='/opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk.config' index='1'/>
Jul 24 16:27:56 user nova-compute[70243]:       <backingStore/>
Jul 24 16:27:56 user nova-compute[70243]:       <target dev='hda' bus='ide'/>
Jul 24 16:27:56 user nova-compute[70243]:       <readonly/>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='ide0-0-0'/>
Jul 24 16:27:56 user nova-compute[70243]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </disk>
Jul 24 16:27:56 user nova-compute[70243]:     <controller type='usb' index='0' model='none'>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='usb'/>
Jul 24 16:27:56 user nova-compute[70243]:     </controller>
Jul 24 16:27:56 user nova-compute[70243]:     <controller type='pci' index='0' model='pci-root'>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='pci.0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </controller>
Jul 24 16:27:56 user nova-compute[70243]:     <controller type='ide' index='0'>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='ide'/>
Jul 24 16:27:56 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 24 16:27:56 user nova-compute[70243]:     </controller>
Jul 24 16:27:56 user nova-compute[70243]:     <interface type='ethernet'>
Jul 24 16:27:56 user nova-compute[70243]:       <mac address='fa:16:3e:61:2d:32'/>
Jul 24 16:27:56 user nova-compute[70243]:       <target dev='tapd441139a-50'/>
Jul 24 16:27:56 user nova-compute[70243]:       <model type='virtio'/>
Jul 24 16:27:56 user nova-compute[70243]:       <mtu size='1442'/>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='net0'/>
Jul 24 16:27:56 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </interface>
Jul 24 16:27:56 user nova-compute[70243]:     <interface type='ethernet'>
Jul 24 16:27:56 user nova-compute[70243]:       <mac address='fa:16:3e:c4:dd:3e'/>
Jul 24 16:27:56 user nova-compute[70243]:       <target dev='tap72e59011-e2'/>
Jul 24 16:27:56 user nova-compute[70243]:       <model type='virtio'/>
Jul 24 16:27:56 user nova-compute[70243]:       <mtu size='1442'/>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='net1'/>
Jul 24 16:27:56 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </interface>
Jul 24 16:27:56 user nova-compute[70243]:     <serial type='pty'>
Jul 24 16:27:56 user nova-compute[70243]:       <source path='/dev/pts/7'/>
Jul 24 16:27:56 user nova-compute[70243]:       <log file='/opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/console.log' append='off'/>
Jul 24 16:27:56 user nova-compute[70243]:       <target type='isa-serial' port='0'>
Jul 24 16:27:56 user nova-compute[70243]:         <model name='isa-serial'/>
Jul 24 16:27:56 user nova-compute[70243]:       </target>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='serial0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </serial>
Jul 24 16:27:56 user nova-compute[70243]:     <console type='pty' tty='/dev/pts/7'>
Jul 24 16:27:56 user nova-compute[70243]:       <source path='/dev/pts/7'/>
Jul 24 16:27:56 user nova-compute[70243]:       <log file='/opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/console.log' append='off'/>
Jul 24 16:27:56 user nova-compute[70243]:       <target type='serial' port='0'/>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='serial0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </console>
Jul 24 16:27:56 user nova-compute[70243]:     <input type='mouse' bus='ps2'>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='input0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </input>
Jul 24 16:27:56 user nova-compute[70243]:     <input type='keyboard' bus='ps2'>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='input1'/>
Jul 24 16:27:56 user nova-compute[70243]:     </input>
Jul 24 16:27:56 user nova-compute[70243]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Jul 24 16:27:56 user nova-compute[70243]:       <listen type='address' address='0.0.0.0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </graphics>
Jul 24 16:27:56 user nova-compute[70243]:     <audio id='1' type='none'/>
Jul 24 16:27:56 user nova-compute[70243]:     <video>
Jul 24 16:27:56 user nova-compute[70243]:       <model type='virtio' heads='1' primary='yes'/>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='video0'/>
Jul 24 16:27:56 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </video>
Jul 24 16:27:56 user nova-compute[70243]:     <memballoon model='virtio'>
Jul 24 16:27:56 user nova-compute[70243]:       <stats period='10'/>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='balloon0'/>
Jul 24 16:27:56 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </memballoon>
Jul 24 16:27:56 user nova-compute[70243]:     <rng model='virtio'>
Jul 24 16:27:56 user nova-compute[70243]:       <backend model='random'>/dev/urandom</backend>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='rng0'/>
Jul 24 16:27:56 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </rng>
Jul 24 16:27:56 user nova-compute[70243]:   </devices>
Jul 24 16:27:56 user nova-compute[70243]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 24 16:27:56 user nova-compute[70243]:     <label>libvirt-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</label>
Jul 24 16:27:56 user nova-compute[70243]:     <imagelabel>libvirt-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</imagelabel>
Jul 24 16:27:56 user nova-compute[70243]:   </seclabel>
Jul 24 16:27:56 user nova-compute[70243]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 24 16:27:56 user nova-compute[70243]:     <label>+64055:+108</label>
Jul 24 16:27:56 user nova-compute[70243]:     <imagelabel>+64055:+108</imagelabel>
Jul 24 16:27:56 user nova-compute[70243]:   </seclabel>
Jul 24 16:27:56 user nova-compute[70243]: </domain>
Jul 24 16:27:56 user nova-compute[70243]:  {{(pid=70243) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 24 16:27:56 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Successfully detached device tap72e59011-e2 from instance 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 from the persistent domain config.
Jul 24 16:27:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] (1/8): Attempting to detach device tap72e59011-e2 with device alias net1 from instance 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:27:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] detach device xml: <interface type="ethernet">
Jul 24 16:27:56 user nova-compute[70243]:   <mac address="fa:16:3e:c4:dd:3e"/>
Jul 24 16:27:56 user nova-compute[70243]:   <model type="virtio"/>
Jul 24 16:27:56 user nova-compute[70243]:   <mtu size="1442"/>
Jul 24 16:27:56 user nova-compute[70243]:   <target dev="tap72e59011-e2"/>
Jul 24 16:27:56 user nova-compute[70243]: </interface>
Jul 24 16:27:56 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:27:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690216076.9840112, 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:27:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Start waiting for the detach event from libvirt for device tap72e59011-e2 with device alias net1 for instance 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:27:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c4:dd:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap72e59011-e2"/></interface> {{(pid=70243) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 24 16:27:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c4:dd:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap72e59011-e2"/></interface>not found in domain: <domain type='kvm' id='29'>
Jul 24 16:27:56 user nova-compute[70243]:   <name>instance-00000014</name>
Jul 24 16:27:56 user nova-compute[70243]:   <uuid>9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</uuid>
Jul 24 16:27:56 user nova-compute[70243]:   <metadata>
Jul 24 16:27:56 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:27:56 user nova-compute[70243]:   <nova:package version="0.0.0"/>
Jul 24 16:27:56 user nova-compute[70243]:   <nova:name>tempest-device-tagging-server-305165087</nova:name>
Jul 24 16:27:56 user nova-compute[70243]:   <nova:creationTime>2023-07-24 16:27:39</nova:creationTime>
Jul 24 16:27:56 user nova-compute[70243]:   <nova:flavor name="m1.tiny">
Jul 24 16:27:56 user nova-compute[70243]:     <nova:memory>512</nova:memory>
Jul 24 16:27:56 user nova-compute[70243]:     <nova:disk>1</nova:disk>
Jul 24 16:27:56 user nova-compute[70243]:     <nova:swap>0</nova:swap>
Jul 24 16:27:56 user nova-compute[70243]:     <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:27:56 user nova-compute[70243]:     <nova:vcpus>1</nova:vcpus>
Jul 24 16:27:56 user nova-compute[70243]:   </nova:flavor>
Jul 24 16:27:56 user nova-compute[70243]:   <nova:owner>
Jul 24 16:27:56 user nova-compute[70243]:     <nova:user uuid="695787042f9f4e4eb0997bf72d169913">tempest-TaggedAttachmentsTest-130428048-project-member</nova:user>
Jul 24 16:27:56 user nova-compute[70243]:     <nova:project uuid="21d8ae9e361c4588ac564ac242dcab21">tempest-TaggedAttachmentsTest-130428048</nova:project>
Jul 24 16:27:56 user nova-compute[70243]:   </nova:owner>
Jul 24 16:27:56 user nova-compute[70243]:   <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:27:56 user nova-compute[70243]:   <nova:ports>
Jul 24 16:27:56 user nova-compute[70243]:     <nova:port uuid="d441139a-506e-44b6-9bea-0825befacf40">
Jul 24 16:27:56 user nova-compute[70243]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 24 16:27:56 user nova-compute[70243]:     </nova:port>
Jul 24 16:27:56 user nova-compute[70243]:     <nova:port uuid="72e59011-e2ab-4330-8826-c5de17daf617">
Jul 24 16:27:56 user nova-compute[70243]:       <nova:ip type="fixed" address="10.10.10.86" ipVersion="4"/>
Jul 24 16:27:56 user nova-compute[70243]:     </nova:port>
Jul 24 16:27:56 user nova-compute[70243]:   </nova:ports>
Jul 24 16:27:56 user nova-compute[70243]: </nova:instance>
Jul 24 16:27:56 user nova-compute[70243]:   </metadata>
Jul 24 16:27:56 user nova-compute[70243]:   <memory unit='KiB'>524288</memory>
Jul 24 16:27:56 user nova-compute[70243]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 24 16:27:56 user nova-compute[70243]:   <vcpu placement='static'>1</vcpu>
Jul 24 16:27:56 user nova-compute[70243]:   <resource>
Jul 24 16:27:56 user nova-compute[70243]:     <partition>/machine</partition>
Jul 24 16:27:56 user nova-compute[70243]:   </resource>
Jul 24 16:27:56 user nova-compute[70243]:   <sysinfo type='smbios'>
Jul 24 16:27:56 user nova-compute[70243]:     <system>
Jul 24 16:27:56 user nova-compute[70243]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 24 16:27:56 user nova-compute[70243]:       <entry name='product'>OpenStack Nova</entry>
Jul 24 16:27:56 user nova-compute[70243]:       <entry name='version'>0.0.0</entry>
Jul 24 16:27:56 user nova-compute[70243]:       <entry name='serial'>9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</entry>
Jul 24 16:27:56 user nova-compute[70243]:       <entry name='uuid'>9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</entry>
Jul 24 16:27:56 user nova-compute[70243]:       <entry name='family'>Virtual Machine</entry>
Jul 24 16:27:56 user nova-compute[70243]:     </system>
Jul 24 16:27:56 user nova-compute[70243]:   </sysinfo>
Jul 24 16:27:56 user nova-compute[70243]:   <os>
Jul 24 16:27:56 user nova-compute[70243]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 24 16:27:56 user nova-compute[70243]:     <boot dev='hd'/>
Jul 24 16:27:56 user nova-compute[70243]:     <smbios mode='sysinfo'/>
Jul 24 16:27:56 user nova-compute[70243]:   </os>
Jul 24 16:27:56 user nova-compute[70243]:   <features>
Jul 24 16:27:56 user nova-compute[70243]:     <acpi/>
Jul 24 16:27:56 user nova-compute[70243]:     <apic/>
Jul 24 16:27:56 user nova-compute[70243]:     <vmcoreinfo state='on'/>
Jul 24 16:27:56 user nova-compute[70243]:   </features>
Jul 24 16:27:56 user nova-compute[70243]:   <cpu mode='custom' match='exact' check='full'>
Jul 24 16:27:56 user nova-compute[70243]:     <model fallback='forbid'>Nehalem</model>
Jul 24 16:27:56 user nova-compute[70243]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 24 16:27:56 user nova-compute[70243]:     <feature policy='require' name='vme'/>
Jul 24 16:27:56 user nova-compute[70243]:     <feature policy='require' name='x2apic'/>
Jul 24 16:27:56 user nova-compute[70243]:     <feature policy='require' name='hypervisor'/>
Jul 24 16:27:56 user nova-compute[70243]:   </cpu>
Jul 24 16:27:56 user nova-compute[70243]:   <clock offset='utc'>
Jul 24 16:27:56 user nova-compute[70243]:     <timer name='pit' tickpolicy='delay'/>
Jul 24 16:27:56 user nova-compute[70243]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 24 16:27:56 user nova-compute[70243]:     <timer name='hpet' present='no'/>
Jul 24 16:27:56 user nova-compute[70243]:   </clock>
Jul 24 16:27:56 user nova-compute[70243]:   <on_poweroff>destroy</on_poweroff>
Jul 24 16:27:56 user nova-compute[70243]:   <on_reboot>restart</on_reboot>
Jul 24 16:27:56 user nova-compute[70243]:   <on_crash>destroy</on_crash>
Jul 24 16:27:56 user nova-compute[70243]:   <devices>
Jul 24 16:27:56 user nova-compute[70243]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 24 16:27:56 user nova-compute[70243]:     <disk type='file' device='disk'>
Jul 24 16:27:56 user nova-compute[70243]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 24 16:27:56 user nova-compute[70243]:       <source file='/opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk' index='2'/>
Jul 24 16:27:56 user nova-compute[70243]:       <backingStore type='file' index='3'>
Jul 24 16:27:56 user nova-compute[70243]:         <format type='raw'/>
Jul 24 16:27:56 user nova-compute[70243]:         <source file='/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d'/>
Jul 24 16:27:56 user nova-compute[70243]:         <backingStore/>
Jul 24 16:27:56 user nova-compute[70243]:       </backingStore>
Jul 24 16:27:56 user nova-compute[70243]:       <target dev='vda' bus='virtio'/>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='virtio-disk0'/>
Jul 24 16:27:56 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </disk>
Jul 24 16:27:56 user nova-compute[70243]:     <disk type='file' device='cdrom'>
Jul 24 16:27:56 user nova-compute[70243]:       <driver name='qemu' type='raw' cache='none'/>
Jul 24 16:27:56 user nova-compute[70243]:       <source file='/opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk.config' index='1'/>
Jul 24 16:27:56 user nova-compute[70243]:       <backingStore/>
Jul 24 16:27:56 user nova-compute[70243]:       <target dev='hda' bus='ide'/>
Jul 24 16:27:56 user nova-compute[70243]:       <readonly/>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='ide0-0-0'/>
Jul 24 16:27:56 user nova-compute[70243]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </disk>
Jul 24 16:27:56 user nova-compute[70243]:     <controller type='usb' index='0' model='none'>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='usb'/>
Jul 24 16:27:56 user nova-compute[70243]:     </controller>
Jul 24 16:27:56 user nova-compute[70243]:     <controller type='pci' index='0' model='pci-root'>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='pci.0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </controller>
Jul 24 16:27:56 user nova-compute[70243]:     <controller type='ide' index='0'>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='ide'/>
Jul 24 16:27:56 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 24 16:27:56 user nova-compute[70243]:     </controller>
Jul 24 16:27:56 user nova-compute[70243]:     <interface type='ethernet'>
Jul 24 16:27:56 user nova-compute[70243]:       <mac address='fa:16:3e:61:2d:32'/>
Jul 24 16:27:56 user nova-compute[70243]:       <target dev='tapd441139a-50'/>
Jul 24 16:27:56 user nova-compute[70243]:       <model type='virtio'/>
Jul 24 16:27:56 user nova-compute[70243]:       <mtu size='1442'/>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='net0'/>
Jul 24 16:27:56 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </interface>
Jul 24 16:27:56 user nova-compute[70243]:     <serial type='pty'>
Jul 24 16:27:56 user nova-compute[70243]:       <source path='/dev/pts/7'/>
Jul 24 16:27:56 user nova-compute[70243]:       <log file='/opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/console.log' append='off'/>
Jul 24 16:27:56 user nova-compute[70243]:       <target type='isa-serial' port='0'>
Jul 24 16:27:56 user nova-compute[70243]:         <model name='isa-serial'/>
Jul 24 16:27:56 user nova-compute[70243]:       </target>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='serial0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </serial>
Jul 24 16:27:56 user nova-compute[70243]:     <console type='pty' tty='/dev/pts/7'>
Jul 24 16:27:56 user nova-compute[70243]:       <source path='/dev/pts/7'/>
Jul 24 16:27:56 user nova-compute[70243]:       <log file='/opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/console.log' append='off'/>
Jul 24 16:27:56 user nova-compute[70243]:       <target type='serial' port='0'/>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='serial0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </console>
Jul 24 16:27:56 user nova-compute[70243]:     <input type='mouse' bus='ps2'>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='input0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </input>
Jul 24 16:27:56 user nova-compute[70243]:     <input type='keyboard' bus='ps2'>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='input1'/>
Jul 24 16:27:56 user nova-compute[70243]:     </input>
Jul 24 16:27:56 user nova-compute[70243]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Jul 24 16:27:56 user nova-compute[70243]:       <listen type='address' address='0.0.0.0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </graphics>
Jul 24 16:27:56 user nova-compute[70243]:     <audio id='1' type='none'/>
Jul 24 16:27:56 user nova-compute[70243]:     <video>
Jul 24 16:27:56 user nova-compute[70243]:       <model type='virtio' heads='1' primary='yes'/>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='video0'/>
Jul 24 16:27:56 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </video>
Jul 24 16:27:56 user nova-compute[70243]:     <memballoon model='virtio'>
Jul 24 16:27:56 user nova-compute[70243]:       <stats period='10'/>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='balloon0'/>
Jul 24 16:27:56 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </memballoon>
Jul 24 16:27:56 user nova-compute[70243]:     <rng model='virtio'>
Jul 24 16:27:56 user nova-compute[70243]:       <backend model='random'>/dev/urandom</backend>
Jul 24 16:27:56 user nova-compute[70243]:       <alias name='rng0'/>
Jul 24 16:27:56 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 24 16:27:56 user nova-compute[70243]:     </rng>
Jul 24 16:27:56 user nova-compute[70243]:   </devices>
Jul 24 16:27:56 user nova-compute[70243]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 24 16:27:56 user nova-compute[70243]:     <label>libvirt-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</label>
Jul 24 16:27:56 user nova-compute[70243]:     <imagelabel>libvirt-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</imagelabel>
Jul 24 16:27:56 user nova-compute[70243]:   </seclabel>
Jul 24 16:27:56 user nova-compute[70243]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 24 16:27:56 user nova-compute[70243]:     <label>+64055:+108</label>
Jul 24 16:27:56 user nova-compute[70243]:     <imagelabel>+64055:+108</imagelabel>
Jul 24 16:27:56 user nova-compute[70243]:   </seclabel>
Jul 24 16:27:56 user nova-compute[70243]: </domain>
Jul 24 16:27:56 user nova-compute[70243]:  {{(pid=70243) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 24 16:27:57 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Successfully detached device tap72e59011-e2 from instance 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 from the live domain config.
Jul 24 16:27:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:25:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-305165087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-305165087',id=20,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqr4Sb1YiAbSsHxY/YCQVoIvx0BtmisaU3JoqCzarQMjncCNKMWQUfzzjinb/WTtTYj0jaZsWe6GxxviHHKByoit7MC06BJwyYNp7QiEzsbdQ26xq1MPIO2FeXV/7igXw==',key_name='tempest-keypair-751084804',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:25:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21d8ae9e361c4588ac564ac242dcab21',ramdisk_id='',reservation_id='r-kztppkde',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-130428048',owner_user_name='tempest-TaggedAttachmentsTest-130428048-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:25:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='695787042f9f4e4eb0997bf72d169913',uuid=9e4e0f20-5488-44ce-ac82-e0e77b8a3e30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72e59011-e2ab-4330-8826-c5de17daf617", "address": "fa:16:3e:c4:dd:3e", "network": {"id": "86683aa8-6178-4e82-add6-ad9ae6b723ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2084262809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e59011-e2", "ovs_interfaceid": "72e59011-e2ab-4330-8826-c5de17daf617", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Converting VIF {"id": "72e59011-e2ab-4330-8826-c5de17daf617", "address": "fa:16:3e:c4:dd:3e", "network": {"id": "86683aa8-6178-4e82-add6-ad9ae6b723ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2084262809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e59011-e2", "ovs_interfaceid": "72e59011-e2ab-4330-8826-c5de17daf617", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:dd:3e,bridge_name='br-int',has_traffic_filtering=True,id=72e59011-e2ab-4330-8826-c5de17daf617,network=Network(86683aa8-6178-4e82-add6-ad9ae6b723ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e59011-e2') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG os_vif [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:dd:3e,bridge_name='br-int',has_traffic_filtering=True,id=72e59011-e2ab-4330-8826-c5de17daf617,network=Network(86683aa8-6178-4e82-add6-ad9ae6b723ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e59011-e2') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72e59011-e2, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:57 user nova-compute[70243]: INFO os_vif [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:dd:3e,bridge_name='br-int',has_traffic_filtering=True,id=72e59011-e2ab-4330-8826-c5de17daf617,network=Network(86683aa8-6178-4e82-add6-ad9ae6b723ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e59011-e2')
Jul 24 16:27:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:27:57 user nova-compute[70243]:   <nova:package version="0.0.0"/>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:name>tempest-device-tagging-server-305165087</nova:name>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:creationTime>2023-07-24 16:27:57</nova:creationTime>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:flavor name="m1.tiny">
Jul 24 16:27:57 user nova-compute[70243]:     <nova:memory>512</nova:memory>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:disk>1</nova:disk>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:swap>0</nova:swap>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:vcpus>1</nova:vcpus>
Jul 24 16:27:57 user nova-compute[70243]:   </nova:flavor>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:owner>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:user uuid="695787042f9f4e4eb0997bf72d169913">tempest-TaggedAttachmentsTest-130428048-project-member</nova:user>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:project uuid="21d8ae9e361c4588ac564ac242dcab21">tempest-TaggedAttachmentsTest-130428048</nova:project>
Jul 24 16:27:57 user nova-compute[70243]:   </nova:owner>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:ports>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:port uuid="d441139a-506e-44b6-9bea-0825befacf40">
Jul 24 16:27:57 user nova-compute[70243]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 24 16:27:57 user nova-compute[70243]:     </nova:port>
Jul 24 16:27:57 user nova-compute[70243]:   </nova:ports>
Jul 24 16:27:57 user nova-compute[70243]: </nova:instance>
Jul 24 16:27:57 user nova-compute[70243]:  {{(pid=70243) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG nova.compute.manager [req-3436d3fe-014c-40fb-af3a-bfed2cfcd765 req-991e3f6a-de3a-403b-ba8f-63fbb5b178cd service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Received event network-vif-unplugged-72e59011-e2ab-4330-8826-c5de17daf617 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3436d3fe-014c-40fb-af3a-bfed2cfcd765 req-991e3f6a-de3a-403b-ba8f-63fbb5b178cd service nova] Acquiring lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3436d3fe-014c-40fb-af3a-bfed2cfcd765 req-991e3f6a-de3a-403b-ba8f-63fbb5b178cd service nova] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3436d3fe-014c-40fb-af3a-bfed2cfcd765 req-991e3f6a-de3a-403b-ba8f-63fbb5b178cd service nova] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG nova.compute.manager [req-3436d3fe-014c-40fb-af3a-bfed2cfcd765 req-991e3f6a-de3a-403b-ba8f-63fbb5b178cd service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] No waiting events found dispatching network-vif-unplugged-72e59011-e2ab-4330-8826-c5de17daf617 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:27:57 user nova-compute[70243]: WARNING nova.compute.manager [req-3436d3fe-014c-40fb-af3a-bfed2cfcd765 req-991e3f6a-de3a-403b-ba8f-63fbb5b178cd service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Received unexpected event network-vif-unplugged-72e59011-e2ab-4330-8826-c5de17daf617 for instance with vm_state active and task_state None.
Jul 24 16:27:57 user nova-compute[70243]: DEBUG nova.compute.manager [req-ade4c8a7-e9b9-4d16-9725-4736051bee0a req-69e0488e-f5dc-4594-9b67-fe3689948626 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Received event network-vif-deleted-72e59011-e2ab-4330-8826-c5de17daf617 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:57 user nova-compute[70243]: INFO nova.compute.manager [req-ade4c8a7-e9b9-4d16-9725-4736051bee0a req-69e0488e-f5dc-4594-9b67-fe3689948626 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Neutron deleted interface 72e59011-e2ab-4330-8826-c5de17daf617; detaching it from the instance and deleting it from the info cache
Jul 24 16:27:57 user nova-compute[70243]: DEBUG nova.network.neutron [req-ade4c8a7-e9b9-4d16-9725-4736051bee0a req-69e0488e-f5dc-4594-9b67-fe3689948626 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Updating instance_info_cache with network_info: [{"id": "d441139a-506e-44b6-9bea-0825befacf40", "address": "fa:16:3e:61:2d:32", "network": {"id": "99dd3690-f380-4199-b2cd-a871694533f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1380968726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd441139a-50", "ovs_interfaceid": "d441139a-506e-44b6-9bea-0825befacf40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Acquiring lock "refresh_cache-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Acquired lock "refresh_cache-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG nova.network.neutron [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG nova.objects.instance [req-ade4c8a7-e9b9-4d16-9725-4736051bee0a req-69e0488e-f5dc-4594-9b67-fe3689948626 service nova] Lazy-loading 'system_metadata' on Instance uuid 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG nova.objects.instance [req-ade4c8a7-e9b9-4d16-9725-4736051bee0a req-69e0488e-f5dc-4594-9b67-fe3689948626 service nova] Lazy-loading 'flavor' on Instance uuid 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [req-ade4c8a7-e9b9-4d16-9725-4736051bee0a req-69e0488e-f5dc-4594-9b67-fe3689948626 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:25:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-305165087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-305165087',id=20,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqr4Sb1YiAbSsHxY/YCQVoIvx0BtmisaU3JoqCzarQMjncCNKMWQUfzzjinb/WTtTYj0jaZsWe6GxxviHHKByoit7MC06BJwyYNp7QiEzsbdQ26xq1MPIO2FeXV/7igXw==',key_name='tempest-keypair-751084804',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:25:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21d8ae9e361c4588ac564ac242dcab21',ramdisk_id='',reservation_id='r-kztppkde',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-130428048',owner_user_name='tempest-TaggedAttachmentsTest-130428048-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:25:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='695787042f9f4e4eb0997bf72d169913',uuid=9e4e0f20-5488-44ce-ac82-e0e77b8a3e30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72e59011-e2ab-4330-8826-c5de17daf617", "address": "fa:16:3e:c4:dd:3e", "network": {"id": "86683aa8-6178-4e82-add6-ad9ae6b723ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2084262809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e59011-e2", "ovs_interfaceid": "72e59011-e2ab-4330-8826-c5de17daf617", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG nova.network.os_vif_util [req-ade4c8a7-e9b9-4d16-9725-4736051bee0a req-69e0488e-f5dc-4594-9b67-fe3689948626 service nova] Converting VIF {"id": "72e59011-e2ab-4330-8826-c5de17daf617", "address": "fa:16:3e:c4:dd:3e", "network": {"id": "86683aa8-6178-4e82-add6-ad9ae6b723ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2084262809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e59011-e2", "ovs_interfaceid": "72e59011-e2ab-4330-8826-c5de17daf617", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG nova.network.os_vif_util [req-ade4c8a7-e9b9-4d16-9725-4736051bee0a req-69e0488e-f5dc-4594-9b67-fe3689948626 service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:dd:3e,bridge_name='br-int',has_traffic_filtering=True,id=72e59011-e2ab-4330-8826-c5de17daf617,network=Network(86683aa8-6178-4e82-add6-ad9ae6b723ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e59011-e2') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [req-ade4c8a7-e9b9-4d16-9725-4736051bee0a req-69e0488e-f5dc-4594-9b67-fe3689948626 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c4:dd:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap72e59011-e2"/></interface> {{(pid=70243) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [req-ade4c8a7-e9b9-4d16-9725-4736051bee0a req-69e0488e-f5dc-4594-9b67-fe3689948626 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c4:dd:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap72e59011-e2"/></interface>not found in domain: <domain type='kvm' id='29'>
Jul 24 16:27:57 user nova-compute[70243]:   <name>instance-00000014</name>
Jul 24 16:27:57 user nova-compute[70243]:   <uuid>9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</uuid>
Jul 24 16:27:57 user nova-compute[70243]:   <metadata>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:27:57 user nova-compute[70243]:   <nova:package version="0.0.0"/>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:name>tempest-device-tagging-server-305165087</nova:name>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:creationTime>2023-07-24 16:27:57</nova:creationTime>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:flavor name="m1.tiny">
Jul 24 16:27:57 user nova-compute[70243]:     <nova:memory>512</nova:memory>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:disk>1</nova:disk>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:swap>0</nova:swap>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:vcpus>1</nova:vcpus>
Jul 24 16:27:57 user nova-compute[70243]:   </nova:flavor>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:owner>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:user uuid="695787042f9f4e4eb0997bf72d169913">tempest-TaggedAttachmentsTest-130428048-project-member</nova:user>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:project uuid="21d8ae9e361c4588ac564ac242dcab21">tempest-TaggedAttachmentsTest-130428048</nova:project>
Jul 24 16:27:57 user nova-compute[70243]:   </nova:owner>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:ports>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:port uuid="d441139a-506e-44b6-9bea-0825befacf40">
Jul 24 16:27:57 user nova-compute[70243]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 24 16:27:57 user nova-compute[70243]:     </nova:port>
Jul 24 16:27:57 user nova-compute[70243]:   </nova:ports>
Jul 24 16:27:57 user nova-compute[70243]: </nova:instance>
Jul 24 16:27:57 user nova-compute[70243]:   </metadata>
Jul 24 16:27:57 user nova-compute[70243]:   <memory unit='KiB'>524288</memory>
Jul 24 16:27:57 user nova-compute[70243]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 24 16:27:57 user nova-compute[70243]:   <vcpu placement='static'>1</vcpu>
Jul 24 16:27:57 user nova-compute[70243]:   <resource>
Jul 24 16:27:57 user nova-compute[70243]:     <partition>/machine</partition>
Jul 24 16:27:57 user nova-compute[70243]:   </resource>
Jul 24 16:27:57 user nova-compute[70243]:   <sysinfo type='smbios'>
Jul 24 16:27:57 user nova-compute[70243]:     <system>
Jul 24 16:27:57 user nova-compute[70243]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 24 16:27:57 user nova-compute[70243]:       <entry name='product'>OpenStack Nova</entry>
Jul 24 16:27:57 user nova-compute[70243]:       <entry name='version'>0.0.0</entry>
Jul 24 16:27:57 user nova-compute[70243]:       <entry name='serial'>9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</entry>
Jul 24 16:27:57 user nova-compute[70243]:       <entry name='uuid'>9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</entry>
Jul 24 16:27:57 user nova-compute[70243]:       <entry name='family'>Virtual Machine</entry>
Jul 24 16:27:57 user nova-compute[70243]:     </system>
Jul 24 16:27:57 user nova-compute[70243]:   </sysinfo>
Jul 24 16:27:57 user nova-compute[70243]:   <os>
Jul 24 16:27:57 user nova-compute[70243]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 24 16:27:57 user nova-compute[70243]:     <boot dev='hd'/>
Jul 24 16:27:57 user nova-compute[70243]:     <smbios mode='sysinfo'/>
Jul 24 16:27:57 user nova-compute[70243]:   </os>
Jul 24 16:27:57 user nova-compute[70243]:   <features>
Jul 24 16:27:57 user nova-compute[70243]:     <acpi/>
Jul 24 16:27:57 user nova-compute[70243]:     <apic/>
Jul 24 16:27:57 user nova-compute[70243]:     <vmcoreinfo state='on'/>
Jul 24 16:27:57 user nova-compute[70243]:   </features>
Jul 24 16:27:57 user nova-compute[70243]:   <cpu mode='custom' match='exact' check='full'>
Jul 24 16:27:57 user nova-compute[70243]:     <model fallback='forbid'>Nehalem</model>
Jul 24 16:27:57 user nova-compute[70243]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 24 16:27:57 user nova-compute[70243]:     <feature policy='require' name='vme'/>
Jul 24 16:27:57 user nova-compute[70243]:     <feature policy='require' name='x2apic'/>
Jul 24 16:27:57 user nova-compute[70243]:     <feature policy='require' name='hypervisor'/>
Jul 24 16:27:57 user nova-compute[70243]:   </cpu>
Jul 24 16:27:57 user nova-compute[70243]:   <clock offset='utc'>
Jul 24 16:27:57 user nova-compute[70243]:     <timer name='pit' tickpolicy='delay'/>
Jul 24 16:27:57 user nova-compute[70243]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 24 16:27:57 user nova-compute[70243]:     <timer name='hpet' present='no'/>
Jul 24 16:27:57 user nova-compute[70243]:   </clock>
Jul 24 16:27:57 user nova-compute[70243]:   <on_poweroff>destroy</on_poweroff>
Jul 24 16:27:57 user nova-compute[70243]:   <on_reboot>restart</on_reboot>
Jul 24 16:27:57 user nova-compute[70243]:   <on_crash>destroy</on_crash>
Jul 24 16:27:57 user nova-compute[70243]:   <devices>
Jul 24 16:27:57 user nova-compute[70243]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 24 16:27:57 user nova-compute[70243]:     <disk type='file' device='disk'>
Jul 24 16:27:57 user nova-compute[70243]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 24 16:27:57 user nova-compute[70243]:       <source file='/opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk' index='2'/>
Jul 24 16:27:57 user nova-compute[70243]:       <backingStore type='file' index='3'>
Jul 24 16:27:57 user nova-compute[70243]:         <format type='raw'/>
Jul 24 16:27:57 user nova-compute[70243]:         <source file='/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d'/>
Jul 24 16:27:57 user nova-compute[70243]:         <backingStore/>
Jul 24 16:27:57 user nova-compute[70243]:       </backingStore>
Jul 24 16:27:57 user nova-compute[70243]:       <target dev='vda' bus='virtio'/>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='virtio-disk0'/>
Jul 24 16:27:57 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 24 16:27:57 user nova-compute[70243]:     </disk>
Jul 24 16:27:57 user nova-compute[70243]:     <disk type='file' device='cdrom'>
Jul 24 16:27:57 user nova-compute[70243]:       <driver name='qemu' type='raw' cache='none'/>
Jul 24 16:27:57 user nova-compute[70243]:       <source file='/opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk.config' index='1'/>
Jul 24 16:27:57 user nova-compute[70243]:       <backingStore/>
Jul 24 16:27:57 user nova-compute[70243]:       <target dev='hda' bus='ide'/>
Jul 24 16:27:57 user nova-compute[70243]:       <readonly/>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='ide0-0-0'/>
Jul 24 16:27:57 user nova-compute[70243]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 24 16:27:57 user nova-compute[70243]:     </disk>
Jul 24 16:27:57 user nova-compute[70243]:     <controller type='usb' index='0' model='none'>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='usb'/>
Jul 24 16:27:57 user nova-compute[70243]:     </controller>
Jul 24 16:27:57 user nova-compute[70243]:     <controller type='pci' index='0' model='pci-root'>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='pci.0'/>
Jul 24 16:27:57 user nova-compute[70243]:     </controller>
Jul 24 16:27:57 user nova-compute[70243]:     <controller type='ide' index='0'>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='ide'/>
Jul 24 16:27:57 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 24 16:27:57 user nova-compute[70243]:     </controller>
Jul 24 16:27:57 user nova-compute[70243]:     <interface type='ethernet'>
Jul 24 16:27:57 user nova-compute[70243]:       <mac address='fa:16:3e:61:2d:32'/>
Jul 24 16:27:57 user nova-compute[70243]:       <target dev='tapd441139a-50'/>
Jul 24 16:27:57 user nova-compute[70243]:       <model type='virtio'/>
Jul 24 16:27:57 user nova-compute[70243]:       <mtu size='1442'/>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='net0'/>
Jul 24 16:27:57 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 24 16:27:57 user nova-compute[70243]:     </interface>
Jul 24 16:27:57 user nova-compute[70243]:     <serial type='pty'>
Jul 24 16:27:57 user nova-compute[70243]:       <source path='/dev/pts/7'/>
Jul 24 16:27:57 user nova-compute[70243]:       <log file='/opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/console.log' append='off'/>
Jul 24 16:27:57 user nova-compute[70243]:       <target type='isa-serial' port='0'>
Jul 24 16:27:57 user nova-compute[70243]:         <model name='isa-serial'/>
Jul 24 16:27:57 user nova-compute[70243]:       </target>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='serial0'/>
Jul 24 16:27:57 user nova-compute[70243]:     </serial>
Jul 24 16:27:57 user nova-compute[70243]:     <console type='pty' tty='/dev/pts/7'>
Jul 24 16:27:57 user nova-compute[70243]:       <source path='/dev/pts/7'/>
Jul 24 16:27:57 user nova-compute[70243]:       <log file='/opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/console.log' append='off'/>
Jul 24 16:27:57 user nova-compute[70243]:       <target type='serial' port='0'/>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='serial0'/>
Jul 24 16:27:57 user nova-compute[70243]:     </console>
Jul 24 16:27:57 user nova-compute[70243]:     <input type='mouse' bus='ps2'>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='input0'/>
Jul 24 16:27:57 user nova-compute[70243]:     </input>
Jul 24 16:27:57 user nova-compute[70243]:     <input type='keyboard' bus='ps2'>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='input1'/>
Jul 24 16:27:57 user nova-compute[70243]:     </input>
Jul 24 16:27:57 user nova-compute[70243]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Jul 24 16:27:57 user nova-compute[70243]:       <listen type='address' address='0.0.0.0'/>
Jul 24 16:27:57 user nova-compute[70243]:     </graphics>
Jul 24 16:27:57 user nova-compute[70243]:     <audio id='1' type='none'/>
Jul 24 16:27:57 user nova-compute[70243]:     <video>
Jul 24 16:27:57 user nova-compute[70243]:       <model type='virtio' heads='1' primary='yes'/>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='video0'/>
Jul 24 16:27:57 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 24 16:27:57 user nova-compute[70243]:     </video>
Jul 24 16:27:57 user nova-compute[70243]:     <memballoon model='virtio'>
Jul 24 16:27:57 user nova-compute[70243]:       <stats period='10'/>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='balloon0'/>
Jul 24 16:27:57 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 24 16:27:57 user nova-compute[70243]:     </memballoon>
Jul 24 16:27:57 user nova-compute[70243]:     <rng model='virtio'>
Jul 24 16:27:57 user nova-compute[70243]:       <backend model='random'>/dev/urandom</backend>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='rng0'/>
Jul 24 16:27:57 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 24 16:27:57 user nova-compute[70243]:     </rng>
Jul 24 16:27:57 user nova-compute[70243]:   </devices>
Jul 24 16:27:57 user nova-compute[70243]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 24 16:27:57 user nova-compute[70243]:     <label>libvirt-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</label>
Jul 24 16:27:57 user nova-compute[70243]:     <imagelabel>libvirt-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</imagelabel>
Jul 24 16:27:57 user nova-compute[70243]:   </seclabel>
Jul 24 16:27:57 user nova-compute[70243]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 24 16:27:57 user nova-compute[70243]:     <label>+64055:+108</label>
Jul 24 16:27:57 user nova-compute[70243]:     <imagelabel>+64055:+108</imagelabel>
Jul 24 16:27:57 user nova-compute[70243]:   </seclabel>
Jul 24 16:27:57 user nova-compute[70243]: </domain>
Jul 24 16:27:57 user nova-compute[70243]:  {{(pid=70243) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [req-ade4c8a7-e9b9-4d16-9725-4736051bee0a req-69e0488e-f5dc-4594-9b67-fe3689948626 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c4:dd:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap72e59011-e2"/></interface> {{(pid=70243) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [req-ade4c8a7-e9b9-4d16-9725-4736051bee0a req-69e0488e-f5dc-4594-9b67-fe3689948626 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c4:dd:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap72e59011-e2"/></interface>not found in domain: <domain type='kvm' id='29'>
Jul 24 16:27:57 user nova-compute[70243]:   <name>instance-00000014</name>
Jul 24 16:27:57 user nova-compute[70243]:   <uuid>9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</uuid>
Jul 24 16:27:57 user nova-compute[70243]:   <metadata>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:27:57 user nova-compute[70243]:   <nova:package version="0.0.0"/>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:name>tempest-device-tagging-server-305165087</nova:name>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:creationTime>2023-07-24 16:27:57</nova:creationTime>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:flavor name="m1.tiny">
Jul 24 16:27:57 user nova-compute[70243]:     <nova:memory>512</nova:memory>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:disk>1</nova:disk>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:swap>0</nova:swap>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:vcpus>1</nova:vcpus>
Jul 24 16:27:57 user nova-compute[70243]:   </nova:flavor>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:owner>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:user uuid="695787042f9f4e4eb0997bf72d169913">tempest-TaggedAttachmentsTest-130428048-project-member</nova:user>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:project uuid="21d8ae9e361c4588ac564ac242dcab21">tempest-TaggedAttachmentsTest-130428048</nova:project>
Jul 24 16:27:57 user nova-compute[70243]:   </nova:owner>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:ports>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:port uuid="d441139a-506e-44b6-9bea-0825befacf40">
Jul 24 16:27:57 user nova-compute[70243]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 24 16:27:57 user nova-compute[70243]:     </nova:port>
Jul 24 16:27:57 user nova-compute[70243]:   </nova:ports>
Jul 24 16:27:57 user nova-compute[70243]: </nova:instance>
Jul 24 16:27:57 user nova-compute[70243]:   </metadata>
Jul 24 16:27:57 user nova-compute[70243]:   <memory unit='KiB'>524288</memory>
Jul 24 16:27:57 user nova-compute[70243]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 24 16:27:57 user nova-compute[70243]:   <vcpu placement='static'>1</vcpu>
Jul 24 16:27:57 user nova-compute[70243]:   <resource>
Jul 24 16:27:57 user nova-compute[70243]:     <partition>/machine</partition>
Jul 24 16:27:57 user nova-compute[70243]:   </resource>
Jul 24 16:27:57 user nova-compute[70243]:   <sysinfo type='smbios'>
Jul 24 16:27:57 user nova-compute[70243]:     <system>
Jul 24 16:27:57 user nova-compute[70243]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 24 16:27:57 user nova-compute[70243]:       <entry name='product'>OpenStack Nova</entry>
Jul 24 16:27:57 user nova-compute[70243]:       <entry name='version'>0.0.0</entry>
Jul 24 16:27:57 user nova-compute[70243]:       <entry name='serial'>9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</entry>
Jul 24 16:27:57 user nova-compute[70243]:       <entry name='uuid'>9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</entry>
Jul 24 16:27:57 user nova-compute[70243]:       <entry name='family'>Virtual Machine</entry>
Jul 24 16:27:57 user nova-compute[70243]:     </system>
Jul 24 16:27:57 user nova-compute[70243]:   </sysinfo>
Jul 24 16:27:57 user nova-compute[70243]:   <os>
Jul 24 16:27:57 user nova-compute[70243]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 24 16:27:57 user nova-compute[70243]:     <boot dev='hd'/>
Jul 24 16:27:57 user nova-compute[70243]:     <smbios mode='sysinfo'/>
Jul 24 16:27:57 user nova-compute[70243]:   </os>
Jul 24 16:27:57 user nova-compute[70243]:   <features>
Jul 24 16:27:57 user nova-compute[70243]:     <acpi/>
Jul 24 16:27:57 user nova-compute[70243]:     <apic/>
Jul 24 16:27:57 user nova-compute[70243]:     <vmcoreinfo state='on'/>
Jul 24 16:27:57 user nova-compute[70243]:   </features>
Jul 24 16:27:57 user nova-compute[70243]:   <cpu mode='custom' match='exact' check='full'>
Jul 24 16:27:57 user nova-compute[70243]:     <model fallback='forbid'>Nehalem</model>
Jul 24 16:27:57 user nova-compute[70243]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 24 16:27:57 user nova-compute[70243]:     <feature policy='require' name='vme'/>
Jul 24 16:27:57 user nova-compute[70243]:     <feature policy='require' name='x2apic'/>
Jul 24 16:27:57 user nova-compute[70243]:     <feature policy='require' name='hypervisor'/>
Jul 24 16:27:57 user nova-compute[70243]:   </cpu>
Jul 24 16:27:57 user nova-compute[70243]:   <clock offset='utc'>
Jul 24 16:27:57 user nova-compute[70243]:     <timer name='pit' tickpolicy='delay'/>
Jul 24 16:27:57 user nova-compute[70243]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 24 16:27:57 user nova-compute[70243]:     <timer name='hpet' present='no'/>
Jul 24 16:27:57 user nova-compute[70243]:   </clock>
Jul 24 16:27:57 user nova-compute[70243]:   <on_poweroff>destroy</on_poweroff>
Jul 24 16:27:57 user nova-compute[70243]:   <on_reboot>restart</on_reboot>
Jul 24 16:27:57 user nova-compute[70243]:   <on_crash>destroy</on_crash>
Jul 24 16:27:57 user nova-compute[70243]:   <devices>
Jul 24 16:27:57 user nova-compute[70243]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 24 16:27:57 user nova-compute[70243]:     <disk type='file' device='disk'>
Jul 24 16:27:57 user nova-compute[70243]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 24 16:27:57 user nova-compute[70243]:       <source file='/opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk' index='2'/>
Jul 24 16:27:57 user nova-compute[70243]:       <backingStore type='file' index='3'>
Jul 24 16:27:57 user nova-compute[70243]:         <format type='raw'/>
Jul 24 16:27:57 user nova-compute[70243]:         <source file='/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d'/>
Jul 24 16:27:57 user nova-compute[70243]:         <backingStore/>
Jul 24 16:27:57 user nova-compute[70243]:       </backingStore>
Jul 24 16:27:57 user nova-compute[70243]:       <target dev='vda' bus='virtio'/>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='virtio-disk0'/>
Jul 24 16:27:57 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 24 16:27:57 user nova-compute[70243]:     </disk>
Jul 24 16:27:57 user nova-compute[70243]:     <disk type='file' device='cdrom'>
Jul 24 16:27:57 user nova-compute[70243]:       <driver name='qemu' type='raw' cache='none'/>
Jul 24 16:27:57 user nova-compute[70243]:       <source file='/opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/disk.config' index='1'/>
Jul 24 16:27:57 user nova-compute[70243]:       <backingStore/>
Jul 24 16:27:57 user nova-compute[70243]:       <target dev='hda' bus='ide'/>
Jul 24 16:27:57 user nova-compute[70243]:       <readonly/>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='ide0-0-0'/>
Jul 24 16:27:57 user nova-compute[70243]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 24 16:27:57 user nova-compute[70243]:     </disk>
Jul 24 16:27:57 user nova-compute[70243]:     <controller type='usb' index='0' model='none'>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='usb'/>
Jul 24 16:27:57 user nova-compute[70243]:     </controller>
Jul 24 16:27:57 user nova-compute[70243]:     <controller type='pci' index='0' model='pci-root'>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='pci.0'/>
Jul 24 16:27:57 user nova-compute[70243]:     </controller>
Jul 24 16:27:57 user nova-compute[70243]:     <controller type='ide' index='0'>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='ide'/>
Jul 24 16:27:57 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 24 16:27:57 user nova-compute[70243]:     </controller>
Jul 24 16:27:57 user nova-compute[70243]:     <interface type='ethernet'>
Jul 24 16:27:57 user nova-compute[70243]:       <mac address='fa:16:3e:61:2d:32'/>
Jul 24 16:27:57 user nova-compute[70243]:       <target dev='tapd441139a-50'/>
Jul 24 16:27:57 user nova-compute[70243]:       <model type='virtio'/>
Jul 24 16:27:57 user nova-compute[70243]:       <mtu size='1442'/>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='net0'/>
Jul 24 16:27:57 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 24 16:27:57 user nova-compute[70243]:     </interface>
Jul 24 16:27:57 user nova-compute[70243]:     <serial type='pty'>
Jul 24 16:27:57 user nova-compute[70243]:       <source path='/dev/pts/7'/>
Jul 24 16:27:57 user nova-compute[70243]:       <log file='/opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/console.log' append='off'/>
Jul 24 16:27:57 user nova-compute[70243]:       <target type='isa-serial' port='0'>
Jul 24 16:27:57 user nova-compute[70243]:         <model name='isa-serial'/>
Jul 24 16:27:57 user nova-compute[70243]:       </target>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='serial0'/>
Jul 24 16:27:57 user nova-compute[70243]:     </serial>
Jul 24 16:27:57 user nova-compute[70243]:     <console type='pty' tty='/dev/pts/7'>
Jul 24 16:27:57 user nova-compute[70243]:       <source path='/dev/pts/7'/>
Jul 24 16:27:57 user nova-compute[70243]:       <log file='/opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30/console.log' append='off'/>
Jul 24 16:27:57 user nova-compute[70243]:       <target type='serial' port='0'/>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='serial0'/>
Jul 24 16:27:57 user nova-compute[70243]:     </console>
Jul 24 16:27:57 user nova-compute[70243]:     <input type='mouse' bus='ps2'>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='input0'/>
Jul 24 16:27:57 user nova-compute[70243]:     </input>
Jul 24 16:27:57 user nova-compute[70243]:     <input type='keyboard' bus='ps2'>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='input1'/>
Jul 24 16:27:57 user nova-compute[70243]:     </input>
Jul 24 16:27:57 user nova-compute[70243]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Jul 24 16:27:57 user nova-compute[70243]:       <listen type='address' address='0.0.0.0'/>
Jul 24 16:27:57 user nova-compute[70243]:     </graphics>
Jul 24 16:27:57 user nova-compute[70243]:     <audio id='1' type='none'/>
Jul 24 16:27:57 user nova-compute[70243]:     <video>
Jul 24 16:27:57 user nova-compute[70243]:       <model type='virtio' heads='1' primary='yes'/>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='video0'/>
Jul 24 16:27:57 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 24 16:27:57 user nova-compute[70243]:     </video>
Jul 24 16:27:57 user nova-compute[70243]:     <memballoon model='virtio'>
Jul 24 16:27:57 user nova-compute[70243]:       <stats period='10'/>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='balloon0'/>
Jul 24 16:27:57 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 24 16:27:57 user nova-compute[70243]:     </memballoon>
Jul 24 16:27:57 user nova-compute[70243]:     <rng model='virtio'>
Jul 24 16:27:57 user nova-compute[70243]:       <backend model='random'>/dev/urandom</backend>
Jul 24 16:27:57 user nova-compute[70243]:       <alias name='rng0'/>
Jul 24 16:27:57 user nova-compute[70243]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 24 16:27:57 user nova-compute[70243]:     </rng>
Jul 24 16:27:57 user nova-compute[70243]:   </devices>
Jul 24 16:27:57 user nova-compute[70243]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 24 16:27:57 user nova-compute[70243]:     <label>libvirt-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</label>
Jul 24 16:27:57 user nova-compute[70243]:     <imagelabel>libvirt-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30</imagelabel>
Jul 24 16:27:57 user nova-compute[70243]:   </seclabel>
Jul 24 16:27:57 user nova-compute[70243]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 24 16:27:57 user nova-compute[70243]:     <label>+64055:+108</label>
Jul 24 16:27:57 user nova-compute[70243]:     <imagelabel>+64055:+108</imagelabel>
Jul 24 16:27:57 user nova-compute[70243]:   </seclabel>
Jul 24 16:27:57 user nova-compute[70243]: </domain>
Jul 24 16:27:57 user nova-compute[70243]:  {{(pid=70243) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 24 16:27:57 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [req-ade4c8a7-e9b9-4d16-9725-4736051bee0a req-69e0488e-f5dc-4594-9b67-fe3689948626 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Detaching interface fa:16:3e:c4:dd:3e failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap72e59011-e2' not found.
Jul 24 16:27:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [req-ade4c8a7-e9b9-4d16-9725-4736051bee0a req-69e0488e-f5dc-4594-9b67-fe3689948626 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:25:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-305165087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-305165087',id=20,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqr4Sb1YiAbSsHxY/YCQVoIvx0BtmisaU3JoqCzarQMjncCNKMWQUfzzjinb/WTtTYj0jaZsWe6GxxviHHKByoit7MC06BJwyYNp7QiEzsbdQ26xq1MPIO2FeXV/7igXw==',key_name='tempest-keypair-751084804',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:25:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21d8ae9e361c4588ac564ac242dcab21',ramdisk_id='',reservation_id='r-kztppkde',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-130428048',owner_user_name='tempest-TaggedAttachmentsTest-130428048-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:25:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='695787042f9f4e4eb0997bf72d169913',uuid=9e4e0f20-5488-44ce-ac82-e0e77b8a3e30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72e59011-e2ab-4330-8826-c5de17daf617", "address": "fa:16:3e:c4:dd:3e", "network": {"id": "86683aa8-6178-4e82-add6-ad9ae6b723ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2084262809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e59011-e2", "ovs_interfaceid": "72e59011-e2ab-4330-8826-c5de17daf617", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG nova.network.os_vif_util [req-ade4c8a7-e9b9-4d16-9725-4736051bee0a req-69e0488e-f5dc-4594-9b67-fe3689948626 service nova] Converting VIF {"id": "72e59011-e2ab-4330-8826-c5de17daf617", "address": "fa:16:3e:c4:dd:3e", "network": {"id": "86683aa8-6178-4e82-add6-ad9ae6b723ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2084262809", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72e59011-e2", "ovs_interfaceid": "72e59011-e2ab-4330-8826-c5de17daf617", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG nova.network.os_vif_util [req-ade4c8a7-e9b9-4d16-9725-4736051bee0a req-69e0488e-f5dc-4594-9b67-fe3689948626 service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:dd:3e,bridge_name='br-int',has_traffic_filtering=True,id=72e59011-e2ab-4330-8826-c5de17daf617,network=Network(86683aa8-6178-4e82-add6-ad9ae6b723ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e59011-e2') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG os_vif [req-ade4c8a7-e9b9-4d16-9725-4736051bee0a req-69e0488e-f5dc-4594-9b67-fe3689948626 service nova] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:dd:3e,bridge_name='br-int',has_traffic_filtering=True,id=72e59011-e2ab-4330-8826-c5de17daf617,network=Network(86683aa8-6178-4e82-add6-ad9ae6b723ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e59011-e2') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72e59011-e2, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:27:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:27:57 user nova-compute[70243]: INFO os_vif [req-ade4c8a7-e9b9-4d16-9725-4736051bee0a req-69e0488e-f5dc-4594-9b67-fe3689948626 service nova] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:dd:3e,bridge_name='br-int',has_traffic_filtering=True,id=72e59011-e2ab-4330-8826-c5de17daf617,network=Network(86683aa8-6178-4e82-add6-ad9ae6b723ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72e59011-e2')
Jul 24 16:27:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [req-ade4c8a7-e9b9-4d16-9725-4736051bee0a req-69e0488e-f5dc-4594-9b67-fe3689948626 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:27:57 user nova-compute[70243]:   <nova:package version="0.0.0"/>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:name>tempest-device-tagging-server-305165087</nova:name>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:creationTime>2023-07-24 16:27:57</nova:creationTime>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:flavor name="m1.tiny">
Jul 24 16:27:57 user nova-compute[70243]:     <nova:memory>512</nova:memory>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:disk>1</nova:disk>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:swap>0</nova:swap>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:vcpus>1</nova:vcpus>
Jul 24 16:27:57 user nova-compute[70243]:   </nova:flavor>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:owner>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:user uuid="695787042f9f4e4eb0997bf72d169913">tempest-TaggedAttachmentsTest-130428048-project-member</nova:user>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:project uuid="21d8ae9e361c4588ac564ac242dcab21">tempest-TaggedAttachmentsTest-130428048</nova:project>
Jul 24 16:27:57 user nova-compute[70243]:   </nova:owner>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:27:57 user nova-compute[70243]:   <nova:ports>
Jul 24 16:27:57 user nova-compute[70243]:     <nova:port uuid="d441139a-506e-44b6-9bea-0825befacf40">
Jul 24 16:27:57 user nova-compute[70243]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 24 16:27:57 user nova-compute[70243]:     </nova:port>
Jul 24 16:27:57 user nova-compute[70243]:   </nova:ports>
Jul 24 16:27:57 user nova-compute[70243]: </nova:instance>
Jul 24 16:27:57 user nova-compute[70243]:  {{(pid=70243) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 24 16:27:58 user nova-compute[70243]: DEBUG nova.network.neutron [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Updating instance_info_cache with network_info: [{"id": "d441139a-506e-44b6-9bea-0825befacf40", "address": "fa:16:3e:61:2d:32", "network": {"id": "99dd3690-f380-4199-b2cd-a871694533f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1380968726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd441139a-50", "ovs_interfaceid": "d441139a-506e-44b6-9bea-0825befacf40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:27:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Releasing lock "refresh_cache-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:27:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a4ff711b-4417-4864-9a79-0bbe98e09f35 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "interface-9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-72e59011-e2ab-4330-8826-c5de17daf617" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.901s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:59 user nova-compute[70243]: DEBUG nova.compute.manager [req-2646cb8f-e499-40a2-b9c5-3116cfdae4e8 req-cd99f23b-b2f4-48ab-b14f-f37278e47259 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Received event network-vif-plugged-72e59011-e2ab-4330-8826-c5de17daf617 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:27:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2646cb8f-e499-40a2-b9c5-3116cfdae4e8 req-cd99f23b-b2f4-48ab-b14f-f37278e47259 service nova] Acquiring lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:27:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2646cb8f-e499-40a2-b9c5-3116cfdae4e8 req-cd99f23b-b2f4-48ab-b14f-f37278e47259 service nova] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:27:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2646cb8f-e499-40a2-b9c5-3116cfdae4e8 req-cd99f23b-b2f4-48ab-b14f-f37278e47259 service nova] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:27:59 user nova-compute[70243]: DEBUG nova.compute.manager [req-2646cb8f-e499-40a2-b9c5-3116cfdae4e8 req-cd99f23b-b2f4-48ab-b14f-f37278e47259 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] No waiting events found dispatching network-vif-plugged-72e59011-e2ab-4330-8826-c5de17daf617 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:27:59 user nova-compute[70243]: WARNING nova.compute.manager [req-2646cb8f-e499-40a2-b9c5-3116cfdae4e8 req-cd99f23b-b2f4-48ab-b14f-f37278e47259 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Received unexpected event network-vif-plugged-72e59011-e2ab-4330-8826-c5de17daf617 for instance with vm_state active and task_state None.
Jul 24 16:27:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:28:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:28:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:28:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:28:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:28:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:31 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:28:31 user nova-compute[70243]: INFO nova.compute.claims [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Claim successful on node user
Jul 24 16:28:31 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:28:31 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:28:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:28:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:28:31 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:28:31 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:28:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:28:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:28:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:28:31 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Creating image(s)
Jul 24 16:28:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "/opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "/opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG nova.policy [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7de0cd9dd23d4569939884728bde772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd099632b940545b9bbe000e5cc323ec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.145s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/disk 1073741824" returned: 0 in 0.049s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Cannot resize image /opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'migration_context' on Instance uuid 5d5f72a1-afd5-43f1-b803-c8924352acc2 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Ensure instance console log exists: /opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:32 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Successfully created port: 238f8b90-f497-46f5-9edd-0de67b62d546 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:28:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Acquiring lock "c8fb01bf-c754-445c-ae71-18721cf5de7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "c8fb01bf-c754-445c-ae71-18721cf5de7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:28:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:33 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:28:33 user nova-compute[70243]: INFO nova.compute.claims [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Claim successful on node user
Jul 24 16:28:33 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:28:33 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:28:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:28:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:28:33 user nova-compute[70243]: DEBUG nova.network.neutron [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:28:33 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:28:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:28:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:28:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:28:33 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Creating image(s)
Jul 24 16:28:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8fb01bf-c754-445c-ae71-18721cf5de7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "/opt/stack/data/nova/instances/c8fb01bf-c754-445c-ae71-18721cf5de7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "/opt/stack/data/nova/instances/c8fb01bf-c754-445c-ae71-18721cf5de7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:33 user nova-compute[70243]: DEBUG nova.policy [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ec427ff69094ac7a8647c0811c2af7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb3c0ed911674b69a05524f555ea6e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:28:33 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Successfully updated port: 238f8b90-f497-46f5-9edd-0de67b62d546 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:28:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "refresh_cache-5d5f72a1-afd5-43f1-b803-c8924352acc2" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:28:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquired lock "refresh_cache-5d5f72a1-afd5-43f1-b803-c8924352acc2" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:28:33 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.compute.manager [req-62e035ee-40e2-4b46-b925-41f963c69db3 req-277c5758-f38f-462e-aad3-a8c4f6edbb6d service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Received event network-changed-238f8b90-f497-46f5-9edd-0de67b62d546 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.compute.manager [req-62e035ee-40e2-4b46-b925-41f963c69db3 req-277c5758-f38f-462e-aad3-a8c4f6edbb6d service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Refreshing instance network info cache due to event network-changed-238f8b90-f497-46f5-9edd-0de67b62d546. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-62e035ee-40e2-4b46-b925-41f963c69db3 req-277c5758-f38f-462e-aad3-a8c4f6edbb6d service nova] Acquiring lock "refresh_cache-5d5f72a1-afd5-43f1-b803-c8924352acc2" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.146s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/c8fb01bf-c754-445c-ae71-18721cf5de7e/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/c8fb01bf-c754-445c-ae71-18721cf5de7e/disk 1073741824" returned: 0 in 0.046s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c8fb01bf-c754-445c-ae71-18721cf5de7e/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8fb01bf-c754-445c-ae71-18721cf5de7e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8fb01bf-c754-445c-ae71-18721cf5de7e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Cannot resize image /opt/stack/data/nova/instances/c8fb01bf-c754-445c-ae71-18721cf5de7e/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.objects.instance [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lazy-loading 'migration_context' on Instance uuid c8fb01bf-c754-445c-ae71-18721cf5de7e {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Ensure instance console log exists: /opt/stack/data/nova/instances/c8fb01bf-c754-445c-ae71-18721cf5de7e/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Updating instance_info_cache with network_info: [{"id": "238f8b90-f497-46f5-9edd-0de67b62d546", "address": "fa:16:3e:a7:f1:90", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f8b90-f4", "ovs_interfaceid": "238f8b90-f497-46f5-9edd-0de67b62d546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Releasing lock "refresh_cache-5d5f72a1-afd5-43f1-b803-c8924352acc2" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Instance network_info: |[{"id": "238f8b90-f497-46f5-9edd-0de67b62d546", "address": "fa:16:3e:a7:f1:90", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f8b90-f4", "ovs_interfaceid": "238f8b90-f497-46f5-9edd-0de67b62d546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-62e035ee-40e2-4b46-b925-41f963c69db3 req-277c5758-f38f-462e-aad3-a8c4f6edbb6d service nova] Acquired lock "refresh_cache-5d5f72a1-afd5-43f1-b803-c8924352acc2" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.network.neutron [req-62e035ee-40e2-4b46-b925-41f963c69db3 req-277c5758-f38f-462e-aad3-a8c4f6edbb6d service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Refreshing network info cache for port 238f8b90-f497-46f5-9edd-0de67b62d546 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Start _get_guest_xml network_info=[{"id": "238f8b90-f497-46f5-9edd-0de67b62d546", "address": "fa:16:3e:a7:f1:90", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f8b90-f4", "ovs_interfaceid": "238f8b90-f497-46f5-9edd-0de67b62d546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:28:34 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:28:34 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:28:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1586144779',display_name='tempest-AttachVolumeTestJSON-server-1586144779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1586144779',id=24,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKg0ZONl+5spwbU3OpYganUPRYkH+/KA/VPO8l5I1QChjbB3asB66UGA2xZaNRzLwUJuX9BzASENmcjoUZKdOFhtWP1GnroSqNqauJUbqcsmSRiJGYhkjv0npUpk3j9SPg==',key_name='tempest-keypair-218761919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d099632b940545b9bbe000e5cc323ec1',ramdisk_id='',reservation_id='r-t8x5s887',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1836925262',owner_user_name='tempest-AttachVolumeTestJSON-1836925262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:28:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7de0cd9dd23d4569939884728bde772c',uuid=5d5f72a1-afd5-43f1-b803-c8924352acc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "238f8b90-f497-46f5-9edd-0de67b62d546", "address": "fa:16:3e:a7:f1:90", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f8b90-f4", "ovs_interfaceid": "238f8b90-f497-46f5-9edd-0de67b62d546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converting VIF {"id": "238f8b90-f497-46f5-9edd-0de67b62d546", "address": "fa:16:3e:a7:f1:90", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f8b90-f4", "ovs_interfaceid": "238f8b90-f497-46f5-9edd-0de67b62d546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f1:90,bridge_name='br-int',has_traffic_filtering=True,id=238f8b90-f497-46f5-9edd-0de67b62d546,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238f8b90-f4') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d5f72a1-afd5-43f1-b803-c8924352acc2 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:28:34 user nova-compute[70243]:   <uuid>5d5f72a1-afd5-43f1-b803-c8924352acc2</uuid>
Jul 24 16:28:34 user nova-compute[70243]:   <name>instance-00000018</name>
Jul 24 16:28:34 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:28:34 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:28:34 user nova-compute[70243]:   <metadata>
Jul 24 16:28:34 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:28:34 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:28:34 user nova-compute[70243]:       <nova:name>tempest-AttachVolumeTestJSON-server-1586144779</nova:name>
Jul 24 16:28:34 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:28:34</nova:creationTime>
Jul 24 16:28:34 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:28:34 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:28:34 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:28:34 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:28:34 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:28:34 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:28:34 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:28:34 user nova-compute[70243]:       <nova:owner>
Jul 24 16:28:34 user nova-compute[70243]:         <nova:user uuid="7de0cd9dd23d4569939884728bde772c">tempest-AttachVolumeTestJSON-1836925262-project-member</nova:user>
Jul 24 16:28:34 user nova-compute[70243]:         <nova:project uuid="d099632b940545b9bbe000e5cc323ec1">tempest-AttachVolumeTestJSON-1836925262</nova:project>
Jul 24 16:28:34 user nova-compute[70243]:       </nova:owner>
Jul 24 16:28:34 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:28:34 user nova-compute[70243]:       <nova:ports>
Jul 24 16:28:34 user nova-compute[70243]:         <nova:port uuid="238f8b90-f497-46f5-9edd-0de67b62d546">
Jul 24 16:28:34 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 24 16:28:34 user nova-compute[70243]:         </nova:port>
Jul 24 16:28:34 user nova-compute[70243]:       </nova:ports>
Jul 24 16:28:34 user nova-compute[70243]:     </nova:instance>
Jul 24 16:28:34 user nova-compute[70243]:   </metadata>
Jul 24 16:28:34 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:28:34 user nova-compute[70243]:     <system>
Jul 24 16:28:34 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:28:34 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:28:34 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:28:34 user nova-compute[70243]:       <entry name="serial">5d5f72a1-afd5-43f1-b803-c8924352acc2</entry>
Jul 24 16:28:34 user nova-compute[70243]:       <entry name="uuid">5d5f72a1-afd5-43f1-b803-c8924352acc2</entry>
Jul 24 16:28:34 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:28:34 user nova-compute[70243]:     </system>
Jul 24 16:28:34 user nova-compute[70243]:   </sysinfo>
Jul 24 16:28:34 user nova-compute[70243]:   <os>
Jul 24 16:28:34 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:28:34 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:28:34 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:28:34 user nova-compute[70243]:   </os>
Jul 24 16:28:34 user nova-compute[70243]:   <features>
Jul 24 16:28:34 user nova-compute[70243]:     <acpi/>
Jul 24 16:28:34 user nova-compute[70243]:     <apic/>
Jul 24 16:28:34 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:28:34 user nova-compute[70243]:   </features>
Jul 24 16:28:34 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:28:34 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:28:34 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:28:34 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:28:34 user nova-compute[70243]:   </clock>
Jul 24 16:28:34 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:28:34 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:28:34 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:28:34 user nova-compute[70243]:   </cpu>
Jul 24 16:28:34 user nova-compute[70243]:   <devices>
Jul 24 16:28:34 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:28:34 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:28:34 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/disk"/>
Jul 24 16:28:34 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:28:34 user nova-compute[70243]:     </disk>
Jul 24 16:28:34 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:28:34 user nova-compute[70243]:       <mac address="fa:16:3e:a7:f1:90"/>
Jul 24 16:28:34 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:28:34 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:28:34 user nova-compute[70243]:       <target dev="tap238f8b90-f4"/>
Jul 24 16:28:34 user nova-compute[70243]:     </interface>
Jul 24 16:28:34 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:28:34 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/console.log" append="off"/>
Jul 24 16:28:34 user nova-compute[70243]:     </serial>
Jul 24 16:28:34 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:28:34 user nova-compute[70243]:     <video>
Jul 24 16:28:34 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:28:34 user nova-compute[70243]:     </video>
Jul 24 16:28:34 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:28:34 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:28:34 user nova-compute[70243]:     </rng>
Jul 24 16:28:34 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:28:34 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:28:34 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:28:34 user nova-compute[70243]:     </memballoon>
Jul 24 16:28:34 user nova-compute[70243]:   </devices>
Jul 24 16:28:34 user nova-compute[70243]: </domain>
Jul 24 16:28:34 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:28:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1586144779',display_name='tempest-AttachVolumeTestJSON-server-1586144779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1586144779',id=24,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKg0ZONl+5spwbU3OpYganUPRYkH+/KA/VPO8l5I1QChjbB3asB66UGA2xZaNRzLwUJuX9BzASENmcjoUZKdOFhtWP1GnroSqNqauJUbqcsmSRiJGYhkjv0npUpk3j9SPg==',key_name='tempest-keypair-218761919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d099632b940545b9bbe000e5cc323ec1',ramdisk_id='',reservation_id='r-t8x5s887',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1836925262',owner_user_name='tempest-AttachVolumeTestJSON-1836925262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:28:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7de0cd9dd23d4569939884728bde772c',uuid=5d5f72a1-afd5-43f1-b803-c8924352acc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "238f8b90-f497-46f5-9edd-0de67b62d546", "address": "fa:16:3e:a7:f1:90", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f8b90-f4", "ovs_interfaceid": "238f8b90-f497-46f5-9edd-0de67b62d546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converting VIF {"id": "238f8b90-f497-46f5-9edd-0de67b62d546", "address": "fa:16:3e:a7:f1:90", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f8b90-f4", "ovs_interfaceid": "238f8b90-f497-46f5-9edd-0de67b62d546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f1:90,bridge_name='br-int',has_traffic_filtering=True,id=238f8b90-f497-46f5-9edd-0de67b62d546,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238f8b90-f4') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG os_vif [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f1:90,bridge_name='br-int',has_traffic_filtering=True,id=238f8b90-f497-46f5-9edd-0de67b62d546,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238f8b90-f4') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap238f8b90-f4, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap238f8b90-f4, col_values=(('external_ids', {'iface-id': '238f8b90-f497-46f5-9edd-0de67b62d546', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:f1:90', 'vm-uuid': '5d5f72a1-afd5-43f1-b803-c8924352acc2'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:34 user nova-compute[70243]: INFO os_vif [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f1:90,bridge_name='br-int',has_traffic_filtering=True,id=238f8b90-f497-46f5-9edd-0de67b62d546,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238f8b90-f4')
Jul 24 16:28:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:28:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] No VIF found with MAC fa:16:3e:a7:f1:90, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:28:35 user nova-compute[70243]: DEBUG nova.network.neutron [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Successfully created port: 4784b9be-f5b3-47f8-a553-45934b58f35d {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:28:35 user nova-compute[70243]: DEBUG nova.network.neutron [req-62e035ee-40e2-4b46-b925-41f963c69db3 req-277c5758-f38f-462e-aad3-a8c4f6edbb6d service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Updated VIF entry in instance network info cache for port 238f8b90-f497-46f5-9edd-0de67b62d546. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:28:35 user nova-compute[70243]: DEBUG nova.network.neutron [req-62e035ee-40e2-4b46-b925-41f963c69db3 req-277c5758-f38f-462e-aad3-a8c4f6edbb6d service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Updating instance_info_cache with network_info: [{"id": "238f8b90-f497-46f5-9edd-0de67b62d546", "address": "fa:16:3e:a7:f1:90", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f8b90-f4", "ovs_interfaceid": "238f8b90-f497-46f5-9edd-0de67b62d546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:28:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-62e035ee-40e2-4b46-b925-41f963c69db3 req-277c5758-f38f-462e-aad3-a8c4f6edbb6d service nova] Releasing lock "refresh_cache-5d5f72a1-afd5-43f1-b803-c8924352acc2" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.network.neutron [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Successfully updated port: 4784b9be-f5b3-47f8-a553-45934b58f35d {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Acquiring lock "refresh_cache-c8fb01bf-c754-445c-ae71-18721cf5de7e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Acquired lock "refresh_cache-c8fb01bf-c754-445c-ae71-18721cf5de7e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.network.neutron [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.compute.manager [req-f9d099c1-fd0a-4e1e-9d07-f910e9d347d3 req-a5bd4de9-bb07-4db9-9509-a1851ce306e5 service nova] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Received event network-changed-4784b9be-f5b3-47f8-a553-45934b58f35d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.compute.manager [req-f9d099c1-fd0a-4e1e-9d07-f910e9d347d3 req-a5bd4de9-bb07-4db9-9509-a1851ce306e5 service nova] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Refreshing instance network info cache due to event network-changed-4784b9be-f5b3-47f8-a553-45934b58f35d. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f9d099c1-fd0a-4e1e-9d07-f910e9d347d3 req-a5bd4de9-bb07-4db9-9509-a1851ce306e5 service nova] Acquiring lock "refresh_cache-c8fb01bf-c754-445c-ae71-18721cf5de7e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.network.neutron [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.compute.manager [req-47fd14c4-662c-4141-a3a0-c82d687b7b95 req-f886b086-1624-4785-a41e-fa7bd3e38cee service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Received event network-vif-plugged-238f8b90-f497-46f5-9edd-0de67b62d546 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-47fd14c4-662c-4141-a3a0-c82d687b7b95 req-f886b086-1624-4785-a41e-fa7bd3e38cee service nova] Acquiring lock "5d5f72a1-afd5-43f1-b803-c8924352acc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-47fd14c4-662c-4141-a3a0-c82d687b7b95 req-f886b086-1624-4785-a41e-fa7bd3e38cee service nova] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-47fd14c4-662c-4141-a3a0-c82d687b7b95 req-f886b086-1624-4785-a41e-fa7bd3e38cee service nova] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.compute.manager [req-47fd14c4-662c-4141-a3a0-c82d687b7b95 req-f886b086-1624-4785-a41e-fa7bd3e38cee service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] No waiting events found dispatching network-vif-plugged-238f8b90-f497-46f5-9edd-0de67b62d546 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:28:36 user nova-compute[70243]: WARNING nova.compute.manager [req-47fd14c4-662c-4141-a3a0-c82d687b7b95 req-f886b086-1624-4785-a41e-fa7bd3e38cee service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Received unexpected event network-vif-plugged-238f8b90-f497-46f5-9edd-0de67b62d546 for instance with vm_state building and task_state spawning.
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.network.neutron [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Updating instance_info_cache with network_info: [{"id": "4784b9be-f5b3-47f8-a553-45934b58f35d", "address": "fa:16:3e:42:7e:a3", "network": {"id": "26f40e99-b090-4a8e-8d72-6b8674b2f716", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919802542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3c0ed911674b69a05524f555ea6e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4784b9be-f5", "ovs_interfaceid": "4784b9be-f5b3-47f8-a553-45934b58f35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Releasing lock "refresh_cache-c8fb01bf-c754-445c-ae71-18721cf5de7e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.compute.manager [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Instance network_info: |[{"id": "4784b9be-f5b3-47f8-a553-45934b58f35d", "address": "fa:16:3e:42:7e:a3", "network": {"id": "26f40e99-b090-4a8e-8d72-6b8674b2f716", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919802542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3c0ed911674b69a05524f555ea6e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4784b9be-f5", "ovs_interfaceid": "4784b9be-f5b3-47f8-a553-45934b58f35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f9d099c1-fd0a-4e1e-9d07-f910e9d347d3 req-a5bd4de9-bb07-4db9-9509-a1851ce306e5 service nova] Acquired lock "refresh_cache-c8fb01bf-c754-445c-ae71-18721cf5de7e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.network.neutron [req-f9d099c1-fd0a-4e1e-9d07-f910e9d347d3 req-a5bd4de9-bb07-4db9-9509-a1851ce306e5 service nova] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Refreshing network info cache for port 4784b9be-f5b3-47f8-a553-45934b58f35d {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Start _get_guest_xml network_info=[{"id": "4784b9be-f5b3-47f8-a553-45934b58f35d", "address": "fa:16:3e:42:7e:a3", "network": {"id": "26f40e99-b090-4a8e-8d72-6b8674b2f716", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919802542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3c0ed911674b69a05524f555ea6e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4784b9be-f5", "ovs_interfaceid": "4784b9be-f5b3-47f8-a553-45934b58f35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:28:36 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:28:36 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:28:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1082198834',display_name='tempest-VolumesActionsTest-instance-1082198834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1082198834',id=25,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb3c0ed911674b69a05524f555ea6e0e',ramdisk_id='',reservation_id='r-0xvfijm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-137271236',owner_user_name='tempest-VolumesActionsTest-137271236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:28:34Z,user_data=None,user_id='8ec427ff69094ac7a8647c0811c2af7c',uuid=c8fb01bf-c754-445c-ae71-18721cf5de7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4784b9be-f5b3-47f8-a553-45934b58f35d", "address": "fa:16:3e:42:7e:a3", "network": {"id": "26f40e99-b090-4a8e-8d72-6b8674b2f716", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919802542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3c0ed911674b69a05524f555ea6e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4784b9be-f5", "ovs_interfaceid": "4784b9be-f5b3-47f8-a553-45934b58f35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Converting VIF {"id": "4784b9be-f5b3-47f8-a553-45934b58f35d", "address": "fa:16:3e:42:7e:a3", "network": {"id": "26f40e99-b090-4a8e-8d72-6b8674b2f716", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919802542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3c0ed911674b69a05524f555ea6e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4784b9be-f5", "ovs_interfaceid": "4784b9be-f5b3-47f8-a553-45934b58f35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:7e:a3,bridge_name='br-int',has_traffic_filtering=True,id=4784b9be-f5b3-47f8-a553-45934b58f35d,network=Network(26f40e99-b090-4a8e-8d72-6b8674b2f716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4784b9be-f5') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.objects.instance [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lazy-loading 'pci_devices' on Instance uuid c8fb01bf-c754-445c-ae71-18721cf5de7e {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:28:36 user nova-compute[70243]:   <uuid>c8fb01bf-c754-445c-ae71-18721cf5de7e</uuid>
Jul 24 16:28:36 user nova-compute[70243]:   <name>instance-00000019</name>
Jul 24 16:28:36 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:28:36 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:28:36 user nova-compute[70243]:   <metadata>
Jul 24 16:28:36 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:28:36 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:28:36 user nova-compute[70243]:       <nova:name>tempest-VolumesActionsTest-instance-1082198834</nova:name>
Jul 24 16:28:36 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:28:36</nova:creationTime>
Jul 24 16:28:36 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:28:36 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:28:36 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:28:36 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:28:36 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:28:36 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:28:36 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:28:36 user nova-compute[70243]:       <nova:owner>
Jul 24 16:28:36 user nova-compute[70243]:         <nova:user uuid="8ec427ff69094ac7a8647c0811c2af7c">tempest-VolumesActionsTest-137271236-project-member</nova:user>
Jul 24 16:28:36 user nova-compute[70243]:         <nova:project uuid="fb3c0ed911674b69a05524f555ea6e0e">tempest-VolumesActionsTest-137271236</nova:project>
Jul 24 16:28:36 user nova-compute[70243]:       </nova:owner>
Jul 24 16:28:36 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:28:36 user nova-compute[70243]:       <nova:ports>
Jul 24 16:28:36 user nova-compute[70243]:         <nova:port uuid="4784b9be-f5b3-47f8-a553-45934b58f35d">
Jul 24 16:28:36 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 24 16:28:36 user nova-compute[70243]:         </nova:port>
Jul 24 16:28:36 user nova-compute[70243]:       </nova:ports>
Jul 24 16:28:36 user nova-compute[70243]:     </nova:instance>
Jul 24 16:28:36 user nova-compute[70243]:   </metadata>
Jul 24 16:28:36 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:28:36 user nova-compute[70243]:     <system>
Jul 24 16:28:36 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:28:36 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:28:36 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:28:36 user nova-compute[70243]:       <entry name="serial">c8fb01bf-c754-445c-ae71-18721cf5de7e</entry>
Jul 24 16:28:36 user nova-compute[70243]:       <entry name="uuid">c8fb01bf-c754-445c-ae71-18721cf5de7e</entry>
Jul 24 16:28:36 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:28:36 user nova-compute[70243]:     </system>
Jul 24 16:28:36 user nova-compute[70243]:   </sysinfo>
Jul 24 16:28:36 user nova-compute[70243]:   <os>
Jul 24 16:28:36 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:28:36 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:28:36 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:28:36 user nova-compute[70243]:   </os>
Jul 24 16:28:36 user nova-compute[70243]:   <features>
Jul 24 16:28:36 user nova-compute[70243]:     <acpi/>
Jul 24 16:28:36 user nova-compute[70243]:     <apic/>
Jul 24 16:28:36 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:28:36 user nova-compute[70243]:   </features>
Jul 24 16:28:36 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:28:36 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:28:36 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:28:36 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:28:36 user nova-compute[70243]:   </clock>
Jul 24 16:28:36 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:28:36 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:28:36 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:28:36 user nova-compute[70243]:   </cpu>
Jul 24 16:28:36 user nova-compute[70243]:   <devices>
Jul 24 16:28:36 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:28:36 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:28:36 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/c8fb01bf-c754-445c-ae71-18721cf5de7e/disk"/>
Jul 24 16:28:36 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:28:36 user nova-compute[70243]:     </disk>
Jul 24 16:28:36 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:28:36 user nova-compute[70243]:       <mac address="fa:16:3e:42:7e:a3"/>
Jul 24 16:28:36 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:28:36 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:28:36 user nova-compute[70243]:       <target dev="tap4784b9be-f5"/>
Jul 24 16:28:36 user nova-compute[70243]:     </interface>
Jul 24 16:28:36 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:28:36 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/c8fb01bf-c754-445c-ae71-18721cf5de7e/console.log" append="off"/>
Jul 24 16:28:36 user nova-compute[70243]:     </serial>
Jul 24 16:28:36 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:28:36 user nova-compute[70243]:     <video>
Jul 24 16:28:36 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:28:36 user nova-compute[70243]:     </video>
Jul 24 16:28:36 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:28:36 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:28:36 user nova-compute[70243]:     </rng>
Jul 24 16:28:36 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:28:36 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:28:36 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:28:36 user nova-compute[70243]:     </memballoon>
Jul 24 16:28:36 user nova-compute[70243]:   </devices>
Jul 24 16:28:36 user nova-compute[70243]: </domain>
Jul 24 16:28:36 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:28:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1082198834',display_name='tempest-VolumesActionsTest-instance-1082198834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1082198834',id=25,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb3c0ed911674b69a05524f555ea6e0e',ramdisk_id='',reservation_id='r-0xvfijm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-137271236',owner_user_name='tempest-VolumesActionsTest-137271236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:28:34Z,user_data=None,user_id='8ec427ff69094ac7a8647c0811c2af7c',uuid=c8fb01bf-c754-445c-ae71-18721cf5de7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4784b9be-f5b3-47f8-a553-45934b58f35d", "address": "fa:16:3e:42:7e:a3", "network": {"id": "26f40e99-b090-4a8e-8d72-6b8674b2f716", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919802542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3c0ed911674b69a05524f555ea6e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4784b9be-f5", "ovs_interfaceid": "4784b9be-f5b3-47f8-a553-45934b58f35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Converting VIF {"id": "4784b9be-f5b3-47f8-a553-45934b58f35d", "address": "fa:16:3e:42:7e:a3", "network": {"id": "26f40e99-b090-4a8e-8d72-6b8674b2f716", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919802542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3c0ed911674b69a05524f555ea6e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4784b9be-f5", "ovs_interfaceid": "4784b9be-f5b3-47f8-a553-45934b58f35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:7e:a3,bridge_name='br-int',has_traffic_filtering=True,id=4784b9be-f5b3-47f8-a553-45934b58f35d,network=Network(26f40e99-b090-4a8e-8d72-6b8674b2f716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4784b9be-f5') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG os_vif [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:7e:a3,bridge_name='br-int',has_traffic_filtering=True,id=4784b9be-f5b3-47f8-a553-45934b58f35d,network=Network(26f40e99-b090-4a8e-8d72-6b8674b2f716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4784b9be-f5') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4784b9be-f5, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4784b9be-f5, col_values=(('external_ids', {'iface-id': '4784b9be-f5b3-47f8-a553-45934b58f35d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:7e:a3', 'vm-uuid': 'c8fb01bf-c754-445c-ae71-18721cf5de7e'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:36 user nova-compute[70243]: INFO os_vif [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:7e:a3,bridge_name='br-int',has_traffic_filtering=True,id=4784b9be-f5b3-47f8-a553-45934b58f35d,network=Network(26f40e99-b090-4a8e-8d72-6b8674b2f716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4784b9be-f5')
Jul 24 16:28:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] No VIF found with MAC fa:16:3e:42:7e:a3, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:37 user nova-compute[70243]: DEBUG nova.network.neutron [req-f9d099c1-fd0a-4e1e-9d07-f910e9d347d3 req-a5bd4de9-bb07-4db9-9509-a1851ce306e5 service nova] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Updated VIF entry in instance network info cache for port 4784b9be-f5b3-47f8-a553-45934b58f35d. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:28:37 user nova-compute[70243]: DEBUG nova.network.neutron [req-f9d099c1-fd0a-4e1e-9d07-f910e9d347d3 req-a5bd4de9-bb07-4db9-9509-a1851ce306e5 service nova] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Updating instance_info_cache with network_info: [{"id": "4784b9be-f5b3-47f8-a553-45934b58f35d", "address": "fa:16:3e:42:7e:a3", "network": {"id": "26f40e99-b090-4a8e-8d72-6b8674b2f716", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919802542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3c0ed911674b69a05524f555ea6e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4784b9be-f5", "ovs_interfaceid": "4784b9be-f5b3-47f8-a553-45934b58f35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:28:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f9d099c1-fd0a-4e1e-9d07-f910e9d347d3 req-a5bd4de9-bb07-4db9-9509-a1851ce306e5 service nova] Releasing lock "refresh_cache-c8fb01bf-c754-445c-ae71-18721cf5de7e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216118.297279, 5d5f72a1-afd5-43f1-b803-c8924352acc2 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:28:38 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] VM Resumed (Lifecycle Event)
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:28:38 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Instance spawned successfully.
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:28:38 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216118.3038123, 5d5f72a1-afd5-43f1-b803-c8924352acc2 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:28:38 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] VM Started (Lifecycle Event)
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:28:38 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.compute.manager [req-163034f0-8ab3-4785-9434-a10ca65848ed req-39a28624-a9a5-4866-b5a7-b3b96d0d5183 service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Received event network-vif-plugged-238f8b90-f497-46f5-9edd-0de67b62d546 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-163034f0-8ab3-4785-9434-a10ca65848ed req-39a28624-a9a5-4866-b5a7-b3b96d0d5183 service nova] Acquiring lock "5d5f72a1-afd5-43f1-b803-c8924352acc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-163034f0-8ab3-4785-9434-a10ca65848ed req-39a28624-a9a5-4866-b5a7-b3b96d0d5183 service nova] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-163034f0-8ab3-4785-9434-a10ca65848ed req-39a28624-a9a5-4866-b5a7-b3b96d0d5183 service nova] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.compute.manager [req-163034f0-8ab3-4785-9434-a10ca65848ed req-39a28624-a9a5-4866-b5a7-b3b96d0d5183 service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] No waiting events found dispatching network-vif-plugged-238f8b90-f497-46f5-9edd-0de67b62d546 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:28:38 user nova-compute[70243]: WARNING nova.compute.manager [req-163034f0-8ab3-4785-9434-a10ca65848ed req-39a28624-a9a5-4866-b5a7-b3b96d0d5183 service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Received unexpected event network-vif-plugged-238f8b90-f497-46f5-9edd-0de67b62d546 for instance with vm_state building and task_state spawning.
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.compute.manager [req-163034f0-8ab3-4785-9434-a10ca65848ed req-39a28624-a9a5-4866-b5a7-b3b96d0d5183 service nova] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Received event network-vif-plugged-4784b9be-f5b3-47f8-a553-45934b58f35d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-163034f0-8ab3-4785-9434-a10ca65848ed req-39a28624-a9a5-4866-b5a7-b3b96d0d5183 service nova] Acquiring lock "c8fb01bf-c754-445c-ae71-18721cf5de7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-163034f0-8ab3-4785-9434-a10ca65848ed req-39a28624-a9a5-4866-b5a7-b3b96d0d5183 service nova] Lock "c8fb01bf-c754-445c-ae71-18721cf5de7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-163034f0-8ab3-4785-9434-a10ca65848ed req-39a28624-a9a5-4866-b5a7-b3b96d0d5183 service nova] Lock "c8fb01bf-c754-445c-ae71-18721cf5de7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.compute.manager [req-163034f0-8ab3-4785-9434-a10ca65848ed req-39a28624-a9a5-4866-b5a7-b3b96d0d5183 service nova] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] No waiting events found dispatching network-vif-plugged-4784b9be-f5b3-47f8-a553-45934b58f35d {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:28:38 user nova-compute[70243]: WARNING nova.compute.manager [req-163034f0-8ab3-4785-9434-a10ca65848ed req-39a28624-a9a5-4866-b5a7-b3b96d0d5183 service nova] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Received unexpected event network-vif-plugged-4784b9be-f5b3-47f8-a553-45934b58f35d for instance with vm_state building and task_state spawning.
Jul 24 16:28:38 user nova-compute[70243]: INFO nova.compute.manager [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Took 6.58 seconds to spawn the instance on the hypervisor.
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:28:38 user nova-compute[70243]: INFO nova.compute.manager [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Took 7.39 seconds to build instance.
Jul 24 16:28:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8c80ad9-28b3-4837-9b8e-b77c3505fb2f tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.501s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.compute.manager [req-e40d521d-3f9b-4840-a25d-0df2c6bc6d66 req-b5854027-aa5e-4f70-97f3-2163d438766f service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Received event network-changed-e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.compute.manager [req-e40d521d-3f9b-4840-a25d-0df2c6bc6d66 req-b5854027-aa5e-4f70-97f3-2163d438766f service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Refreshing instance network info cache due to event network-changed-e709e269-eff5-4ac2-8c2a-29048448a422. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e40d521d-3f9b-4840-a25d-0df2c6bc6d66 req-b5854027-aa5e-4f70-97f3-2163d438766f service nova] Acquiring lock "refresh_cache-de22ea98-b041-4f3f-8986-435c43267a2e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e40d521d-3f9b-4840-a25d-0df2c6bc6d66 req-b5854027-aa5e-4f70-97f3-2163d438766f service nova] Acquired lock "refresh_cache-de22ea98-b041-4f3f-8986-435c43267a2e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG nova.network.neutron [req-e40d521d-3f9b-4840-a25d-0df2c6bc6d66 req-b5854027-aa5e-4f70-97f3-2163d438766f service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Refreshing network info cache for port e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:28:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:39 user nova-compute[70243]: DEBUG nova.network.neutron [req-e40d521d-3f9b-4840-a25d-0df2c6bc6d66 req-b5854027-aa5e-4f70-97f3-2163d438766f service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Updated VIF entry in instance network info cache for port e709e269-eff5-4ac2-8c2a-29048448a422. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:28:39 user nova-compute[70243]: DEBUG nova.network.neutron [req-e40d521d-3f9b-4840-a25d-0df2c6bc6d66 req-b5854027-aa5e-4f70-97f3-2163d438766f service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Updating instance_info_cache with network_info: [{"id": "e709e269-eff5-4ac2-8c2a-29048448a422", "address": "fa:16:3e:0a:84:99", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape709e269-ef", "ovs_interfaceid": "e709e269-eff5-4ac2-8c2a-29048448a422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:28:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e40d521d-3f9b-4840-a25d-0df2c6bc6d66 req-b5854027-aa5e-4f70-97f3-2163d438766f service nova] Releasing lock "refresh_cache-de22ea98-b041-4f3f-8986-435c43267a2e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:28:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:40 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216120.4971297, c8fb01bf-c754-445c-ae71-18721cf5de7e => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:28:40 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] VM Resumed (Lifecycle Event)
Jul 24 16:28:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:28:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:28:40 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Instance spawned successfully.
Jul 24 16:28:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:28:40 user nova-compute[70243]: DEBUG nova.compute.manager [req-bd2a0a12-c3b3-4710-9ac8-3b3684f7bad5 req-52c8d73e-0a56-4c27-89ce-f2b2edfab87f service nova] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Received event network-vif-plugged-4784b9be-f5b3-47f8-a553-45934b58f35d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:28:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-bd2a0a12-c3b3-4710-9ac8-3b3684f7bad5 req-52c8d73e-0a56-4c27-89ce-f2b2edfab87f service nova] Acquiring lock "c8fb01bf-c754-445c-ae71-18721cf5de7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-bd2a0a12-c3b3-4710-9ac8-3b3684f7bad5 req-52c8d73e-0a56-4c27-89ce-f2b2edfab87f service nova] Lock "c8fb01bf-c754-445c-ae71-18721cf5de7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-bd2a0a12-c3b3-4710-9ac8-3b3684f7bad5 req-52c8d73e-0a56-4c27-89ce-f2b2edfab87f service nova] Lock "c8fb01bf-c754-445c-ae71-18721cf5de7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:40 user nova-compute[70243]: DEBUG nova.compute.manager [req-bd2a0a12-c3b3-4710-9ac8-3b3684f7bad5 req-52c8d73e-0a56-4c27-89ce-f2b2edfab87f service nova] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] No waiting events found dispatching network-vif-plugged-4784b9be-f5b3-47f8-a553-45934b58f35d {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:28:40 user nova-compute[70243]: WARNING nova.compute.manager [req-bd2a0a12-c3b3-4710-9ac8-3b3684f7bad5 req-52c8d73e-0a56-4c27-89ce-f2b2edfab87f service nova] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Received unexpected event network-vif-plugged-4784b9be-f5b3-47f8-a553-45934b58f35d for instance with vm_state building and task_state spawning.
Jul 24 16:28:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:28:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:28:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:28:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:28:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:28:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:28:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:28:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:28:40 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:28:40 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216120.5007956, c8fb01bf-c754-445c-ae71-18721cf5de7e => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:28:40 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] VM Started (Lifecycle Event)
Jul 24 16:28:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:28:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:28:40 user nova-compute[70243]: INFO nova.compute.manager [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Took 6.79 seconds to spawn the instance on the hypervisor.
Jul 24 16:28:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:28:40 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:28:40 user nova-compute[70243]: INFO nova.compute.manager [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Took 7.57 seconds to build instance.
Jul 24 16:28:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4bbb0f50-fe47-47e8-a9a9-d70613675609 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "c8fb01bf-c754-445c-ae71-18721cf5de7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.673s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:40 user nova-compute[70243]: DEBUG nova.compute.manager [req-f8153983-10b2-4944-8f8a-9167ef7a01f7 req-87138f55-9827-49a0-a1a0-c0b7344ebe60 service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Received event network-changed-021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:28:40 user nova-compute[70243]: DEBUG nova.compute.manager [req-f8153983-10b2-4944-8f8a-9167ef7a01f7 req-87138f55-9827-49a0-a1a0-c0b7344ebe60 service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Refreshing instance network info cache due to event network-changed-021971db-1e79-467f-8f5b-5361f205fceb. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:28:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f8153983-10b2-4944-8f8a-9167ef7a01f7 req-87138f55-9827-49a0-a1a0-c0b7344ebe60 service nova] Acquiring lock "refresh_cache-6ed1935d-3a60-418e-bc44-ed65452afc1a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:28:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f8153983-10b2-4944-8f8a-9167ef7a01f7 req-87138f55-9827-49a0-a1a0-c0b7344ebe60 service nova] Acquired lock "refresh_cache-6ed1935d-3a60-418e-bc44-ed65452afc1a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:28:40 user nova-compute[70243]: DEBUG nova.network.neutron [req-f8153983-10b2-4944-8f8a-9167ef7a01f7 req-87138f55-9827-49a0-a1a0-c0b7344ebe60 service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Refreshing network info cache for port 021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:28:41 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Stashing vm_state: active {{(pid=70243) _prep_resize /opt/stack/nova/nova/compute/manager.py:5529}}
Jul 24 16:28:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:41 user nova-compute[70243]: DEBUG nova.objects.instance [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lazy-loading 'pci_requests' on Instance uuid 6ed1935d-3a60-418e-bc44-ed65452afc1a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:28:41 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:28:41 user nova-compute[70243]: INFO nova.compute.claims [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Claim successful on node user
Jul 24 16:28:41 user nova-compute[70243]: DEBUG nova.objects.instance [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lazy-loading 'resources' on Instance uuid 6ed1935d-3a60-418e-bc44-ed65452afc1a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:28:41 user nova-compute[70243]: DEBUG nova.objects.instance [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ed1935d-3a60-418e-bc44-ed65452afc1a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:28:41 user nova-compute[70243]: INFO nova.compute.resource_tracker [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Updating resource usage from migration fd176af4-9996-4d94-805d-cc43802750cf
Jul 24 16:28:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:41 user nova-compute[70243]: DEBUG nova.network.neutron [req-f8153983-10b2-4944-8f8a-9167ef7a01f7 req-87138f55-9827-49a0-a1a0-c0b7344ebe60 service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Updated VIF entry in instance network info cache for port 021971db-1e79-467f-8f5b-5361f205fceb. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:28:41 user nova-compute[70243]: DEBUG nova.network.neutron [req-f8153983-10b2-4944-8f8a-9167ef7a01f7 req-87138f55-9827-49a0-a1a0-c0b7344ebe60 service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Updating instance_info_cache with network_info: [{"id": "021971db-1e79-467f-8f5b-5361f205fceb", "address": "fa:16:3e:4a:88:70", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021971db-1e", "ovs_interfaceid": "021971db-1e79-467f-8f5b-5361f205fceb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:28:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f8153983-10b2-4944-8f8a-9167ef7a01f7 req-87138f55-9827-49a0-a1a0-c0b7344ebe60 service nova] Releasing lock "refresh_cache-6ed1935d-3a60-418e-bc44-ed65452afc1a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:28:41 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:28:41 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:28:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.704s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:41 user nova-compute[70243]: INFO nova.compute.manager [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Migrating
Jul 24 16:28:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "refresh_cache-6ed1935d-3a60-418e-bc44-ed65452afc1a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:28:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquired lock "refresh_cache-6ed1935d-3a60-418e-bc44-ed65452afc1a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:28:42 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:28:42 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:28:42 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Updating instance_info_cache with network_info: [{"id": "021971db-1e79-467f-8f5b-5361f205fceb", "address": "fa:16:3e:4a:88:70", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021971db-1e", "ovs_interfaceid": "021971db-1e79-467f-8f5b-5361f205fceb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:28:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Releasing lock "refresh_cache-6ed1935d-3a60-418e-bc44-ed65452afc1a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:28:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Starting migrate_disk_and_power_off {{(pid=70243) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 24 16:28:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG nova.compute.manager [req-857ed733-f751-4ae1-9889-da2f9930590c req-32796990-42e9-4bd5-acc8-1eb59a6ac9be service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Received event network-vif-unplugged-021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-857ed733-f751-4ae1-9889-da2f9930590c req-32796990-42e9-4bd5-acc8-1eb59a6ac9be service nova] Acquiring lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-857ed733-f751-4ae1-9889-da2f9930590c req-32796990-42e9-4bd5-acc8-1eb59a6ac9be service nova] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-857ed733-f751-4ae1-9889-da2f9930590c req-32796990-42e9-4bd5-acc8-1eb59a6ac9be service nova] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG nova.compute.manager [req-857ed733-f751-4ae1-9889-da2f9930590c req-32796990-42e9-4bd5-acc8-1eb59a6ac9be service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] No waiting events found dispatching network-vif-unplugged-021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:28:43 user nova-compute[70243]: WARNING nova.compute.manager [req-857ed733-f751-4ae1-9889-da2f9930590c req-32796990-42e9-4bd5-acc8-1eb59a6ac9be service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Received unexpected event network-vif-unplugged-021971db-1e79-467f-8f5b-5361f205fceb for instance with vm_state active and task_state resize_migrating.
Jul 24 16:28:43 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Instance destroyed successfully.
Jul 24 16:28:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:26:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1036526617',display_name='tempest-ServerActionsTestOtherA-server-1036526617',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1036526617',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNt4ywOtyDbY3gzVxioiadq0RHvp3ujVzU7+egeM9QHVtvP6DGqg4hSRwxq8r4OyAFnfBqKPWEeStDLSLwfjx+5dISRxZesWLAiccd5P+5WMBwka91+aa63O7dxU+RVwA==',key_name='tempest-keypair-283031417',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:27:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ebdb3cb079814db091227f80b2ed1b9d',ramdisk_id='',reservation_id='r-bvklrqc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-39125821',owner_user_name='tempest-ServerActionsTestOtherA-39125821-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:28:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa3936255d31421184e585e2fd17d7ef',uuid=6ed1935d-3a60-418e-bc44-ed65452afc1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "021971db-1e79-467f-8f5b-5361f205fceb", "address": "fa:16:3e:4a:88:70", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-757960214-network", "vif_mac": "fa:16:3e:4a:88:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021971db-1e", "ovs_interfaceid": "021971db-1e79-467f-8f5b-5361f205fceb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converting VIF {"id": "021971db-1e79-467f-8f5b-5361f205fceb", "address": "fa:16:3e:4a:88:70", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-757960214-network", "vif_mac": "fa:16:3e:4a:88:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021971db-1e", "ovs_interfaceid": "021971db-1e79-467f-8f5b-5361f205fceb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:88:70,bridge_name='br-int',has_traffic_filtering=True,id=021971db-1e79-467f-8f5b-5361f205fceb,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021971db-1e') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG os_vif [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:88:70,bridge_name='br-int',has_traffic_filtering=True,id=021971db-1e79-467f-8f5b-5361f205fceb,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021971db-1e') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap021971db-1e, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:43 user nova-compute[70243]: INFO os_vif [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:88:70,bridge_name='br-int',has_traffic_filtering=True,id=021971db-1e79-467f-8f5b-5361f205fceb,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021971db-1e')
Jul 24 16:28:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVOWQZzq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:28:43 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:28:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5503b3db-f19a-47a0-82fb-187e3aeb471d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:28:43 user nova-compute[70243]: No targets found.
Jul 24 16:28:43 user nova-compute[70243]: iSNS:
Jul 24 16:28:43 user nova-compute[70243]: No targets found.
Jul 24 16:28:43 user nova-compute[70243]: STATIC:
Jul 24 16:28:43 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8
Jul 24 16:28:43 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:28:43 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:28:43 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3
Jul 24 16:28:43 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:28:43 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:28:43 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c
Jul 24 16:28:43 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:28:43 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:28:43 user nova-compute[70243]: FIRMWARE:
Jul 24 16:28:43 user nova-compute[70243]: No targets found.
Jul 24 16:28:43 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:28:43 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:28:43 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17108d7-a02e-4254-8919-6fbe11a560f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18352e4-c3bc-47e7-99f7-086305837f7b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:28:43 user nova-compute[70243]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:28:43 user nova-compute[70243]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)
Jul 24 16:28:43 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:28:43 user nova-compute[70243]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:28:43 user nova-compute[70243]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)
Jul 24 16:28:43 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc1349d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8'): ({'sdb'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Removing single pathed devices sdb {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1663bb-1d11-49c4-9fa9-2316bd1958bc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3628ee-a8b0-4860-b1bc-7097b4bd18b4]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Flushing IO for device /dev/sdb {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1277160-2f7b-4471-a6a8-170987a5a13b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0151e591-1ee3-42d7-971f-2c853fceff06]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b216c318', '/dev/disk/by-id/scsi-26562303032373133', '/dev/disk/by-id/scsi-1SCST_BIOb216c318-eb002713f8ec5879') {{(pid=81266) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9d858e-2822-41b7-828f-38419f893a48]: (4, None) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c56acd3-a754-4dbd-bdee-f7798ea7c615]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:28:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:44 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a69c29-9518-41d2-8334-a4113e2ca558]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8, portal: 172.16.0.220,3260]
Jul 24 16:28:44 user nova-compute[70243]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8, portal: 172.16.0.220,3260] successful.
Jul 24 16:28:44 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:28:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:44 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5e85cf-9884-4c0b-9323-c67406f8af92]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:28:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:28:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] <== disconnect_volume: return (405ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:28:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:28:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:28:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Port 021971db-1e79-467f-8f5b-5361f205fceb binding to destination host user is already ACTIVE {{(pid=70243) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "refresh_cache-6ed1935d-3a60-418e-bc44-ed65452afc1a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquired lock "refresh_cache-6ed1935d-3a60-418e-bc44-ed65452afc1a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG nova.compute.manager [req-fca210b1-9951-4750-a540-29284ae27b49 req-94278105-07a0-4b78-97e3-e342bfe2918b service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Received event network-vif-plugged-021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fca210b1-9951-4750-a540-29284ae27b49 req-94278105-07a0-4b78-97e3-e342bfe2918b service nova] Acquiring lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fca210b1-9951-4750-a540-29284ae27b49 req-94278105-07a0-4b78-97e3-e342bfe2918b service nova] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fca210b1-9951-4750-a540-29284ae27b49 req-94278105-07a0-4b78-97e3-e342bfe2918b service nova] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG nova.compute.manager [req-fca210b1-9951-4750-a540-29284ae27b49 req-94278105-07a0-4b78-97e3-e342bfe2918b service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] No waiting events found dispatching network-vif-plugged-021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:28:45 user nova-compute[70243]: WARNING nova.compute.manager [req-fca210b1-9951-4750-a540-29284ae27b49 req-94278105-07a0-4b78-97e3-e342bfe2918b service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Received unexpected event network-vif-plugged-021971db-1e79-467f-8f5b-5361f205fceb for instance with vm_state active and task_state resize_migrated.
Jul 24 16:28:45 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Updating instance_info_cache with network_info: [{"id": "021971db-1e79-467f-8f5b-5361f205fceb", "address": "fa:16:3e:4a:88:70", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021971db-1e", "ovs_interfaceid": "021971db-1e79-467f-8f5b-5361f205fceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Releasing lock "refresh_cache-6ed1935d-3a60-418e-bc44-ed65452afc1a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG os_brick.utils [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c03bd1-d91e-4959-9e49-8149046bcbae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[94860f65-fd09-4294-bf9f-4e3dc55f046f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d6a05d-b143-4888-8948-ec566bb97179]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa5f20e-36d1-4ed9-81dd-15a93cc95428]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:28:46 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:28:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:28:46 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:28:46 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70f851e-9e59-4a3b-9918-a6c350a67baf]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:46 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:28:46 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:28:46 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:28:46 user nova-compute[70243]: DEBUG os_brick.utils [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:28:46 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:28:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:28:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Acquiring lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Acquiring lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:47 user nova-compute[70243]: INFO nova.compute.manager [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Terminating instance
Jul 24 16:28:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:28:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:47 user nova-compute[70243]: DEBUG nova.compute.manager [req-e047be66-9c35-4555-916b-651a670fccba req-27d81df9-2950-46fb-94c8-778dcfc2d34a service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Received event network-vif-unplugged-d441139a-506e-44b6-9bea-0825befacf40 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:28:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e047be66-9c35-4555-916b-651a670fccba req-27d81df9-2950-46fb-94c8-778dcfc2d34a service nova] Acquiring lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e047be66-9c35-4555-916b-651a670fccba req-27d81df9-2950-46fb-94c8-778dcfc2d34a service nova] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e047be66-9c35-4555-916b-651a670fccba req-27d81df9-2950-46fb-94c8-778dcfc2d34a service nova] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:47 user nova-compute[70243]: DEBUG nova.compute.manager [req-e047be66-9c35-4555-916b-651a670fccba req-27d81df9-2950-46fb-94c8-778dcfc2d34a service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] No waiting events found dispatching network-vif-unplugged-d441139a-506e-44b6-9bea-0825befacf40 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:28:47 user nova-compute[70243]: DEBUG nova.compute.manager [req-e047be66-9c35-4555-916b-651a670fccba req-27d81df9-2950-46fb-94c8-778dcfc2d34a service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Received event network-vif-unplugged-d441139a-506e-44b6-9bea-0825befacf40 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:28:48 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Instance destroyed successfully.
Jul 24 16:28:48 user nova-compute[70243]: DEBUG nova.objects.instance [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lazy-loading 'resources' on Instance uuid 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:28:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-07-24T16:25:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-305165087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-305165087',id=20,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqr4Sb1YiAbSsHxY/YCQVoIvx0BtmisaU3JoqCzarQMjncCNKMWQUfzzjinb/WTtTYj0jaZsWe6GxxviHHKByoit7MC06BJwyYNp7QiEzsbdQ26xq1MPIO2FeXV/7igXw==',key_name='tempest-keypair-751084804',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:25:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21d8ae9e361c4588ac564ac242dcab21',ramdisk_id='',reservation_id='r-kztppkde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-130428048',owner_user_name='tempest-TaggedAttachmentsTest-130428048-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:25:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='695787042f9f4e4eb0997bf72d169913',uuid=9e4e0f20-5488-44ce-ac82-e0e77b8a3e30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d441139a-506e-44b6-9bea-0825befacf40", "address": "fa:16:3e:61:2d:32", "network": {"id": "99dd3690-f380-4199-b2cd-a871694533f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1380968726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd441139a-50", "ovs_interfaceid": "d441139a-506e-44b6-9bea-0825befacf40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:28:48 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Converting VIF {"id": "d441139a-506e-44b6-9bea-0825befacf40", "address": "fa:16:3e:61:2d:32", "network": {"id": "99dd3690-f380-4199-b2cd-a871694533f7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1380968726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d8ae9e361c4588ac564ac242dcab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd441139a-50", "ovs_interfaceid": "d441139a-506e-44b6-9bea-0825befacf40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:28:48 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:2d:32,bridge_name='br-int',has_traffic_filtering=True,id=d441139a-506e-44b6-9bea-0825befacf40,network=Network(99dd3690-f380-4199-b2cd-a871694533f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd441139a-50') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:28:48 user nova-compute[70243]: DEBUG os_vif [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:2d:32,bridge_name='br-int',has_traffic_filtering=True,id=d441139a-506e-44b6-9bea-0825befacf40,network=Network(99dd3690-f380-4199-b2cd-a871694533f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd441139a-50') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:28:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd441139a-50, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:28:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:28:48 user nova-compute[70243]: INFO os_vif [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:2d:32,bridge_name='br-int',has_traffic_filtering=True,id=d441139a-506e-44b6-9bea-0825befacf40,network=Network(99dd3690-f380-4199-b2cd-a871694533f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd441139a-50')
Jul 24 16:28:48 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Deleting instance files /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30_del
Jul 24 16:28:48 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Deletion of /opt/stack/data/nova/instances/9e4e0f20-5488-44ce-ac82-e0e77b8a3e30_del complete
Jul 24 16:28:48 user nova-compute[70243]: INFO nova.compute.manager [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 24 16:28:48 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:28:48 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:28:48 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:28:49 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Took 1.02 seconds to deallocate network for instance.
Jul 24 16:28:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG nova.compute.manager [req-d89aaa8b-559a-4652-b799-7ca324f7f9fb req-b7807554-87cb-4368-91e3-5d5ef722dc65 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Received event network-vif-deleted-d441139a-506e-44b6-9bea-0825befacf40 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:28:49 user nova-compute[70243]: INFO nova.compute.manager [req-d89aaa8b-559a-4652-b799-7ca324f7f9fb req-b7807554-87cb-4368-91e3-5d5ef722dc65 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Neutron deleted interface d441139a-506e-44b6-9bea-0825befacf40; detaching it from the instance and deleting it from the info cache
Jul 24 16:28:49 user nova-compute[70243]: DEBUG nova.network.neutron [req-d89aaa8b-559a-4652-b799-7ca324f7f9fb req-b7807554-87cb-4368-91e3-5d5ef722dc65 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG nova.compute.manager [req-d89aaa8b-559a-4652-b799-7ca324f7f9fb req-b7807554-87cb-4368-91e3-5d5ef722dc65 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Detach interface failed, port_id=d441139a-506e-44b6-9bea-0825befacf40, reason: Instance 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 could not be found. {{(pid=70243) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a84c738-68d3-463f-8cb4-170be05abbdf/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a84c738-68d3-463f-8cb4-170be05abbdf/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a84c738-68d3-463f-8cb4-170be05abbdf/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG nova.compute.manager [req-61804dbc-a668-4a6c-94ef-d6282b9abb97 req-0dd1d026-d8ed-401e-9ca0-d61bc0f72fe2 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Received event network-vif-plugged-d441139a-506e-44b6-9bea-0825befacf40 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-61804dbc-a668-4a6c-94ef-d6282b9abb97 req-0dd1d026-d8ed-401e-9ca0-d61bc0f72fe2 service nova] Acquiring lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-61804dbc-a668-4a6c-94ef-d6282b9abb97 req-0dd1d026-d8ed-401e-9ca0-d61bc0f72fe2 service nova] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-61804dbc-a668-4a6c-94ef-d6282b9abb97 req-0dd1d026-d8ed-401e-9ca0-d61bc0f72fe2 service nova] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG nova.compute.manager [req-61804dbc-a668-4a6c-94ef-d6282b9abb97 req-0dd1d026-d8ed-401e-9ca0-d61bc0f72fe2 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] No waiting events found dispatching network-vif-plugged-d441139a-506e-44b6-9bea-0825befacf40 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:28:49 user nova-compute[70243]: WARNING nova.compute.manager [req-61804dbc-a668-4a6c-94ef-d6282b9abb97 req-0dd1d026-d8ed-401e-9ca0-d61bc0f72fe2 service nova] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Received unexpected event network-vif-plugged-d441139a-506e-44b6-9bea-0825befacf40 for instance with vm_state deleted and task_state None.
Jul 24 16:28:49 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a84c738-68d3-463f-8cb4-170be05abbdf/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.500s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:49 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Deleted allocations for instance 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30
Jul 24 16:28:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-820db9d9-9fb8-441f-83d2-48614cf575d5 tempest-TaggedAttachmentsTest-130428048 tempest-TaggedAttachmentsTest-130428048-project-member] Lock "9e4e0f20-5488-44ce-ac82-e0e77b8a3e30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.659s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:28:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:28:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8fb01bf-c754-445c-ae71-18721cf5de7e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8fb01bf-c754-445c-ae71-18721cf5de7e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8fb01bf-c754-445c-ae71-18721cf5de7e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8fb01bf-c754-445c-ae71-18721cf5de7e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:53 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:28:53 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=7402MB free_disk=24.316905975341797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "abcd54bc-02d4-4872-8227-43cb93d27491" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "abcd54bc-02d4-4872-8227-43cb93d27491" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:53 user nova-compute[70243]: INFO nova.compute.manager [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Detaching volume eb7c1819-e8e1-41be-983c-8322cd613c9c
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Starting finish_migration {{(pid=70243) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Instance directory exists: not creating {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 16:28:53 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Creating image(s)
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Did not create local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Ensure instance console log exists: /opt/stack/data/nova/instances/6ed1935d-3a60-418e-bc44-ed65452afc1a/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Start _get_guest_xml network_info=[{"id": "021971db-1e79-467f-8f5b-5361f205fceb", "address": "fa:16:3e:4a:88:70", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-757960214-network", "vif_mac": "fa:16:3e:4a:88:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021971db-1e", "ovs_interfaceid": "021971db-1e79-467f-8f5b-5361f205fceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVOWQZzq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6ed1935d-3a60-418e-bc44-ed65452afc1a', 'attached_at': '2023-07-24T16:28:53.000000', 'detached_at': '', 'volume_id': '8d7390a0-1192-49ab-b8a9-9c449d89ecd8', 'serial': '8d7390a0-1192-49ab-b8a9-9c449d89ecd8'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'a1e3a50c-1607-4a69-8098-2c57b7bcf99f', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:28:53 user nova-compute[70243]: INFO nova.virt.block_device [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Attempting to driver detach volume eb7c1819-e8e1-41be-983c-8322cd613c9c from mountpoint /dev/vdc
Jul 24 16:28:53 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:28:53 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Attempting to detach device vdc from instance abcd54bc-02d4-4872-8227-43cb93d27491 from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:28:53 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:28:53 user nova-compute[70243]:   <source dev="/dev/sdd"/>
Jul 24 16:28:53 user nova-compute[70243]:   <target dev="vdc" bus="virtio"/>
Jul 24 16:28:53 user nova-compute[70243]:   <serial>eb7c1819-e8e1-41be-983c-8322cd613c9c</serial>
Jul 24 16:28:53 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 16:28:53 user nova-compute[70243]: </disk>
Jul 24 16:28:53 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Applying migration context for instance 6ed1935d-3a60-418e-bc44-ed65452afc1a as it has an incoming, in-progress migration fd176af4-9996-4d94-805d-cc43802750cf. Migration status is post-migrating {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 24 16:28:53 user nova-compute[70243]: INFO nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Updating resource usage from migration fd176af4-9996-4d94-805d-cc43802750cf
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.objects.instance [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6ed1935d-3a60-418e-bc44-ed65452afc1a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:28:53 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Successfully detached device vdc from instance abcd54bc-02d4-4872-8227-43cb93d27491 from the persistent domain config.
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance abcd54bc-02d4-4872-8227-43cb93d27491 from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:28:53 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:28:53 user nova-compute[70243]:   <source dev="/dev/sdd"/>
Jul 24 16:28:53 user nova-compute[70243]:   <target dev="vdc" bus="virtio"/>
Jul 24 16:28:53 user nova-compute[70243]:   <serial>eb7c1819-e8e1-41be-983c-8322cd613c9c</serial>
Jul 24 16:28:53 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 24 16:28:53 user nova-compute[70243]: </disk>
Jul 24 16:28:53 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVOWQZzq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:28:53 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:28:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:28:53 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:28:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:28:53 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance de22ea98-b041-4f3f-8986-435c43267a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 50fecb3a-8f06-4822-8c84-76df51acfe50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6f2258de-6b31-48af-81df-37b64da4ca99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance abcd54bc-02d4-4872-8227-43cb93d27491 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5a84c738-68d3-463f-8cb4-170be05abbdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 4c394c36-5163-4739-964a-7350ee4814ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5d5f72a1-afd5-43f1-b803-c8924352acc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance c8fb01bf-c754-445c-ae71-18721cf5de7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Migration fd176af4-9996-4d94-805d-cc43802750cf is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6ed1935d-3a60-418e-bc44-ed65452afc1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e0e5dc-7ded-4581-9f73-23f405fb5f4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:28:53 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8977ca6-bd43-4fc1-bb5a-ce9c6b15926a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8] added
Jul 24 16:28:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[66165ca8-9aad-41e1-94bc-3c67be3e98c8]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5eba09-db4c-463d-8b91-3c1c11ed5734]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TVOWQZzq {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TVOWQZzq" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f811c4cf-7a6a-493b-89a5-311e75e27d83]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TVOWQZzq'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70b2613-e5d0-44e7-aec1-e242867c7442]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[433345ce-88b5-4f07-addf-143c6e05cb37]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:28:53 user nova-compute[70243]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)
Jul 24 16:28:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:28:53 user nova-compute[70243]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)
Jul 24 16:28:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0270ce4b-f43d-40af-bcd7-a2a4af7b46f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8, portal: 172.16.0.220,3260]
Jul 24 16:28:53 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8, portal: 172.16.0.220,3260] successful.
Jul 24 16:28:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d8e1e0-4126-43a8-8f93-4a64bb46da47]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:28:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6587cf22-4f50-4cee-8326-4fd1beaca3c7]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:28:54 user nova-compute[70243]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)
Jul 24 16:28:54 user nova-compute[70243]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:28:54 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:28:54 user nova-compute[70243]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)
Jul 24 16:28:54 user nova-compute[70243]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:28:54 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5755211a-2501-4b0b-a6ec-d1e407d1cada]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVOWQZzq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690216134.1236498, abcd54bc-02d4-4872-8227-43cb93d27491 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance abcd54bc-02d4-4872-8227-43cb93d27491 {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:28:54 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Successfully detached device vdc from instance abcd54bc-02d4-4872-8227-43cb93d27491 from the live domain config.
Jul 24 16:28:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70243) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kZYsAwEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:28:54 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:28:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-de22ea98-b041-4f3f-8986-435c43267a2e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-de22ea98-b041-4f3f-8986-435c43267a2e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lazy-loading 'info_cache' on Instance uuid de22ea98-b041-4f3f-8986-435c43267a2e {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Updating instance_info_cache with network_info: [{"id": "e709e269-eff5-4ac2-8c2a-29048448a422", "address": "fa:16:3e:0a:84:99", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape709e269-ef", "ovs_interfaceid": "e709e269-eff5-4ac2-8c2a-29048448a422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-de22ea98-b041-4f3f-8986-435c43267a2e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Cleaning up deleted instances {{(pid=70243) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 16:28:54 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] There are 0 instances to clean {{(pid=70243) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26562303032373133', 'path': '/dev/sdb'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562303032373133', 'path': '/dev/sdb'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.892s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:26:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1036526617',display_name='tempest-ServerActionsTestOtherA-server-1036526617',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1036526617',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNt4ywOtyDbY3gzVxioiadq0RHvp3ujVzU7+egeM9QHVtvP6DGqg4hSRwxq8r4OyAFnfBqKPWEeStDLSLwfjx+5dISRxZesWLAiccd5P+5WMBwka91+aa63O7dxU+RVwA==',key_name='tempest-keypair-283031417',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:27:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ebdb3cb079814db091227f80b2ed1b9d',ramdisk_id='',reservation_id='r-bvklrqc6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-39125821',owner_user_name='tempest-ServerActionsTestOtherA-39125821-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:28:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa3936255d31421184e585e2fd17d7ef',uuid=6ed1935d-3a60-418e-bc44-ed65452afc1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "021971db-1e79-467f-8f5b-5361f205fceb", "address": "fa:16:3e:4a:88:70", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-757960214-network", "vif_mac": "fa:16:3e:4a:88:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021971db-1e", "ovs_interfaceid": "021971db-1e79-467f-8f5b-5361f205fceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converting VIF {"id": "021971db-1e79-467f-8f5b-5361f205fceb", "address": "fa:16:3e:4a:88:70", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-757960214-network", "vif_mac": "fa:16:3e:4a:88:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021971db-1e", "ovs_interfaceid": "021971db-1e79-467f-8f5b-5361f205fceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:88:70,bridge_name='br-int',has_traffic_filtering=True,id=021971db-1e79-467f-8f5b-5361f205fceb,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021971db-1e') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:28:55 user nova-compute[70243]:   <uuid>6ed1935d-3a60-418e-bc44-ed65452afc1a</uuid>
Jul 24 16:28:55 user nova-compute[70243]:   <name>instance-00000015</name>
Jul 24 16:28:55 user nova-compute[70243]:   <memory>2097152</memory>
Jul 24 16:28:55 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:28:55 user nova-compute[70243]:   <metadata>
Jul 24 16:28:55 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:28:55 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:28:55 user nova-compute[70243]:       <nova:name>tempest-ServerActionsTestOtherA-server-1036526617</nova:name>
Jul 24 16:28:55 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:28:53</nova:creationTime>
Jul 24 16:28:55 user nova-compute[70243]:       <nova:flavor name="m1.small">
Jul 24 16:28:55 user nova-compute[70243]:         <nova:memory>2048</nova:memory>
Jul 24 16:28:55 user nova-compute[70243]:         <nova:disk>20</nova:disk>
Jul 24 16:28:55 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:28:55 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:28:55 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:28:55 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:28:55 user nova-compute[70243]:       <nova:owner>
Jul 24 16:28:55 user nova-compute[70243]:         <nova:user uuid="aa3936255d31421184e585e2fd17d7ef">tempest-ServerActionsTestOtherA-39125821-project-member</nova:user>
Jul 24 16:28:55 user nova-compute[70243]:         <nova:project uuid="ebdb3cb079814db091227f80b2ed1b9d">tempest-ServerActionsTestOtherA-39125821</nova:project>
Jul 24 16:28:55 user nova-compute[70243]:       </nova:owner>
Jul 24 16:28:55 user nova-compute[70243]:       <nova:ports>
Jul 24 16:28:55 user nova-compute[70243]:         <nova:port uuid="021971db-1e79-467f-8f5b-5361f205fceb">
Jul 24 16:28:55 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 24 16:28:55 user nova-compute[70243]:         </nova:port>
Jul 24 16:28:55 user nova-compute[70243]:       </nova:ports>
Jul 24 16:28:55 user nova-compute[70243]:     </nova:instance>
Jul 24 16:28:55 user nova-compute[70243]:   </metadata>
Jul 24 16:28:55 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:28:55 user nova-compute[70243]:     <system>
Jul 24 16:28:55 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:28:55 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:28:55 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:28:55 user nova-compute[70243]:       <entry name="serial">6ed1935d-3a60-418e-bc44-ed65452afc1a</entry>
Jul 24 16:28:55 user nova-compute[70243]:       <entry name="uuid">6ed1935d-3a60-418e-bc44-ed65452afc1a</entry>
Jul 24 16:28:55 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:28:55 user nova-compute[70243]:     </system>
Jul 24 16:28:55 user nova-compute[70243]:   </sysinfo>
Jul 24 16:28:55 user nova-compute[70243]:   <os>
Jul 24 16:28:55 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:28:55 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:28:55 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:28:55 user nova-compute[70243]:   </os>
Jul 24 16:28:55 user nova-compute[70243]:   <features>
Jul 24 16:28:55 user nova-compute[70243]:     <acpi/>
Jul 24 16:28:55 user nova-compute[70243]:     <apic/>
Jul 24 16:28:55 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:28:55 user nova-compute[70243]:   </features>
Jul 24 16:28:55 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:28:55 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:28:55 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:28:55 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:28:55 user nova-compute[70243]:   </clock>
Jul 24 16:28:55 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:28:55 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:28:55 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:28:55 user nova-compute[70243]:   </cpu>
Jul 24 16:28:55 user nova-compute[70243]:   <devices>
Jul 24 16:28:55 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:28:55 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:28:55 user nova-compute[70243]:       <source dev="/dev/sdb"/>
Jul 24 16:28:55 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:28:55 user nova-compute[70243]:       <serial>8d7390a0-1192-49ab-b8a9-9c449d89ecd8</serial>
Jul 24 16:28:55 user nova-compute[70243]:     </disk>
Jul 24 16:28:55 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:28:55 user nova-compute[70243]:       <mac address="fa:16:3e:4a:88:70"/>
Jul 24 16:28:55 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:28:55 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:28:55 user nova-compute[70243]:       <target dev="tap021971db-1e"/>
Jul 24 16:28:55 user nova-compute[70243]:     </interface>
Jul 24 16:28:55 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:28:55 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/6ed1935d-3a60-418e-bc44-ed65452afc1a/console.log" append="off"/>
Jul 24 16:28:55 user nova-compute[70243]:     </serial>
Jul 24 16:28:55 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:28:55 user nova-compute[70243]:     <video>
Jul 24 16:28:55 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:28:55 user nova-compute[70243]:     </video>
Jul 24 16:28:55 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:28:55 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:28:55 user nova-compute[70243]:     </rng>
Jul 24 16:28:55 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:28:55 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:28:55 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:28:55 user nova-compute[70243]:     </memballoon>
Jul 24 16:28:55 user nova-compute[70243]:   </devices>
Jul 24 16:28:55 user nova-compute[70243]: </domain>
Jul 24 16:28:55 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:26:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1036526617',display_name='tempest-ServerActionsTestOtherA-server-1036526617',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1036526617',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNt4ywOtyDbY3gzVxioiadq0RHvp3ujVzU7+egeM9QHVtvP6DGqg4hSRwxq8r4OyAFnfBqKPWEeStDLSLwfjx+5dISRxZesWLAiccd5P+5WMBwka91+aa63O7dxU+RVwA==',key_name='tempest-keypair-283031417',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:27:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ebdb3cb079814db091227f80b2ed1b9d',ramdisk_id='',reservation_id='r-bvklrqc6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-39125821',owner_user_name='tempest-ServerActionsTestOtherA-39125821-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:28:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa3936255d31421184e585e2fd17d7ef',uuid=6ed1935d-3a60-418e-bc44-ed65452afc1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "021971db-1e79-467f-8f5b-5361f205fceb", "address": "fa:16:3e:4a:88:70", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-757960214-network", "vif_mac": "fa:16:3e:4a:88:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021971db-1e", "ovs_interfaceid": "021971db-1e79-467f-8f5b-5361f205fceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converting VIF {"id": "021971db-1e79-467f-8f5b-5361f205fceb", "address": "fa:16:3e:4a:88:70", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-757960214-network", "vif_mac": "fa:16:3e:4a:88:70"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021971db-1e", "ovs_interfaceid": "021971db-1e79-467f-8f5b-5361f205fceb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:88:70,bridge_name='br-int',has_traffic_filtering=True,id=021971db-1e79-467f-8f5b-5361f205fceb,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021971db-1e') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG os_vif [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:88:70,bridge_name='br-int',has_traffic_filtering=True,id=021971db-1e79-467f-8f5b-5361f205fceb,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021971db-1e') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbf3804-eb11-4a3a-84cb-3756850d7d6b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:28:55 user nova-compute[70243]: No targets found.
Jul 24 16:28:55 user nova-compute[70243]: iSNS:
Jul 24 16:28:55 user nova-compute[70243]: No targets found.
Jul 24 16:28:55 user nova-compute[70243]: STATIC:
Jul 24 16:28:55 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8
Jul 24 16:28:55 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:28:55 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:28:55 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3
Jul 24 16:28:55 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:28:55 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:28:55 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c
Jul 24 16:28:55 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:28:55 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:28:55 user nova-compute[70243]: FIRMWARE:
Jul 24 16:28:55 user nova-compute[70243]: No targets found.
Jul 24 16:28:55 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:28:55 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:28:55 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap021971db-1e, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap021971db-1e, col_values=(('external_ids', {'iface-id': '021971db-1e79-467f-8f5b-5361f205fceb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:88:70', 'vm-uuid': '6ed1935d-3a60-418e-bc44-ed65452afc1a'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:55 user nova-compute[70243]: INFO os_vif [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:88:70,bridge_name='br-int',has_traffic_filtering=True,id=021971db-1e79-467f-8f5b-5361f205fceb,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021971db-1e')
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cbdd1d-bec1-4189-bc46-cde97bbdf7e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7252b3e-4e65-4dff-b3bc-e432ee5a8e7f]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:28:55 user nova-compute[70243]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)
Jul 24 16:28:55 user nova-compute[70243]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:28:55 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:28:55 user nova-compute[70243]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c (non-flash)
Jul 24 16:28:55 user nova-compute[70243]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:28:55 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc1677f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c'): ({'sdd'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Removing single pathed devices sdd {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] No VIF found with MAC fa:16:3e:4a:88:70, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3876205-6271-4ab1-b282-82e5884e1bb1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67bf775-d20f-4511-a682-932aa87febab]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Flushing IO for device /dev/sdd {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c61565-6f2c-4b75-ab9b-e7109dd992dd]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d4083c-3578-4316-a5f8-3956f97b4a26]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] SCSI volumes sdd have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2399f31-0618-412b-b65b-9f868ae6fff1]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fe5345-e645-41d2-ac34-60d49c28aa27]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c, portal: 172.16.0.220,3260]
Jul 24 16:28:55 user nova-compute[70243]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c, portal: 172.16.0.220,3260] successful.
Jul 24 16:28:55 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb7c1819-e8e1-41be-983c-8322cd613c9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[473bd5d8-be71-4449-90f8-29fdc7a3cd66]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] <== disconnect_volume: return (1223ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:28:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:28:56 user nova-compute[70243]: DEBUG nova.objects.instance [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'flavor' on Instance uuid abcd54bc-02d4-4872-8227-43cb93d27491 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:28:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9e8d50d6-9be1-4cc0-b794-370e99871be3 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "abcd54bc-02d4-4872-8227-43cb93d27491" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.590s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:28:56 user nova-compute[70243]: DEBUG nova.compute.manager [req-bc8803c9-5b6b-483e-8b09-e91293ef7bb4 req-95fca4b2-3af3-4919-b01f-3c4260ae3fdd service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Received event network-vif-plugged-021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:28:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-bc8803c9-5b6b-483e-8b09-e91293ef7bb4 req-95fca4b2-3af3-4919-b01f-3c4260ae3fdd service nova] Acquiring lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-bc8803c9-5b6b-483e-8b09-e91293ef7bb4 req-95fca4b2-3af3-4919-b01f-3c4260ae3fdd service nova] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-bc8803c9-5b6b-483e-8b09-e91293ef7bb4 req-95fca4b2-3af3-4919-b01f-3c4260ae3fdd service nova] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:56 user nova-compute[70243]: DEBUG nova.compute.manager [req-bc8803c9-5b6b-483e-8b09-e91293ef7bb4 req-95fca4b2-3af3-4919-b01f-3c4260ae3fdd service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] No waiting events found dispatching network-vif-plugged-021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:28:56 user nova-compute[70243]: WARNING nova.compute.manager [req-bc8803c9-5b6b-483e-8b09-e91293ef7bb4 req-95fca4b2-3af3-4919-b01f-3c4260ae3fdd service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Received unexpected event network-vif-plugged-021971db-1e79-467f-8f5b-5361f205fceb for instance with vm_state active and task_state resize_finish.
Jul 24 16:28:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Removed pending event for 6ed1935d-3a60-418e-bc44-ed65452afc1a due to event {{(pid=70243) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 16:28:58 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216138.561432, 6ed1935d-3a60-418e-bc44-ed65452afc1a => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:28:58 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] VM Resumed (Lifecycle Event)
Jul 24 16:28:58 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:28:58 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Instance running successfully.
Jul 24 16:28:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Failed to set time: agent not configured {{(pid=70243) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 24 16:28:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2ed30792-237a-40a7-ada0-68510b8a39ff tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] finish_migration finished successfully. {{(pid=70243) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 24 16:28:58 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:28:58 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:28:58 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 24 16:28:58 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216138.562024, 6ed1935d-3a60-418e-bc44-ed65452afc1a => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:28:58 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] VM Started (Lifecycle Event)
Jul 24 16:28:58 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:28:58 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:28:58 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 24 16:28:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-db48e5ea-ba7d-4113-89ab-ef9c3678f399 req-a2798a97-cdb5-47a9-8a73-99a42875d84d service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Received event network-vif-plugged-021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:28:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-db48e5ea-ba7d-4113-89ab-ef9c3678f399 req-a2798a97-cdb5-47a9-8a73-99a42875d84d service nova] Acquiring lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:28:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-db48e5ea-ba7d-4113-89ab-ef9c3678f399 req-a2798a97-cdb5-47a9-8a73-99a42875d84d service nova] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:28:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-db48e5ea-ba7d-4113-89ab-ef9c3678f399 req-a2798a97-cdb5-47a9-8a73-99a42875d84d service nova] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:28:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-db48e5ea-ba7d-4113-89ab-ef9c3678f399 req-a2798a97-cdb5-47a9-8a73-99a42875d84d service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] No waiting events found dispatching network-vif-plugged-021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:28:58 user nova-compute[70243]: WARNING nova.compute.manager [req-db48e5ea-ba7d-4113-89ab-ef9c3678f399 req-a2798a97-cdb5-47a9-8a73-99a42875d84d service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Received unexpected event network-vif-plugged-021971db-1e79-467f-8f5b-5361f205fceb for instance with vm_state active and task_state resize_finish.
Jul 24 16:28:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG nova.compute.manager [req-b04fceb6-5b31-4707-9fbe-f96a76364839 req-2cbc4c96-58c9-4ce0-8971-a90540d3096b service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Received event network-changed-453c83f8-79fe-4453-8cbc-440b6b14bb62 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG nova.compute.manager [req-b04fceb6-5b31-4707-9fbe-f96a76364839 req-2cbc4c96-58c9-4ce0-8971-a90540d3096b service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Refreshing instance network info cache due to event network-changed-453c83f8-79fe-4453-8cbc-440b6b14bb62. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b04fceb6-5b31-4707-9fbe-f96a76364839 req-2cbc4c96-58c9-4ce0-8971-a90540d3096b service nova] Acquiring lock "refresh_cache-5a84c738-68d3-463f-8cb4-170be05abbdf" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b04fceb6-5b31-4707-9fbe-f96a76364839 req-2cbc4c96-58c9-4ce0-8971-a90540d3096b service nova] Acquired lock "refresh_cache-5a84c738-68d3-463f-8cb4-170be05abbdf" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG nova.network.neutron [req-b04fceb6-5b31-4707-9fbe-f96a76364839 req-2cbc4c96-58c9-4ce0-8971-a90540d3096b service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Refreshing network info cache for port 453c83f8-79fe-4453-8cbc-440b6b14bb62 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "5a84c738-68d3-463f-8cb4-170be05abbdf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "5a84c738-68d3-463f-8cb4-170be05abbdf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "5a84c738-68d3-463f-8cb4-170be05abbdf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "5a84c738-68d3-463f-8cb4-170be05abbdf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "5a84c738-68d3-463f-8cb4-170be05abbdf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:29:01 user nova-compute[70243]: INFO nova.compute.manager [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Terminating instance
Jul 24 16:29:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG nova.network.neutron [req-b04fceb6-5b31-4707-9fbe-f96a76364839 req-2cbc4c96-58c9-4ce0-8971-a90540d3096b service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Updated VIF entry in instance network info cache for port 453c83f8-79fe-4453-8cbc-440b6b14bb62. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG nova.network.neutron [req-b04fceb6-5b31-4707-9fbe-f96a76364839 req-2cbc4c96-58c9-4ce0-8971-a90540d3096b service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Updating instance_info_cache with network_info: [{"id": "453c83f8-79fe-4453-8cbc-440b6b14bb62", "address": "fa:16:3e:e6:79:dd", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap453c83f8-79", "ovs_interfaceid": "453c83f8-79fe-4453-8cbc-440b6b14bb62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b04fceb6-5b31-4707-9fbe-f96a76364839 req-2cbc4c96-58c9-4ce0-8971-a90540d3096b service nova] Releasing lock "refresh_cache-5a84c738-68d3-463f-8cb4-170be05abbdf" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG nova.compute.manager [req-36144b11-e65d-4a3e-b8f7-9da4fedec739 req-01d823da-d727-4371-8050-7df1acd60e3d service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Received event network-vif-unplugged-453c83f8-79fe-4453-8cbc-440b6b14bb62 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-36144b11-e65d-4a3e-b8f7-9da4fedec739 req-01d823da-d727-4371-8050-7df1acd60e3d service nova] Acquiring lock "5a84c738-68d3-463f-8cb4-170be05abbdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-36144b11-e65d-4a3e-b8f7-9da4fedec739 req-01d823da-d727-4371-8050-7df1acd60e3d service nova] Lock "5a84c738-68d3-463f-8cb4-170be05abbdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-36144b11-e65d-4a3e-b8f7-9da4fedec739 req-01d823da-d727-4371-8050-7df1acd60e3d service nova] Lock "5a84c738-68d3-463f-8cb4-170be05abbdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG nova.compute.manager [req-36144b11-e65d-4a3e-b8f7-9da4fedec739 req-01d823da-d727-4371-8050-7df1acd60e3d service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] No waiting events found dispatching network-vif-unplugged-453c83f8-79fe-4453-8cbc-440b6b14bb62 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:29:01 user nova-compute[70243]: DEBUG nova.compute.manager [req-36144b11-e65d-4a3e-b8f7-9da4fedec739 req-01d823da-d727-4371-8050-7df1acd60e3d service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Received event network-vif-unplugged-453c83f8-79fe-4453-8cbc-440b6b14bb62 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:29:02 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Instance destroyed successfully.
Jul 24 16:29:02 user nova-compute[70243]: DEBUG nova.objects.instance [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lazy-loading 'resources' on Instance uuid 5a84c738-68d3-463f-8cb4-170be05abbdf {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:29:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:27:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-988401357',display_name='tempest-AttachVolumeNegativeTest-server-988401357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-988401357',id=22,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVVp4Y1CP8XCaR1AkYIPM+0MpNM1jtsn2ta7kg1Al3u5WjcFkhv8L1g6ecOfEGOG6wgbg/dCFqdvxMQxtM2mC1fL8tLstcGnDQlwHQPDsJCBSAz1rp2fl8Y7Mh6AxPYKw==',key_name='tempest-keypair-1555637312',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:27:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e819e22e590947478d513e1b9ad39494',ramdisk_id='',reservation_id='r-qxfusx97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1152214105',owner_user_name='tempest-AttachVolumeNegativeTest-1152214105-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:27:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df18929107a458194a9c528d9bdfeac',uuid=5a84c738-68d3-463f-8cb4-170be05abbdf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "453c83f8-79fe-4453-8cbc-440b6b14bb62", "address": "fa:16:3e:e6:79:dd", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap453c83f8-79", "ovs_interfaceid": "453c83f8-79fe-4453-8cbc-440b6b14bb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:29:02 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converting VIF {"id": "453c83f8-79fe-4453-8cbc-440b6b14bb62", "address": "fa:16:3e:e6:79:dd", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap453c83f8-79", "ovs_interfaceid": "453c83f8-79fe-4453-8cbc-440b6b14bb62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:29:02 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:79:dd,bridge_name='br-int',has_traffic_filtering=True,id=453c83f8-79fe-4453-8cbc-440b6b14bb62,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap453c83f8-79') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:29:02 user nova-compute[70243]: DEBUG os_vif [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:79:dd,bridge_name='br-int',has_traffic_filtering=True,id=453c83f8-79fe-4453-8cbc-440b6b14bb62,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap453c83f8-79') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:29:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap453c83f8-79, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:29:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:29:02 user nova-compute[70243]: INFO os_vif [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:79:dd,bridge_name='br-int',has_traffic_filtering=True,id=453c83f8-79fe-4453-8cbc-440b6b14bb62,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap453c83f8-79')
Jul 24 16:29:02 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Deleting instance files /opt/stack/data/nova/instances/5a84c738-68d3-463f-8cb4-170be05abbdf_del
Jul 24 16:29:02 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Deletion of /opt/stack/data/nova/instances/5a84c738-68d3-463f-8cb4-170be05abbdf_del complete
Jul 24 16:29:02 user nova-compute[70243]: INFO nova.compute.manager [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Took 0.67 seconds to destroy the instance on the hypervisor.
Jul 24 16:29:02 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:29:02 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:29:02 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:29:03 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216128.209806, 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:29:03 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] VM Stopped (Lifecycle Event)
Jul 24 16:29:03 user nova-compute[70243]: DEBUG nova.compute.manager [None req-659a1c90-931a-4ebb-9717-c207f32dcb8a None None] [instance: 9e4e0f20-5488-44ce-ac82-e0e77b8a3e30] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:29:03 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:29:03 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Took 1.42 seconds to deallocate network for instance.
Jul 24 16:29:03 user nova-compute[70243]: DEBUG nova.compute.manager [req-182bfa1f-4942-41ca-b911-c92e948abef4 req-ed13bbc6-7223-4767-b6a5-f6961b75313a service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Received event network-vif-deleted-453c83f8-79fe-4453-8cbc-440b6b14bb62 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:29:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:29:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:29:03 user nova-compute[70243]: DEBUG nova.compute.manager [req-20726882-2710-4621-8fec-88be94d765ad req-1b690da2-13ab-4ad2-857e-be412de7617b service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Received event network-vif-plugged-453c83f8-79fe-4453-8cbc-440b6b14bb62 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:29:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-20726882-2710-4621-8fec-88be94d765ad req-1b690da2-13ab-4ad2-857e-be412de7617b service nova] Acquiring lock "5a84c738-68d3-463f-8cb4-170be05abbdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:29:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-20726882-2710-4621-8fec-88be94d765ad req-1b690da2-13ab-4ad2-857e-be412de7617b service nova] Lock "5a84c738-68d3-463f-8cb4-170be05abbdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:29:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-20726882-2710-4621-8fec-88be94d765ad req-1b690da2-13ab-4ad2-857e-be412de7617b service nova] Lock "5a84c738-68d3-463f-8cb4-170be05abbdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:29:03 user nova-compute[70243]: DEBUG nova.compute.manager [req-20726882-2710-4621-8fec-88be94d765ad req-1b690da2-13ab-4ad2-857e-be412de7617b service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] No waiting events found dispatching network-vif-plugged-453c83f8-79fe-4453-8cbc-440b6b14bb62 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:29:03 user nova-compute[70243]: WARNING nova.compute.manager [req-20726882-2710-4621-8fec-88be94d765ad req-1b690da2-13ab-4ad2-857e-be412de7617b service nova] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Received unexpected event network-vif-plugged-453c83f8-79fe-4453-8cbc-440b6b14bb62 for instance with vm_state deleted and task_state None.
Jul 24 16:29:03 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:29:04 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:29:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:29:04 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Deleted allocations for instance 5a84c738-68d3-463f-8cb4-170be05abbdf
Jul 24 16:29:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e42017c9-d1f4-4dfb-b10d-00062a10e7f5 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "5a84c738-68d3-463f-8cb4-170be05abbdf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.707s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:29:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "4c394c36-5163-4739-964a-7350ee4814ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:29:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "4c394c36-5163-4739-964a-7350ee4814ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:29:08 user nova-compute[70243]: DEBUG nova.objects.instance [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lazy-loading 'flavor' on Instance uuid 4c394c36-5163-4739-964a-7350ee4814ae {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:29:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "4c394c36-5163-4739-964a-7350ee4814ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "4c394c36-5163-4739-964a-7350ee4814ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "4c394c36-5163-4739-964a-7350ee4814ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:29:09 user nova-compute[70243]: INFO nova.compute.manager [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Attaching volume 4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 to /dev/vdb
Jul 24 16:29:09 user nova-compute[70243]: DEBUG os_brick.utils [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[80de5d31-f608-423d-9944-f435785bc6fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9522d4-555a-4e77-afeb-4404a58dcce2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b29206-ee48-4115-a3ee-49318710b760]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecda7b55-6ce2-4ca0-a7c6-40d72f3c86ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:29:09 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:29:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0172c0e9-1231-4810-bfab-d896c6cf64ea]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG os_brick.utils [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] <== get_connector_properties: return (434ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Updating existing volume attachment record: ec86c432-7844-40ef-8399-3a58518ba146 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:29:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:29:15 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjToEWcg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:29:15 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:29:15 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:29:15 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:29:15 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:29:15 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:29:15 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:29:15 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:29:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00d8cc9-d920-49d5-a6ae-bcbd5f838b5e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:29:16 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e175226-7be1-49ca-bc85-df786f75424b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0] added
Jul 24 16:29:16 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64331fd-9f19-46b6-8bf9-e218b5f143a1]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d179f87-615e-4977-b098-cdb0098b491c]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JjToEWcg {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JjToEWcg" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76d4d26-61e6-4090-9ee9-f9ab5ad01139]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JjToEWcg'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1501ecea-aa5f-48dc-bace-426d51a9eefd]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1518b3d2-b5c0-4966-a379-67e4ee40f24a]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:29:16 user nova-compute[70243]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:29:16 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:29:16 user nova-compute[70243]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:29:16 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8aa76f2-4cd0-4024-8dbd-3623d380d3fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0, portal: 172.16.0.220,3260]
Jul 24 16:29:16 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0, portal: 172.16.0.220,3260] successful.
Jul 24 16:29:16 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75d9a1b-98a2-4a1b-be07-f27157d15dde]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a464f788-1fba-4d64-8c5d-484dd1e0e60d]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:29:16 user nova-compute[70243]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:29:16 user nova-compute[70243]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)
Jul 24 16:29:16 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:29:16 user nova-compute[70243]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:29:16 user nova-compute[70243]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)
Jul 24 16:29:16 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d313ac6-9522-4b53-bb32-634f1bd9e2de]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:29:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjToEWcg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:29:17 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216142.0367951, 5a84c738-68d3-463f-8cb4-170be05abbdf => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:29:17 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] VM Stopped (Lifecycle Event)
Jul 24 16:29:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-edb72bac-6352-4c9f-a98b-f6150e2dfe0f None None] [instance: 5a84c738-68d3-463f-8cb4-170be05abbdf] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:29:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:29:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26564653337313061', 'path': '/dev/sdd'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:29:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564653337313061', 'path': '/dev/sdd'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:29:17 user nova-compute[70243]: DEBUG nova.objects.instance [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lazy-loading 'flavor' on Instance uuid 4c394c36-5163-4739-964a-7350ee4814ae {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:29:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:29:17 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:29:17 user nova-compute[70243]:   <source dev="/dev/sdd"/>
Jul 24 16:29:17 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:29:17 user nova-compute[70243]:   <serial>4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0</serial>
Jul 24 16:29:17 user nova-compute[70243]: </disk>
Jul 24 16:29:17 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:29:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:29:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:29:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] No VIF found with MAC fa:16:3e:56:fb:e8, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:29:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-42c92361-1343-4818-8e1e-3de661981914 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "4c394c36-5163-4739-964a-7350ee4814ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.770s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:29:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:21 user nova-compute[70243]: DEBUG nova.compute.manager [req-1210a2e0-75dc-4ff3-9809-165cd2f12acc req-a08fb9e4-51c4-4fa2-9cad-988c1c8fb371 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Received event network-changed-7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:29:21 user nova-compute[70243]: DEBUG nova.compute.manager [req-1210a2e0-75dc-4ff3-9809-165cd2f12acc req-a08fb9e4-51c4-4fa2-9cad-988c1c8fb371 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Refreshing instance network info cache due to event network-changed-7d075a00-69b3-4a37-8752-46f3c3a35cb5. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:29:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1210a2e0-75dc-4ff3-9809-165cd2f12acc req-a08fb9e4-51c4-4fa2-9cad-988c1c8fb371 service nova] Acquiring lock "refresh_cache-4c394c36-5163-4739-964a-7350ee4814ae" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:29:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1210a2e0-75dc-4ff3-9809-165cd2f12acc req-a08fb9e4-51c4-4fa2-9cad-988c1c8fb371 service nova] Acquired lock "refresh_cache-4c394c36-5163-4739-964a-7350ee4814ae" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:29:21 user nova-compute[70243]: DEBUG nova.network.neutron [req-1210a2e0-75dc-4ff3-9809-165cd2f12acc req-a08fb9e4-51c4-4fa2-9cad-988c1c8fb371 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Refreshing network info cache for port 7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:29:21 user nova-compute[70243]: DEBUG nova.network.neutron [req-1210a2e0-75dc-4ff3-9809-165cd2f12acc req-a08fb9e4-51c4-4fa2-9cad-988c1c8fb371 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Updated VIF entry in instance network info cache for port 7d075a00-69b3-4a37-8752-46f3c3a35cb5. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:29:21 user nova-compute[70243]: DEBUG nova.network.neutron [req-1210a2e0-75dc-4ff3-9809-165cd2f12acc req-a08fb9e4-51c4-4fa2-9cad-988c1c8fb371 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Updating instance_info_cache with network_info: [{"id": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "address": "fa:16:3e:56:fb:e8", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d075a00-69", "ovs_interfaceid": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:29:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1210a2e0-75dc-4ff3-9809-165cd2f12acc req-a08fb9e4-51c4-4fa2-9cad-988c1c8fb371 service nova] Releasing lock "refresh_cache-4c394c36-5163-4739-964a-7350ee4814ae" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:29:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:23 user nova-compute[70243]: DEBUG nova.compute.manager [req-aed3a296-95f3-4479-9c18-ea0c643dbefd req-d831b541-7a22-4d32-9d5a-eedbc3e6cb77 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Received event network-changed-7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:29:23 user nova-compute[70243]: DEBUG nova.compute.manager [req-aed3a296-95f3-4479-9c18-ea0c643dbefd req-d831b541-7a22-4d32-9d5a-eedbc3e6cb77 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Refreshing instance network info cache due to event network-changed-7d075a00-69b3-4a37-8752-46f3c3a35cb5. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:29:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-aed3a296-95f3-4479-9c18-ea0c643dbefd req-d831b541-7a22-4d32-9d5a-eedbc3e6cb77 service nova] Acquiring lock "refresh_cache-4c394c36-5163-4739-964a-7350ee4814ae" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:29:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-aed3a296-95f3-4479-9c18-ea0c643dbefd req-d831b541-7a22-4d32-9d5a-eedbc3e6cb77 service nova] Acquired lock "refresh_cache-4c394c36-5163-4739-964a-7350ee4814ae" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:29:23 user nova-compute[70243]: DEBUG nova.network.neutron [req-aed3a296-95f3-4479-9c18-ea0c643dbefd req-d831b541-7a22-4d32-9d5a-eedbc3e6cb77 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Refreshing network info cache for port 7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:29:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c7ad8f28-2546-4525-a5dc-31ffc925bb47 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "4c394c36-5163-4739-964a-7350ee4814ae" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:29:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c7ad8f28-2546-4525-a5dc-31ffc925bb47 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "4c394c36-5163-4739-964a-7350ee4814ae" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.004s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:29:24 user nova-compute[70243]: INFO nova.compute.manager [None req-c7ad8f28-2546-4525-a5dc-31ffc925bb47 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Rebooting instance
Jul 24 16:29:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c7ad8f28-2546-4525-a5dc-31ffc925bb47 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "refresh_cache-4c394c36-5163-4739-964a-7350ee4814ae" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:29:24 user nova-compute[70243]: DEBUG nova.network.neutron [req-aed3a296-95f3-4479-9c18-ea0c643dbefd req-d831b541-7a22-4d32-9d5a-eedbc3e6cb77 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Updated VIF entry in instance network info cache for port 7d075a00-69b3-4a37-8752-46f3c3a35cb5. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:29:24 user nova-compute[70243]: DEBUG nova.network.neutron [req-aed3a296-95f3-4479-9c18-ea0c643dbefd req-d831b541-7a22-4d32-9d5a-eedbc3e6cb77 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Updating instance_info_cache with network_info: [{"id": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "address": "fa:16:3e:56:fb:e8", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d075a00-69", "ovs_interfaceid": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:29:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-aed3a296-95f3-4479-9c18-ea0c643dbefd req-d831b541-7a22-4d32-9d5a-eedbc3e6cb77 service nova] Releasing lock "refresh_cache-4c394c36-5163-4739-964a-7350ee4814ae" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:29:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c7ad8f28-2546-4525-a5dc-31ffc925bb47 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquired lock "refresh_cache-4c394c36-5163-4739-964a-7350ee4814ae" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:29:24 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c7ad8f28-2546-4525-a5dc-31ffc925bb47 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:29:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:24 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c7ad8f28-2546-4525-a5dc-31ffc925bb47 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Updating instance_info_cache with network_info: [{"id": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "address": "fa:16:3e:56:fb:e8", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d075a00-69", "ovs_interfaceid": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:29:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c7ad8f28-2546-4525-a5dc-31ffc925bb47 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Releasing lock "refresh_cache-4c394c36-5163-4739-964a-7350ee4814ae" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:29:25 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c7ad8f28-2546-4525-a5dc-31ffc925bb47 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:29:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:27 user nova-compute[70243]: DEBUG nova.compute.manager [req-9c1ce995-af16-4617-99d2-7b715e7d758e req-a4f04903-f5d9-479f-add8-a39797a5bf01 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Received event network-vif-unplugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:29:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9c1ce995-af16-4617-99d2-7b715e7d758e req-a4f04903-f5d9-479f-add8-a39797a5bf01 service nova] Acquiring lock "4c394c36-5163-4739-964a-7350ee4814ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:29:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9c1ce995-af16-4617-99d2-7b715e7d758e req-a4f04903-f5d9-479f-add8-a39797a5bf01 service nova] Lock "4c394c36-5163-4739-964a-7350ee4814ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:29:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9c1ce995-af16-4617-99d2-7b715e7d758e req-a4f04903-f5d9-479f-add8-a39797a5bf01 service nova] Lock "4c394c36-5163-4739-964a-7350ee4814ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:29:27 user nova-compute[70243]: DEBUG nova.compute.manager [req-9c1ce995-af16-4617-99d2-7b715e7d758e req-a4f04903-f5d9-479f-add8-a39797a5bf01 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] No waiting events found dispatching network-vif-unplugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:29:27 user nova-compute[70243]: WARNING nova.compute.manager [req-9c1ce995-af16-4617-99d2-7b715e7d758e req-a4f04903-f5d9-479f-add8-a39797a5bf01 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Received unexpected event network-vif-unplugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 for instance with vm_state active and task_state reboot_started.
Jul 24 16:29:28 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-c7ad8f28-2546-4525-a5dc-31ffc925bb47 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Instance shutdown successfully.
Jul 24 16:29:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:29 user nova-compute[70243]: DEBUG nova.compute.manager [req-6c0029e9-176c-490a-a632-e43fc64be6ad req-966e6dd1-9dfd-4c65-9f6e-bb5caf818e1a service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Received event network-vif-plugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:29:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6c0029e9-176c-490a-a632-e43fc64be6ad req-966e6dd1-9dfd-4c65-9f6e-bb5caf818e1a service nova] Acquiring lock "4c394c36-5163-4739-964a-7350ee4814ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:29:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6c0029e9-176c-490a-a632-e43fc64be6ad req-966e6dd1-9dfd-4c65-9f6e-bb5caf818e1a service nova] Lock "4c394c36-5163-4739-964a-7350ee4814ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:29:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6c0029e9-176c-490a-a632-e43fc64be6ad req-966e6dd1-9dfd-4c65-9f6e-bb5caf818e1a service nova] Lock "4c394c36-5163-4739-964a-7350ee4814ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:29:29 user nova-compute[70243]: DEBUG nova.compute.manager [req-6c0029e9-176c-490a-a632-e43fc64be6ad req-966e6dd1-9dfd-4c65-9f6e-bb5caf818e1a service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] No waiting events found dispatching network-vif-plugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:29:29 user nova-compute[70243]: WARNING nova.compute.manager [req-6c0029e9-176c-490a-a632-e43fc64be6ad req-966e6dd1-9dfd-4c65-9f6e-bb5caf818e1a service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Received unexpected event network-vif-plugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 for instance with vm_state active and task_state reboot_started.
Jul 24 16:29:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:31 user nova-compute[70243]: DEBUG nova.compute.manager [req-d8b39b58-470c-48e8-9060-f0c520de2435 req-c54c8620-6336-444e-a553-0cc88defc631 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Received event network-vif-plugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:29:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d8b39b58-470c-48e8-9060-f0c520de2435 req-c54c8620-6336-444e-a553-0cc88defc631 service nova] Acquiring lock "4c394c36-5163-4739-964a-7350ee4814ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:29:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d8b39b58-470c-48e8-9060-f0c520de2435 req-c54c8620-6336-444e-a553-0cc88defc631 service nova] Lock "4c394c36-5163-4739-964a-7350ee4814ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:29:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d8b39b58-470c-48e8-9060-f0c520de2435 req-c54c8620-6336-444e-a553-0cc88defc631 service nova] Lock "4c394c36-5163-4739-964a-7350ee4814ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:29:31 user nova-compute[70243]: DEBUG nova.compute.manager [req-d8b39b58-470c-48e8-9060-f0c520de2435 req-c54c8620-6336-444e-a553-0cc88defc631 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] No waiting events found dispatching network-vif-plugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:29:31 user nova-compute[70243]: WARNING nova.compute.manager [req-d8b39b58-470c-48e8-9060-f0c520de2435 req-c54c8620-6336-444e-a553-0cc88defc631 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Received unexpected event network-vif-plugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 for instance with vm_state active and task_state reboot_started.
Jul 24 16:29:31 user nova-compute[70243]: DEBUG nova.compute.manager [req-d8b39b58-470c-48e8-9060-f0c520de2435 req-c54c8620-6336-444e-a553-0cc88defc631 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Received event network-vif-plugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:29:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d8b39b58-470c-48e8-9060-f0c520de2435 req-c54c8620-6336-444e-a553-0cc88defc631 service nova] Acquiring lock "4c394c36-5163-4739-964a-7350ee4814ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:29:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d8b39b58-470c-48e8-9060-f0c520de2435 req-c54c8620-6336-444e-a553-0cc88defc631 service nova] Lock "4c394c36-5163-4739-964a-7350ee4814ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:29:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d8b39b58-470c-48e8-9060-f0c520de2435 req-c54c8620-6336-444e-a553-0cc88defc631 service nova] Lock "4c394c36-5163-4739-964a-7350ee4814ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:29:31 user nova-compute[70243]: DEBUG nova.compute.manager [req-d8b39b58-470c-48e8-9060-f0c520de2435 req-c54c8620-6336-444e-a553-0cc88defc631 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] No waiting events found dispatching network-vif-plugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:29:31 user nova-compute[70243]: WARNING nova.compute.manager [req-d8b39b58-470c-48e8-9060-f0c520de2435 req-c54c8620-6336-444e-a553-0cc88defc631 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Received unexpected event network-vif-plugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 for instance with vm_state active and task_state reboot_started.
Jul 24 16:29:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Removed pending event for 4c394c36-5163-4739-964a-7350ee4814ae due to event {{(pid=70243) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 16:29:31 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216171.7626147, 4c394c36-5163-4739-964a-7350ee4814ae => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:29:31 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] VM Resumed (Lifecycle Event)
Jul 24 16:29:31 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Instance running successfully.
Jul 24 16:29:31 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-c7ad8f28-2546-4525-a5dc-31ffc925bb47 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Instance soft rebooted successfully.
Jul 24 16:29:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c7ad8f28-2546-4525-a5dc-31ffc925bb47 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:29:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:29:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:29:31 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] During sync_power_state the instance has a pending task (reboot_started). Skip.
Jul 24 16:29:31 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216171.7665808, 4c394c36-5163-4739-964a-7350ee4814ae => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:29:31 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] VM Started (Lifecycle Event)
Jul 24 16:29:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:29:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c7ad8f28-2546-4525-a5dc-31ffc925bb47 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "4c394c36-5163-4739-964a-7350ee4814ae" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.478s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:29:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:29:32 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:43 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:29:43 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:29:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "abcd54bc-02d4-4872-8227-43cb93d27491" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:29:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "abcd54bc-02d4-4872-8227-43cb93d27491" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:29:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:29:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:29:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:29:43 user nova-compute[70243]: INFO nova.compute.manager [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Terminating instance
Jul 24 16:29:43 user nova-compute[70243]: DEBUG nova.compute.manager [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:29:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:43 user nova-compute[70243]: DEBUG nova.compute.manager [req-3e02855d-9bfa-43d1-b6b6-9a79e24534c5 req-59d897a4-e191-4ac8-bb44-25c1f24d0d84 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Received event network-vif-unplugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:29:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3e02855d-9bfa-43d1-b6b6-9a79e24534c5 req-59d897a4-e191-4ac8-bb44-25c1f24d0d84 service nova] Acquiring lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:29:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3e02855d-9bfa-43d1-b6b6-9a79e24534c5 req-59d897a4-e191-4ac8-bb44-25c1f24d0d84 service nova] Lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:29:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3e02855d-9bfa-43d1-b6b6-9a79e24534c5 req-59d897a4-e191-4ac8-bb44-25c1f24d0d84 service nova] Lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:29:43 user nova-compute[70243]: DEBUG nova.compute.manager [req-3e02855d-9bfa-43d1-b6b6-9a79e24534c5 req-59d897a4-e191-4ac8-bb44-25c1f24d0d84 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] No waiting events found dispatching network-vif-unplugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:29:43 user nova-compute[70243]: DEBUG nova.compute.manager [req-3e02855d-9bfa-43d1-b6b6-9a79e24534c5 req-59d897a4-e191-4ac8-bb44-25c1f24d0d84 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Received event network-vif-unplugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:29:44 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Instance destroyed successfully.
Jul 24 16:29:44 user nova-compute[70243]: DEBUG nova.objects.instance [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'resources' on Instance uuid abcd54bc-02d4-4872-8227-43cb93d27491 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:29:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T16:23:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-81833196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-81833196',id=15,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0i2hBPJPt19uO9e4TSXZhl857gb3L3vMLFLZH6nJI1HpAainLWo36bPWYJB/sqsGP2BMKBKQjwJvt+xGzUlD69hcH1UBhw08zHqrJxdyORpjwKrQqIUJvk9SNHZKYJ2A==',key_name='tempest-keypair-146229776',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:27:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9fcf70d1092145a2bda67106833fe84d',ramdisk_id='',reservation_id='r-i86lveuw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-372850833',owner_user_name='tempest-AttachVolumeShelveTestJSON-372850833-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:27:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62f8a994029a48608bfdcb15f14b2067',uuid=abcd54bc-02d4-4872-8227-43cb93d27491,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "address": "fa:16:3e:11:51:64", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b407a6-85", "ovs_interfaceid": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:29:44 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converting VIF {"id": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "address": "fa:16:3e:11:51:64", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b407a6-85", "ovs_interfaceid": "b7b407a6-851a-4096-b6d4-d60d5e1d40d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:29:44 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:51:64,bridge_name='br-int',has_traffic_filtering=True,id=b7b407a6-851a-4096-b6d4-d60d5e1d40d0,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b407a6-85') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:29:44 user nova-compute[70243]: DEBUG os_vif [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:51:64,bridge_name='br-int',has_traffic_filtering=True,id=b7b407a6-851a-4096-b6d4-d60d5e1d40d0,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b407a6-85') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:29:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7b407a6-85, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:29:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:29:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:44 user nova-compute[70243]: INFO os_vif [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:51:64,bridge_name='br-int',has_traffic_filtering=True,id=b7b407a6-851a-4096-b6d4-d60d5e1d40d0,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b407a6-85')
Jul 24 16:29:44 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Deleting instance files /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491_del
Jul 24 16:29:44 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Deletion of /opt/stack/data/nova/instances/abcd54bc-02d4-4872-8227-43cb93d27491_del complete
Jul 24 16:29:44 user nova-compute[70243]: INFO nova.compute.manager [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 24 16:29:44 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:29:44 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:29:44 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:29:45 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:29:45 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Took 0.95 seconds to deallocate network for instance.
Jul 24 16:29:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:29:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:29:45 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Refreshing inventories for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 16:29:45 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Updating ProviderTree inventory for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 16:29:45 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Updating inventory in ProviderTree for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 16:29:45 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Refreshing aggregate associations for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0, aggregates: None {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 16:29:45 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Refreshing trait associations for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0, traits: HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 16:29:45 user nova-compute[70243]: DEBUG nova.compute.manager [req-c5c5440b-aedb-4db8-b5d3-5a696ffce1f3 req-f71388f5-b66b-4ff0-8f7b-b7e71b22e9d0 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Received event network-vif-plugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:29:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c5c5440b-aedb-4db8-b5d3-5a696ffce1f3 req-f71388f5-b66b-4ff0-8f7b-b7e71b22e9d0 service nova] Acquiring lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:29:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c5c5440b-aedb-4db8-b5d3-5a696ffce1f3 req-f71388f5-b66b-4ff0-8f7b-b7e71b22e9d0 service nova] Lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:29:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c5c5440b-aedb-4db8-b5d3-5a696ffce1f3 req-f71388f5-b66b-4ff0-8f7b-b7e71b22e9d0 service nova] Lock "abcd54bc-02d4-4872-8227-43cb93d27491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:29:45 user nova-compute[70243]: DEBUG nova.compute.manager [req-c5c5440b-aedb-4db8-b5d3-5a696ffce1f3 req-f71388f5-b66b-4ff0-8f7b-b7e71b22e9d0 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] No waiting events found dispatching network-vif-plugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:29:45 user nova-compute[70243]: WARNING nova.compute.manager [req-c5c5440b-aedb-4db8-b5d3-5a696ffce1f3 req-f71388f5-b66b-4ff0-8f7b-b7e71b22e9d0 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Received unexpected event network-vif-plugged-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 for instance with vm_state deleted and task_state None.
Jul 24 16:29:45 user nova-compute[70243]: DEBUG nova.compute.manager [req-c5c5440b-aedb-4db8-b5d3-5a696ffce1f3 req-f71388f5-b66b-4ff0-8f7b-b7e71b22e9d0 service nova] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Received event network-vif-deleted-b7b407a6-851a-4096-b6d4-d60d5e1d40d0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:29:45 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:29:45 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:29:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.632s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:29:46 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Deleted allocations for instance abcd54bc-02d4-4872-8227-43cb93d27491
Jul 24 16:29:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28128cfb-56fa-4456-b8d7-fb6c3d9dbffa tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "abcd54bc-02d4-4872-8227-43cb93d27491" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.654s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:29:46 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:29:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:29:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:49 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:29:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:29:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:29:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:29:49 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:29:49 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:29:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:29:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8fb01bf-c754-445c-ae71-18721cf5de7e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8fb01bf-c754-445c-ae71-18721cf5de7e/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8fb01bf-c754-445c-ae71-18721cf5de7e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8fb01bf-c754-445c-ae71-18721cf5de7e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:29:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:52 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:29:52 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:29:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=7438MB free_disk=24.304096221923828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:29:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:29:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:29:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Applying migration context for instance 6ed1935d-3a60-418e-bc44-ed65452afc1a as it has an incoming, in-progress migration fd176af4-9996-4d94-805d-cc43802750cf. Migration status is finished {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:985}}
Jul 24 16:29:52 user nova-compute[70243]: INFO nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Updating resource usage from migration fd176af4-9996-4d94-805d-cc43802750cf
Jul 24 16:29:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance de22ea98-b041-4f3f-8986-435c43267a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:29:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:29:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 50fecb3a-8f06-4822-8c84-76df51acfe50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:29:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6f2258de-6b31-48af-81df-37b64da4ca99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:29:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 4c394c36-5163-4739-964a-7350ee4814ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:29:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5d5f72a1-afd5-43f1-b803-c8924352acc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:29:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance c8fb01bf-c754-445c-ae71-18721cf5de7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:29:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Migration fd176af4-9996-4d94-805d-cc43802750cf is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1672}}
Jul 24 16:29:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6ed1935d-3a60-418e-bc44-ed65452afc1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:29:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:29:52 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:29:53 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:29:53 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:29:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:29:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.701s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:29:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:29:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:29:53 user nova-compute[70243]: INFO nova.compute.manager [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Detaching volume 5f2d6460-46f7-4822-8755-5bf5545555e3
Jul 24 16:29:53 user nova-compute[70243]: INFO nova.virt.block_device [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Attempting to driver detach volume 5f2d6460-46f7-4822-8755-5bf5545555e3 from mountpoint /dev/vdb
Jul 24 16:29:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Attempting to detach device vdb from instance 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04 from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:29:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:29:53 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:29:53 user nova-compute[70243]:   <source dev="/dev/sdc"/>
Jul 24 16:29:53 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:29:53 user nova-compute[70243]:   <serial>5f2d6460-46f7-4822-8755-5bf5545555e3</serial>
Jul 24 16:29:53 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:29:53 user nova-compute[70243]: </disk>
Jul 24 16:29:53 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:29:53 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Successfully detached device vdb from instance 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04 from the persistent domain config.
Jul 24 16:29:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04 from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:29:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:29:53 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:29:53 user nova-compute[70243]:   <source dev="/dev/sdc"/>
Jul 24 16:29:53 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:29:53 user nova-compute[70243]:   <serial>5f2d6460-46f7-4822-8755-5bf5545555e3</serial>
Jul 24 16:29:53 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:29:53 user nova-compute[70243]: </disk>
Jul 24 16:29:53 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690216194.0417151, 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04 {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:29:54 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Successfully detached device vdb from instance 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04 from the live domain config.
Jul 24 16:29:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQAmYBxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:29:54 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:29:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd806d9-39fd-4002-950d-578ffba5aa5c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:29:54 user nova-compute[70243]: No targets found.
Jul 24 16:29:54 user nova-compute[70243]: iSNS:
Jul 24 16:29:54 user nova-compute[70243]: No targets found.
Jul 24 16:29:54 user nova-compute[70243]: STATIC:
Jul 24 16:29:54 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8
Jul 24 16:29:54 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:29:54 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:29:54 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3
Jul 24 16:29:54 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:29:54 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:29:54 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0
Jul 24 16:29:54 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:29:54 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:29:54 user nova-compute[70243]: FIRMWARE:
Jul 24 16:29:54 user nova-compute[70243]: No targets found.
Jul 24 16:29:54 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:29:54 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:29:54 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c13b064-d3b1-4966-9a46-fb16b3f92ac7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8f56a2-c9c2-4ac7-aee7-db338c39ea17]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:29:54 user nova-compute[70243]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:29:54 user nova-compute[70243]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)
Jul 24 16:29:54 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 (non-flash)
Jul 24 16:29:54 user nova-compute[70243]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:29:54 user nova-compute[70243]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)
Jul 24 16:29:54 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc4c5090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3'): ({'sdc'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Removing single pathed devices sdc {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fd9b25-ce70-43ae-817a-d34fc6a3fa13]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e95e3c0-d17b-4d10-840a-3fc18d4f4573]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Flushing IO for device /dev/sdc {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d20d19-b3c5-44a6-9827-aaf25c2c5541]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8047d1a9-b033-420c-9b03-dca56794441b]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] SCSI volumes sdc have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ef0066-5386-4916-91f7-e9050603300f]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f34f79-d643-41b9-912d-df58c543e597]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3, portal: 172.16.0.220,3260]
Jul 24 16:29:54 user nova-compute[70243]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3, portal: 172.16.0.220,3260] successful.
Jul 24 16:29:54 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2d6460-46f7-4822-8755-5bf5545555e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f674cc9-d7cc-40be-a9fe-0b52b4c84bb8]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] <== disconnect_volume: return (357ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Updating instance_info_cache with network_info: [{"id": "bc944a2d-ab8f-475a-b276-485ab373860a", "address": "fa:16:3e:de:36:b6", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc944a2d-ab", "ovs_interfaceid": "bc944a2d-ab8f-475a-b276-485ab373860a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:29:54 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:29:55 user nova-compute[70243]: DEBUG nova.objects.instance [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lazy-loading 'flavor' on Instance uuid 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:29:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-1fee8d05-4760-4603-b142-189dbd5ed47d tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.873s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:29:59 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216184.249738, abcd54bc-02d4-4872-8227-43cb93d27491 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:29:59 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] VM Stopped (Lifecycle Event)
Jul 24 16:29:59 user nova-compute[70243]: DEBUG nova.compute.manager [None req-25988242-e2ac-48dc-9399-c4e9f6da53ab None None] [instance: abcd54bc-02d4-4872-8227-43cb93d27491] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:29:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:29:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:30:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:30:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:30:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:30:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-e937333e-1725-40d4-900f-c4b58edba94e req-535ba469-aaae-44c5-a55c-c614eed8e49b service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Received event network-changed-238f8b90-f497-46f5-9edd-0de67b62d546 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:30:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-e937333e-1725-40d4-900f-c4b58edba94e req-535ba469-aaae-44c5-a55c-c614eed8e49b service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Refreshing instance network info cache due to event network-changed-238f8b90-f497-46f5-9edd-0de67b62d546. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:30:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e937333e-1725-40d4-900f-c4b58edba94e req-535ba469-aaae-44c5-a55c-c614eed8e49b service nova] Acquiring lock "refresh_cache-5d5f72a1-afd5-43f1-b803-c8924352acc2" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:30:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e937333e-1725-40d4-900f-c4b58edba94e req-535ba469-aaae-44c5-a55c-c614eed8e49b service nova] Acquired lock "refresh_cache-5d5f72a1-afd5-43f1-b803-c8924352acc2" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:30:22 user nova-compute[70243]: DEBUG nova.network.neutron [req-e937333e-1725-40d4-900f-c4b58edba94e req-535ba469-aaae-44c5-a55c-c614eed8e49b service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Refreshing network info cache for port 238f8b90-f497-46f5-9edd-0de67b62d546 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:30:22 user nova-compute[70243]: DEBUG nova.network.neutron [req-e937333e-1725-40d4-900f-c4b58edba94e req-535ba469-aaae-44c5-a55c-c614eed8e49b service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Updated VIF entry in instance network info cache for port 238f8b90-f497-46f5-9edd-0de67b62d546. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:30:22 user nova-compute[70243]: DEBUG nova.network.neutron [req-e937333e-1725-40d4-900f-c4b58edba94e req-535ba469-aaae-44c5-a55c-c614eed8e49b service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Updating instance_info_cache with network_info: [{"id": "238f8b90-f497-46f5-9edd-0de67b62d546", "address": "fa:16:3e:a7:f1:90", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f8b90-f4", "ovs_interfaceid": "238f8b90-f497-46f5-9edd-0de67b62d546", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:30:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e937333e-1725-40d4-900f-c4b58edba94e req-535ba469-aaae-44c5-a55c-c614eed8e49b service nova] Releasing lock "refresh_cache-5d5f72a1-afd5-43f1-b803-c8924352acc2" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:30:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Acquiring lock "c8fb01bf-c754-445c-ae71-18721cf5de7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "c8fb01bf-c754-445c-ae71-18721cf5de7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Acquiring lock "c8fb01bf-c754-445c-ae71-18721cf5de7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "c8fb01bf-c754-445c-ae71-18721cf5de7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "c8fb01bf-c754-445c-ae71-18721cf5de7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:24 user nova-compute[70243]: INFO nova.compute.manager [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Terminating instance
Jul 24 16:30:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:30:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-e45ad3a8-0e51-4420-a5a9-c063f9952bbc req-936fa941-c0b8-4b1b-b520-79efe1d2d110 service nova] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Received event network-vif-unplugged-4784b9be-f5b3-47f8-a553-45934b58f35d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:30:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e45ad3a8-0e51-4420-a5a9-c063f9952bbc req-936fa941-c0b8-4b1b-b520-79efe1d2d110 service nova] Acquiring lock "c8fb01bf-c754-445c-ae71-18721cf5de7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e45ad3a8-0e51-4420-a5a9-c063f9952bbc req-936fa941-c0b8-4b1b-b520-79efe1d2d110 service nova] Lock "c8fb01bf-c754-445c-ae71-18721cf5de7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e45ad3a8-0e51-4420-a5a9-c063f9952bbc req-936fa941-c0b8-4b1b-b520-79efe1d2d110 service nova] Lock "c8fb01bf-c754-445c-ae71-18721cf5de7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-e45ad3a8-0e51-4420-a5a9-c063f9952bbc req-936fa941-c0b8-4b1b-b520-79efe1d2d110 service nova] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] No waiting events found dispatching network-vif-unplugged-4784b9be-f5b3-47f8-a553-45934b58f35d {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:30:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-e45ad3a8-0e51-4420-a5a9-c063f9952bbc req-936fa941-c0b8-4b1b-b520-79efe1d2d110 service nova] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Received event network-vif-unplugged-4784b9be-f5b3-47f8-a553-45934b58f35d for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:30:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:24 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Instance destroyed successfully.
Jul 24 16:30:24 user nova-compute[70243]: DEBUG nova.objects.instance [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lazy-loading 'resources' on Instance uuid c8fb01bf-c754-445c-ae71-18721cf5de7e {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:30:24 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:28:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1082198834',display_name='tempest-VolumesActionsTest-instance-1082198834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1082198834',id=25,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:28:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb3c0ed911674b69a05524f555ea6e0e',ramdisk_id='',reservation_id='r-0xvfijm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-137271236',owner_user_name='tempest-VolumesActionsTest-137271236-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:28:41Z,user_data=None,user_id='8ec427ff69094ac7a8647c0811c2af7c',uuid=c8fb01bf-c754-445c-ae71-18721cf5de7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4784b9be-f5b3-47f8-a553-45934b58f35d", "address": "fa:16:3e:42:7e:a3", "network": {"id": "26f40e99-b090-4a8e-8d72-6b8674b2f716", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919802542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3c0ed911674b69a05524f555ea6e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4784b9be-f5", "ovs_interfaceid": "4784b9be-f5b3-47f8-a553-45934b58f35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:30:25 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Converting VIF {"id": "4784b9be-f5b3-47f8-a553-45934b58f35d", "address": "fa:16:3e:42:7e:a3", "network": {"id": "26f40e99-b090-4a8e-8d72-6b8674b2f716", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919802542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3c0ed911674b69a05524f555ea6e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4784b9be-f5", "ovs_interfaceid": "4784b9be-f5b3-47f8-a553-45934b58f35d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:30:25 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:7e:a3,bridge_name='br-int',has_traffic_filtering=True,id=4784b9be-f5b3-47f8-a553-45934b58f35d,network=Network(26f40e99-b090-4a8e-8d72-6b8674b2f716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4784b9be-f5') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:30:25 user nova-compute[70243]: DEBUG os_vif [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:7e:a3,bridge_name='br-int',has_traffic_filtering=True,id=4784b9be-f5b3-47f8-a553-45934b58f35d,network=Network(26f40e99-b090-4a8e-8d72-6b8674b2f716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4784b9be-f5') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:30:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4784b9be-f5, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:30:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:25 user nova-compute[70243]: INFO os_vif [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:7e:a3,bridge_name='br-int',has_traffic_filtering=True,id=4784b9be-f5b3-47f8-a553-45934b58f35d,network=Network(26f40e99-b090-4a8e-8d72-6b8674b2f716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4784b9be-f5')
Jul 24 16:30:25 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Deleting instance files /opt/stack/data/nova/instances/c8fb01bf-c754-445c-ae71-18721cf5de7e_del
Jul 24 16:30:25 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Deletion of /opt/stack/data/nova/instances/c8fb01bf-c754-445c-ae71-18721cf5de7e_del complete
Jul 24 16:30:25 user nova-compute[70243]: INFO nova.compute.manager [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 24 16:30:25 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:30:25 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:30:25 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:30:25 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:30:25 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Took 0.57 seconds to deallocate network for instance.
Jul 24 16:30:25 user nova-compute[70243]: DEBUG nova.compute.manager [req-2bebfbdc-0c40-41d5-9e11-a5819aa41e15 req-a3278df5-59a0-4e02-bd65-298b0581225c service nova] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Received event network-vif-deleted-4784b9be-f5b3-47f8-a553-45934b58f35d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:30:25 user nova-compute[70243]: INFO nova.compute.manager [req-2bebfbdc-0c40-41d5-9e11-a5819aa41e15 req-a3278df5-59a0-4e02-bd65-298b0581225c service nova] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Neutron deleted interface 4784b9be-f5b3-47f8-a553-45934b58f35d; detaching it from the instance and deleting it from the info cache
Jul 24 16:30:25 user nova-compute[70243]: DEBUG nova.network.neutron [req-2bebfbdc-0c40-41d5-9e11-a5819aa41e15 req-a3278df5-59a0-4e02-bd65-298b0581225c service nova] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:30:25 user nova-compute[70243]: DEBUG nova.compute.manager [req-2bebfbdc-0c40-41d5-9e11-a5819aa41e15 req-a3278df5-59a0-4e02-bd65-298b0581225c service nova] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Detach interface failed, port_id=4784b9be-f5b3-47f8-a553-45934b58f35d, reason: Instance c8fb01bf-c754-445c-ae71-18721cf5de7e could not be found. {{(pid=70243) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 16:30:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:25 user nova-compute[70243]: INFO nova.compute.manager [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Rescuing
Jul 24 16:30:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "refresh_cache-50fecb3a-8f06-4822-8c84-76df51acfe50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:30:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquired lock "refresh_cache-50fecb3a-8f06-4822-8c84-76df51acfe50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:30:25 user nova-compute[70243]: DEBUG nova.network.neutron [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG nova.objects.instance [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'flavor' on Instance uuid 5d5f72a1-afd5-43f1-b803-c8924352acc2 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:26 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Deleted allocations for instance c8fb01bf-c754-445c-ae71-18721cf5de7e
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cf108b52-378d-4dca-8dfc-f66c88c99563 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "c8fb01bf-c754-445c-ae71-18721cf5de7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.102s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:26 user nova-compute[70243]: INFO nova.compute.manager [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Attaching volume 87a58847-d166-4482-9699-9233689364a0 to /dev/vdb
Jul 24 16:30:26 user nova-compute[70243]: DEBUG os_brick.utils [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG nova.network.neutron [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Updating instance_info_cache with network_info: [{"id": "657cc261-2d12-42c2-a879-f8cc121bd811", "address": "fa:16:3e:93:0d:e3", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657cc261-2d", "ovs_interfaceid": "657cc261-2d12-42c2-a879-f8cc121bd811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e725970-45a3-4b7c-aaf3-b9c11c465d1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a86144-2c05-434e-af86-7848bda999cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Releasing lock "refresh_cache-50fecb3a-8f06-4822-8c84-76df51acfe50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daab1b9-dfb8-451c-a9d9-894919a2aa8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[60496617-c823-4edf-95d8-6b44e11ea89c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:30:26 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2810108c-53b5-47aa-a33f-228a03dc8b6f]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG os_brick.utils [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Updating existing volume attachment record: 7c7ebe91-a268-435f-9403-0e76dd6ef987 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-ea203f39-0342-477b-8d03-c9ef56d28f3f req-48918c98-4a09-4fa4-9e37-6fcb412505fe service nova] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Received event network-vif-plugged-4784b9be-f5b3-47f8-a553-45934b58f35d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ea203f39-0342-477b-8d03-c9ef56d28f3f req-48918c98-4a09-4fa4-9e37-6fcb412505fe service nova] Acquiring lock "c8fb01bf-c754-445c-ae71-18721cf5de7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ea203f39-0342-477b-8d03-c9ef56d28f3f req-48918c98-4a09-4fa4-9e37-6fcb412505fe service nova] Lock "c8fb01bf-c754-445c-ae71-18721cf5de7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ea203f39-0342-477b-8d03-c9ef56d28f3f req-48918c98-4a09-4fa4-9e37-6fcb412505fe service nova] Lock "c8fb01bf-c754-445c-ae71-18721cf5de7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-ea203f39-0342-477b-8d03-c9ef56d28f3f req-48918c98-4a09-4fa4-9e37-6fcb412505fe service nova] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] No waiting events found dispatching network-vif-plugged-4784b9be-f5b3-47f8-a553-45934b58f35d {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:30:26 user nova-compute[70243]: WARNING nova.compute.manager [req-ea203f39-0342-477b-8d03-c9ef56d28f3f req-48918c98-4a09-4fa4-9e37-6fcb412505fe service nova] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Received unexpected event network-vif-plugged-4784b9be-f5b3-47f8-a553-45934b58f35d for instance with vm_state deleted and task_state None.
Jul 24 16:30:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:27 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Instance destroyed successfully.
Jul 24 16:30:27 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Attempting rescue
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70243) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Instance directory exists: not creating {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 16:30:27 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Creating image(s)
Jul 24 16:30:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "/opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "/opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "/opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.objects.instance [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'trusted_certs' on Instance uuid 50fecb3a-8f06-4822-8c84-76df51acfe50 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.146s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk.rescue {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk.rescue" returned: 0 in 0.050s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.objects.instance [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'migration_context' on Instance uuid 50fecb3a-8f06-4822-8c84-76df51acfe50 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Start _get_guest_xml network_info=[{"id": "657cc261-2d12-42c2-a879-f8cc121bd811", "address": "fa:16:3e:93:0d:e3", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "vif_mac": "fa:16:3e:93:0d:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657cc261-2d", "ovs_interfaceid": "657cc261-2d12-42c2-a879-f8cc121bd811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.objects.instance [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'resources' on Instance uuid 50fecb3a-8f06-4822-8c84-76df51acfe50 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.objects.instance [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'numa_topology' on Instance uuid 50fecb3a-8f06-4822-8c84-76df51acfe50 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:30:27 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:30:27 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.objects.instance [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'vcpu_model' on Instance uuid 50fecb3a-8f06-4822-8c84-76df51acfe50 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1525531413',display_name='tempest-ServerRescueNegativeTestJSON-server-1525531413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1525531413',id=18,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:25:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c25474ae9fb49cb92c611e77f2dbc79',ramdisk_id='',reservation_id='r-yg0b8tqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1414931075',owner_user_name='tempest-ServerRescueNegativeTestJSON-1414931075-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:25:47Z,user_data=None,user_id='fcb7fb5c11bb4d65b9c39923840685c6',uuid=50fecb3a-8f06-4822-8c84-76df51acfe50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "657cc261-2d12-42c2-a879-f8cc121bd811", "address": "fa:16:3e:93:0d:e3", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "vif_mac": "fa:16:3e:93:0d:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657cc261-2d", "ovs_interfaceid": "657cc261-2d12-42c2-a879-f8cc121bd811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converting VIF {"id": "657cc261-2d12-42c2-a879-f8cc121bd811", "address": "fa:16:3e:93:0d:e3", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "vif_mac": "fa:16:3e:93:0d:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657cc261-2d", "ovs_interfaceid": "657cc261-2d12-42c2-a879-f8cc121bd811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:0d:e3,bridge_name='br-int',has_traffic_filtering=True,id=657cc261-2d12-42c2-a879-f8cc121bd811,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657cc261-2d') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.objects.instance [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'pci_devices' on Instance uuid 50fecb3a-8f06-4822-8c84-76df51acfe50 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:30:27 user nova-compute[70243]:   <uuid>50fecb3a-8f06-4822-8c84-76df51acfe50</uuid>
Jul 24 16:30:27 user nova-compute[70243]:   <name>instance-00000012</name>
Jul 24 16:30:27 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:30:27 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:30:27 user nova-compute[70243]:   <metadata>
Jul 24 16:30:27 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:30:27 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:30:27 user nova-compute[70243]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1525531413</nova:name>
Jul 24 16:30:27 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:30:27</nova:creationTime>
Jul 24 16:30:27 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:30:27 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:30:27 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:30:27 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:30:27 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:30:27 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:30:27 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:30:27 user nova-compute[70243]:       <nova:owner>
Jul 24 16:30:27 user nova-compute[70243]:         <nova:user uuid="fcb7fb5c11bb4d65b9c39923840685c6">tempest-ServerRescueNegativeTestJSON-1414931075-project-member</nova:user>
Jul 24 16:30:27 user nova-compute[70243]:         <nova:project uuid="9c25474ae9fb49cb92c611e77f2dbc79">tempest-ServerRescueNegativeTestJSON-1414931075</nova:project>
Jul 24 16:30:27 user nova-compute[70243]:       </nova:owner>
Jul 24 16:30:27 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:30:27 user nova-compute[70243]:       <nova:ports>
Jul 24 16:30:27 user nova-compute[70243]:         <nova:port uuid="657cc261-2d12-42c2-a879-f8cc121bd811">
Jul 24 16:30:27 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 16:30:27 user nova-compute[70243]:         </nova:port>
Jul 24 16:30:27 user nova-compute[70243]:       </nova:ports>
Jul 24 16:30:27 user nova-compute[70243]:     </nova:instance>
Jul 24 16:30:27 user nova-compute[70243]:   </metadata>
Jul 24 16:30:27 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:30:27 user nova-compute[70243]:     <system>
Jul 24 16:30:27 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:30:27 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:30:27 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:30:27 user nova-compute[70243]:       <entry name="serial">50fecb3a-8f06-4822-8c84-76df51acfe50</entry>
Jul 24 16:30:27 user nova-compute[70243]:       <entry name="uuid">50fecb3a-8f06-4822-8c84-76df51acfe50</entry>
Jul 24 16:30:27 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:30:27 user nova-compute[70243]:     </system>
Jul 24 16:30:27 user nova-compute[70243]:   </sysinfo>
Jul 24 16:30:27 user nova-compute[70243]:   <os>
Jul 24 16:30:27 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:30:27 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:30:27 user nova-compute[70243]:   </os>
Jul 24 16:30:27 user nova-compute[70243]:   <features>
Jul 24 16:30:27 user nova-compute[70243]:     <acpi/>
Jul 24 16:30:27 user nova-compute[70243]:     <apic/>
Jul 24 16:30:27 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:30:27 user nova-compute[70243]:   </features>
Jul 24 16:30:27 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:30:27 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:30:27 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:30:27 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:30:27 user nova-compute[70243]:   </clock>
Jul 24 16:30:27 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:30:27 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:30:27 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:30:27 user nova-compute[70243]:   </cpu>
Jul 24 16:30:27 user nova-compute[70243]:   <devices>
Jul 24 16:30:27 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:30:27 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:30:27 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk.rescue"/>
Jul 24 16:30:27 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:30:27 user nova-compute[70243]:     </disk>
Jul 24 16:30:27 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:30:27 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:30:27 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk"/>
Jul 24 16:30:27 user nova-compute[70243]:       <target dev="vdb" bus="virtio"/>
Jul 24 16:30:27 user nova-compute[70243]:     </disk>
Jul 24 16:30:27 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:30:27 user nova-compute[70243]:       <mac address="fa:16:3e:93:0d:e3"/>
Jul 24 16:30:27 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:30:27 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:30:27 user nova-compute[70243]:       <target dev="tap657cc261-2d"/>
Jul 24 16:30:27 user nova-compute[70243]:     </interface>
Jul 24 16:30:27 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:30:27 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/console.log" append="off"/>
Jul 24 16:30:27 user nova-compute[70243]:     </serial>
Jul 24 16:30:27 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:30:27 user nova-compute[70243]:     <video>
Jul 24 16:30:27 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:30:27 user nova-compute[70243]:     </video>
Jul 24 16:30:27 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:30:27 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:30:27 user nova-compute[70243]:     </rng>
Jul 24 16:30:27 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:30:27 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:30:27 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:30:27 user nova-compute[70243]:     </memballoon>
Jul 24 16:30:27 user nova-compute[70243]:   </devices>
Jul 24 16:30:27 user nova-compute[70243]: </domain>
Jul 24 16:30:27 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:30:27 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Instance destroyed successfully.
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:30:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] No VIF found with MAC fa:16:3e:93:0d:e3, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:30:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-4d14ebed-a53a-4f5d-9ad9-335796e11974 req-0f920872-b2c8-4a82-9341-7ce904250a91 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received event network-vif-unplugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:30:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4d14ebed-a53a-4f5d-9ad9-335796e11974 req-0f920872-b2c8-4a82-9341-7ce904250a91 service nova] Acquiring lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4d14ebed-a53a-4f5d-9ad9-335796e11974 req-0f920872-b2c8-4a82-9341-7ce904250a91 service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4d14ebed-a53a-4f5d-9ad9-335796e11974 req-0f920872-b2c8-4a82-9341-7ce904250a91 service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-4d14ebed-a53a-4f5d-9ad9-335796e11974 req-0f920872-b2c8-4a82-9341-7ce904250a91 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] No waiting events found dispatching network-vif-unplugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:30:28 user nova-compute[70243]: WARNING nova.compute.manager [req-4d14ebed-a53a-4f5d-9ad9-335796e11974 req-0f920872-b2c8-4a82-9341-7ce904250a91 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received unexpected event network-vif-unplugged-657cc261-2d12-42c2-a879-f8cc121bd811 for instance with vm_state active and task_state rescuing.
Jul 24 16:30:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-4d14ebed-a53a-4f5d-9ad9-335796e11974 req-0f920872-b2c8-4a82-9341-7ce904250a91 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received event network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:30:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4d14ebed-a53a-4f5d-9ad9-335796e11974 req-0f920872-b2c8-4a82-9341-7ce904250a91 service nova] Acquiring lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4d14ebed-a53a-4f5d-9ad9-335796e11974 req-0f920872-b2c8-4a82-9341-7ce904250a91 service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4d14ebed-a53a-4f5d-9ad9-335796e11974 req-0f920872-b2c8-4a82-9341-7ce904250a91 service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-4d14ebed-a53a-4f5d-9ad9-335796e11974 req-0f920872-b2c8-4a82-9341-7ce904250a91 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] No waiting events found dispatching network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:30:28 user nova-compute[70243]: WARNING nova.compute.manager [req-4d14ebed-a53a-4f5d-9ad9-335796e11974 req-0f920872-b2c8-4a82-9341-7ce904250a91 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received unexpected event network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 for instance with vm_state active and task_state rescuing.
Jul 24 16:30:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c0ff2a17-b8b7-4be3-b0d5-f0f0ae569526 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "6ed1935d-3a60-418e-bc44-ed65452afc1a" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c0ff2a17-b8b7-4be3-b0d5-f0f0ae569526 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:30 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c0ff2a17-b8b7-4be3-b0d5-f0f0ae569526 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Going to confirm migration 2 {{(pid=70243) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4693}}
Jul 24 16:30:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c0ff2a17-b8b7-4be3-b0d5-f0f0ae569526 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "refresh_cache-6ed1935d-3a60-418e-bc44-ed65452afc1a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:30:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c0ff2a17-b8b7-4be3-b0d5-f0f0ae569526 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquired lock "refresh_cache-6ed1935d-3a60-418e-bc44-ed65452afc1a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:30:30 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c0ff2a17-b8b7-4be3-b0d5-f0f0ae569526 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:30:30 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c0ff2a17-b8b7-4be3-b0d5-f0f0ae569526 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lazy-loading 'info_cache' on Instance uuid 6ed1935d-3a60-418e-bc44-ed65452afc1a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:30:30 user nova-compute[70243]: DEBUG nova.compute.manager [req-27243906-9109-4721-aeab-b5f013388493 req-724a2769-d0f5-4d5e-b3c0-9b2d3c914017 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received event network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:30:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-27243906-9109-4721-aeab-b5f013388493 req-724a2769-d0f5-4d5e-b3c0-9b2d3c914017 service nova] Acquiring lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-27243906-9109-4721-aeab-b5f013388493 req-724a2769-d0f5-4d5e-b3c0-9b2d3c914017 service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-27243906-9109-4721-aeab-b5f013388493 req-724a2769-d0f5-4d5e-b3c0-9b2d3c914017 service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:30 user nova-compute[70243]: DEBUG nova.compute.manager [req-27243906-9109-4721-aeab-b5f013388493 req-724a2769-d0f5-4d5e-b3c0-9b2d3c914017 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] No waiting events found dispatching network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:30:30 user nova-compute[70243]: WARNING nova.compute.manager [req-27243906-9109-4721-aeab-b5f013388493 req-724a2769-d0f5-4d5e-b3c0-9b2d3c914017 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received unexpected event network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 for instance with vm_state active and task_state rescuing.
Jul 24 16:30:30 user nova-compute[70243]: DEBUG nova.compute.manager [req-27243906-9109-4721-aeab-b5f013388493 req-724a2769-d0f5-4d5e-b3c0-9b2d3c914017 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received event network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:30:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-27243906-9109-4721-aeab-b5f013388493 req-724a2769-d0f5-4d5e-b3c0-9b2d3c914017 service nova] Acquiring lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-27243906-9109-4721-aeab-b5f013388493 req-724a2769-d0f5-4d5e-b3c0-9b2d3c914017 service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-27243906-9109-4721-aeab-b5f013388493 req-724a2769-d0f5-4d5e-b3c0-9b2d3c914017 service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:30 user nova-compute[70243]: DEBUG nova.compute.manager [req-27243906-9109-4721-aeab-b5f013388493 req-724a2769-d0f5-4d5e-b3c0-9b2d3c914017 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] No waiting events found dispatching network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:30:30 user nova-compute[70243]: WARNING nova.compute.manager [req-27243906-9109-4721-aeab-b5f013388493 req-724a2769-d0f5-4d5e-b3c0-9b2d3c914017 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received unexpected event network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 for instance with vm_state active and task_state rescuing.
Jul 24 16:30:31 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c0ff2a17-b8b7-4be3-b0d5-f0f0ae569526 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Updating instance_info_cache with network_info: [{"id": "021971db-1e79-467f-8f5b-5361f205fceb", "address": "fa:16:3e:4a:88:70", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021971db-1e", "ovs_interfaceid": "021971db-1e79-467f-8f5b-5361f205fceb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:30:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c0ff2a17-b8b7-4be3-b0d5-f0f0ae569526 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Releasing lock "refresh_cache-6ed1935d-3a60-418e-bc44-ed65452afc1a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:30:31 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c0ff2a17-b8b7-4be3-b0d5-f0f0ae569526 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lazy-loading 'migration_context' on Instance uuid 6ed1935d-3a60-418e-bc44-ed65452afc1a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:30:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c0ff2a17-b8b7-4be3-b0d5-f0f0ae569526 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c0ff2a17-b8b7-4be3-b0d5-f0f0ae569526 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Removed pending event for 50fecb3a-8f06-4822-8c84-76df51acfe50 due to event {{(pid=70243) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 16:30:31 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216231.3096714, 50fecb3a-8f06-4822-8c84-76df51acfe50 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:30:31 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] VM Resumed (Lifecycle Event)
Jul 24 16:30:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b5cc13a1-a6a8-4d61-a772-82b1203455e8 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:30:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:30:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:30:31 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 24 16:30:31 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216231.3109083, 50fecb3a-8f06-4822-8c84-76df51acfe50 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:30:31 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] VM Started (Lifecycle Event)
Jul 24 16:30:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:30:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:30:31 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c0ff2a17-b8b7-4be3-b0d5-f0f0ae569526 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:30:31 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c0ff2a17-b8b7-4be3-b0d5-f0f0ae569526 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:30:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c0ff2a17-b8b7-4be3-b0d5-f0f0ae569526 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.394s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:31 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-c0ff2a17-b8b7-4be3-b0d5-f0f0ae569526 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Deleted allocation for migration fd176af4-9996-4d94-805d-cc43802750cf
Jul 24 16:30:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c0ff2a17-b8b7-4be3-b0d5-f0f0ae569526 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.498s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QSXwfcAl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:30:33 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:30:33 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:30:33 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb415c4-d219-42f1-a4a9-5d3c6cb47aa2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:30:33 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c55501-788b-476e-aab6-6f8628c79313]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0] added
Jul 24 16:30:33 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2042568-78cd-4434-a501-adf3acf6dcc2]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7821a819-cbcf-4bc9-8bf0-44085a0e1a4f]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QSXwfcAl {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QSXwfcAl" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5419b99-a7fb-42e4-af00-39a6e6782b34]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QSXwfcAl'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7262e8-bf9d-45a7-aaa1-129a0bb1e038]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4538ad-6a03-4c91-9845-5680401cd953]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:30:33 user nova-compute[70243]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)
Jul 24 16:30:33 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:30:33 user nova-compute[70243]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)
Jul 24 16:30:33 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[64554ba3-91a0-441e-a4a1-7bbf9f0bf9d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0, portal: 172.16.0.220,3260]
Jul 24 16:30:33 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0, portal: 172.16.0.220,3260] successful.
Jul 24 16:30:33 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3960c3d8-cdc7-48e3-bef0-0a3a9bcee0ff]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65ece42-f56a-49f1-a7b7-655137d047a9]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:30:33 user nova-compute[70243]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)
Jul 24 16:30:33 user nova-compute[70243]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 (non-flash)
Jul 24 16:30:33 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:30:33 user nova-compute[70243]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)
Jul 24 16:30:33 user nova-compute[70243]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 (non-flash)
Jul 24 16:30:33 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7a5155-6a57-4ee0-803a-99c6d38b8d16]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:30:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QSXwfcAl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:30:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:30:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23466663838353562', 'path': '/dev/sdc'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:30:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466663838353562', 'path': '/dev/sdc'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:30:34 user nova-compute[70243]: DEBUG nova.objects.instance [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'flavor' on Instance uuid 5d5f72a1-afd5-43f1-b803-c8924352acc2 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:30:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:30:34 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:30:34 user nova-compute[70243]:   <source dev="/dev/sdc"/>
Jul 24 16:30:34 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:30:34 user nova-compute[70243]:   <serial>87a58847-d166-4482-9699-9233689364a0</serial>
Jul 24 16:30:34 user nova-compute[70243]: </disk>
Jul 24 16:30:34 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:30:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:35 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:30:35 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:30:35 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] No VIF found with MAC fa:16:3e:a7:f1:90, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:30:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e09901f5-79fa-4394-9640-4258b2b7b2d9 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.075s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "8eb4450c-bf08-4949-a126-d30dbb3ea744" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:37 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:30:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:37 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:30:37 user nova-compute[70243]: INFO nova.compute.claims [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Claim successful on node user
Jul 24 16:30:38 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:30:38 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:30:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:38 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:30:38 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:30:38 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:30:38 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:30:38 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:30:38 user nova-compute[70243]: DEBUG nova.policy [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62f8a994029a48608bfdcb15f14b2067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fcf70d1092145a2bda67106833fe84d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:30:38 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:30:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:30:38 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Creating image(s)
Jul 24 16:30:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "/opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "/opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "/opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.151s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk 1073741824" returned: 0 in 0.085s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.134s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:39 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:30:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:39 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Cannot resize image /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:30:39 user nova-compute[70243]: DEBUG nova.objects.instance [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'migration_context' on Instance uuid 8eb4450c-bf08-4949-a126-d30dbb3ea744 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:30:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:30:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Ensure instance console log exists: /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:30:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:39 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Successfully created port: 3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:30:39 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216224.9741926, c8fb01bf-c754-445c-ae71-18721cf5de7e => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:30:39 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] VM Stopped (Lifecycle Event)
Jul 24 16:30:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-7038cd9e-9cf4-4c1c-b655-201154ebd5aa None None] [instance: c8fb01bf-c754-445c-ae71-18721cf5de7e] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG nova.objects.instance [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'flavor' on Instance uuid 5d5f72a1-afd5-43f1-b803-c8924352acc2 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:40 user nova-compute[70243]: INFO nova.compute.manager [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Attaching volume aa63f630-73d0-44e5-8f7b-6296789849e1 to /dev/vdc
Jul 24 16:30:40 user nova-compute[70243]: DEBUG os_brick.utils [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3227d51-5019-4e38-84e3-b4466ed9e74a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92c82e5-accd-489c-9fe4-011c485af829]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[002827a3-e610-4d2b-a647-ca9896b4e68f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[62172716-f897-4679-a542-52dd70e8bd1f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:30:40 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f599e2-1395-4444-9dce-f1af74479136]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG os_brick.utils [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Updating existing volume attachment record: d1e6decb-4046-45b8-af81-22203de0f06d {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Successfully updated port: 3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "refresh_cache-8eb4450c-bf08-4949-a126-d30dbb3ea744" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquired lock "refresh_cache-8eb4450c-bf08-4949-a126-d30dbb3ea744" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG nova.compute.manager [req-6c8fee3d-a743-458a-8a40-4841bd1a52b6 req-b4d0962d-672e-416a-ac3d-d1be62305516 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Received event network-changed-3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG nova.compute.manager [req-6c8fee3d-a743-458a-8a40-4841bd1a52b6 req-b4d0962d-672e-416a-ac3d-d1be62305516 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Refreshing instance network info cache due to event network-changed-3053b7df-e393-4bc7-a17f-8983f22cdd96. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6c8fee3d-a743-458a-8a40-4841bd1a52b6 req-b4d0962d-672e-416a-ac3d-d1be62305516 service nova] Acquiring lock "refresh_cache-8eb4450c-bf08-4949-a126-d30dbb3ea744" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:30:40 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Updating instance_info_cache with network_info: [{"id": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "address": "fa:16:3e:ad:37:16", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3053b7df-e3", "ovs_interfaceid": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Releasing lock "refresh_cache-8eb4450c-bf08-4949-a126-d30dbb3ea744" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Instance network_info: |[{"id": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "address": "fa:16:3e:ad:37:16", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3053b7df-e3", "ovs_interfaceid": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6c8fee3d-a743-458a-8a40-4841bd1a52b6 req-b4d0962d-672e-416a-ac3d-d1be62305516 service nova] Acquired lock "refresh_cache-8eb4450c-bf08-4949-a126-d30dbb3ea744" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.network.neutron [req-6c8fee3d-a743-458a-8a40-4841bd1a52b6 req-b4d0962d-672e-416a-ac3d-d1be62305516 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Refreshing network info cache for port 3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Start _get_guest_xml network_info=[{"id": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "address": "fa:16:3e:ad:37:16", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3053b7df-e3", "ovs_interfaceid": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:30:41 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:30:41 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:30:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-980705664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-980705664',id=26,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyki4BvM4FzSdqhAROYG3ucB3rK6iVcLMVb2n52uMdJxxSOHetAHehA+zLslPea930abAZjc/5HN/NJZ5DpCSRZj9LlXJOIRzDCsIj02zLX2xeAqDz0U2rfyStUNE+81g==',key_name='tempest-keypair-1565290298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fcf70d1092145a2bda67106833fe84d',ramdisk_id='',reservation_id='r-0b0cga8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-372850833',owner_user_name='tempest-AttachVolumeShelveTestJSON-372850833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:30:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62f8a994029a48608bfdcb15f14b2067',uuid=8eb4450c-bf08-4949-a126-d30dbb3ea744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "address": "fa:16:3e:ad:37:16", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3053b7df-e3", "ovs_interfaceid": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converting VIF {"id": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "address": "fa:16:3e:ad:37:16", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3053b7df-e3", "ovs_interfaceid": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:37:16,bridge_name='br-int',has_traffic_filtering=True,id=3053b7df-e393-4bc7-a17f-8983f22cdd96,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3053b7df-e3') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.objects.instance [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'pci_devices' on Instance uuid 8eb4450c-bf08-4949-a126-d30dbb3ea744 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:30:41 user nova-compute[70243]:   <uuid>8eb4450c-bf08-4949-a126-d30dbb3ea744</uuid>
Jul 24 16:30:41 user nova-compute[70243]:   <name>instance-0000001a</name>
Jul 24 16:30:41 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:30:41 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:30:41 user nova-compute[70243]:   <metadata>
Jul 24 16:30:41 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:30:41 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:30:41 user nova-compute[70243]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-980705664</nova:name>
Jul 24 16:30:41 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:30:41</nova:creationTime>
Jul 24 16:30:41 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:30:41 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:30:41 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:30:41 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:30:41 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:30:41 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:30:41 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:30:41 user nova-compute[70243]:       <nova:owner>
Jul 24 16:30:41 user nova-compute[70243]:         <nova:user uuid="62f8a994029a48608bfdcb15f14b2067">tempest-AttachVolumeShelveTestJSON-372850833-project-member</nova:user>
Jul 24 16:30:41 user nova-compute[70243]:         <nova:project uuid="9fcf70d1092145a2bda67106833fe84d">tempest-AttachVolumeShelveTestJSON-372850833</nova:project>
Jul 24 16:30:41 user nova-compute[70243]:       </nova:owner>
Jul 24 16:30:41 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:30:41 user nova-compute[70243]:       <nova:ports>
Jul 24 16:30:41 user nova-compute[70243]:         <nova:port uuid="3053b7df-e393-4bc7-a17f-8983f22cdd96">
Jul 24 16:30:41 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 24 16:30:41 user nova-compute[70243]:         </nova:port>
Jul 24 16:30:41 user nova-compute[70243]:       </nova:ports>
Jul 24 16:30:41 user nova-compute[70243]:     </nova:instance>
Jul 24 16:30:41 user nova-compute[70243]:   </metadata>
Jul 24 16:30:41 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:30:41 user nova-compute[70243]:     <system>
Jul 24 16:30:41 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:30:41 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:30:41 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:30:41 user nova-compute[70243]:       <entry name="serial">8eb4450c-bf08-4949-a126-d30dbb3ea744</entry>
Jul 24 16:30:41 user nova-compute[70243]:       <entry name="uuid">8eb4450c-bf08-4949-a126-d30dbb3ea744</entry>
Jul 24 16:30:41 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:30:41 user nova-compute[70243]:     </system>
Jul 24 16:30:41 user nova-compute[70243]:   </sysinfo>
Jul 24 16:30:41 user nova-compute[70243]:   <os>
Jul 24 16:30:41 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:30:41 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:30:41 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:30:41 user nova-compute[70243]:   </os>
Jul 24 16:30:41 user nova-compute[70243]:   <features>
Jul 24 16:30:41 user nova-compute[70243]:     <acpi/>
Jul 24 16:30:41 user nova-compute[70243]:     <apic/>
Jul 24 16:30:41 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:30:41 user nova-compute[70243]:   </features>
Jul 24 16:30:41 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:30:41 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:30:41 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:30:41 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:30:41 user nova-compute[70243]:   </clock>
Jul 24 16:30:41 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:30:41 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:30:41 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:30:41 user nova-compute[70243]:   </cpu>
Jul 24 16:30:41 user nova-compute[70243]:   <devices>
Jul 24 16:30:41 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:30:41 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:30:41 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk"/>
Jul 24 16:30:41 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:30:41 user nova-compute[70243]:     </disk>
Jul 24 16:30:41 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:30:41 user nova-compute[70243]:       <mac address="fa:16:3e:ad:37:16"/>
Jul 24 16:30:41 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:30:41 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:30:41 user nova-compute[70243]:       <target dev="tap3053b7df-e3"/>
Jul 24 16:30:41 user nova-compute[70243]:     </interface>
Jul 24 16:30:41 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:30:41 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/console.log" append="off"/>
Jul 24 16:30:41 user nova-compute[70243]:     </serial>
Jul 24 16:30:41 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:30:41 user nova-compute[70243]:     <video>
Jul 24 16:30:41 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:30:41 user nova-compute[70243]:     </video>
Jul 24 16:30:41 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:30:41 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:30:41 user nova-compute[70243]:     </rng>
Jul 24 16:30:41 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:30:41 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:30:41 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:30:41 user nova-compute[70243]:     </memballoon>
Jul 24 16:30:41 user nova-compute[70243]:   </devices>
Jul 24 16:30:41 user nova-compute[70243]: </domain>
Jul 24 16:30:41 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:30:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-980705664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-980705664',id=26,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyki4BvM4FzSdqhAROYG3ucB3rK6iVcLMVb2n52uMdJxxSOHetAHehA+zLslPea930abAZjc/5HN/NJZ5DpCSRZj9LlXJOIRzDCsIj02zLX2xeAqDz0U2rfyStUNE+81g==',key_name='tempest-keypair-1565290298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fcf70d1092145a2bda67106833fe84d',ramdisk_id='',reservation_id='r-0b0cga8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-372850833',owner_user_name='tempest-AttachVolumeShelveTestJSON-372850833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:30:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62f8a994029a48608bfdcb15f14b2067',uuid=8eb4450c-bf08-4949-a126-d30dbb3ea744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "address": "fa:16:3e:ad:37:16", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3053b7df-e3", "ovs_interfaceid": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converting VIF {"id": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "address": "fa:16:3e:ad:37:16", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3053b7df-e3", "ovs_interfaceid": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:37:16,bridge_name='br-int',has_traffic_filtering=True,id=3053b7df-e393-4bc7-a17f-8983f22cdd96,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3053b7df-e3') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG os_vif [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:37:16,bridge_name='br-int',has_traffic_filtering=True,id=3053b7df-e393-4bc7-a17f-8983f22cdd96,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3053b7df-e3') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3053b7df-e3, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3053b7df-e3, col_values=(('external_ids', {'iface-id': '3053b7df-e393-4bc7-a17f-8983f22cdd96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:37:16', 'vm-uuid': '8eb4450c-bf08-4949-a126-d30dbb3ea744'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:41 user nova-compute[70243]: INFO os_vif [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:37:16,bridge_name='br-int',has_traffic_filtering=True,id=3053b7df-e393-4bc7-a17f-8983f22cdd96,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3053b7df-e3')
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] No VIF found with MAC fa:16:3e:ad:37:16, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.network.neutron [req-6c8fee3d-a743-458a-8a40-4841bd1a52b6 req-b4d0962d-672e-416a-ac3d-d1be62305516 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Updated VIF entry in instance network info cache for port 3053b7df-e393-4bc7-a17f-8983f22cdd96. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG nova.network.neutron [req-6c8fee3d-a743-458a-8a40-4841bd1a52b6 req-b4d0962d-672e-416a-ac3d-d1be62305516 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Updating instance_info_cache with network_info: [{"id": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "address": "fa:16:3e:ad:37:16", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3053b7df-e3", "ovs_interfaceid": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:30:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6c8fee3d-a743-458a-8a40-4841bd1a52b6 req-b4d0962d-672e-416a-ac3d-d1be62305516 service nova] Releasing lock "refresh_cache-8eb4450c-bf08-4949-a126-d30dbb3ea744" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:30:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:42 user nova-compute[70243]: DEBUG nova.compute.manager [req-cc45f2b0-7bd9-4ac1-b279-aa0d9a9e8f50 req-77deb2d1-612e-46c5-be71-a13385fa78df service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Received event network-vif-plugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:30:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cc45f2b0-7bd9-4ac1-b279-aa0d9a9e8f50 req-77deb2d1-612e-46c5-be71-a13385fa78df service nova] Acquiring lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cc45f2b0-7bd9-4ac1-b279-aa0d9a9e8f50 req-77deb2d1-612e-46c5-be71-a13385fa78df service nova] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cc45f2b0-7bd9-4ac1-b279-aa0d9a9e8f50 req-77deb2d1-612e-46c5-be71-a13385fa78df service nova] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:42 user nova-compute[70243]: DEBUG nova.compute.manager [req-cc45f2b0-7bd9-4ac1-b279-aa0d9a9e8f50 req-77deb2d1-612e-46c5-be71-a13385fa78df service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] No waiting events found dispatching network-vif-plugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:30:42 user nova-compute[70243]: WARNING nova.compute.manager [req-cc45f2b0-7bd9-4ac1-b279-aa0d9a9e8f50 req-77deb2d1-612e-46c5-be71-a13385fa78df service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Received unexpected event network-vif-plugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 for instance with vm_state building and task_state spawning.
Jul 24 16:30:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:44 user nova-compute[70243]: INFO nova.compute.manager [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Terminating instance
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.compute.manager [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-6b91ddae-1f9c-4f84-ab89-f0e42186682d req-47a03d6d-83b7-41ab-b896-54136ac20e5c service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Received event network-vif-unplugged-bc944a2d-ab8f-475a-b276-485ab373860a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6b91ddae-1f9c-4f84-ab89-f0e42186682d req-47a03d6d-83b7-41ab-b896-54136ac20e5c service nova] Acquiring lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6b91ddae-1f9c-4f84-ab89-f0e42186682d req-47a03d6d-83b7-41ab-b896-54136ac20e5c service nova] Lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6b91ddae-1f9c-4f84-ab89-f0e42186682d req-47a03d6d-83b7-41ab-b896-54136ac20e5c service nova] Lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-6b91ddae-1f9c-4f84-ab89-f0e42186682d req-47a03d6d-83b7-41ab-b896-54136ac20e5c service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] No waiting events found dispatching network-vif-unplugged-bc944a2d-ab8f-475a-b276-485ab373860a {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-6b91ddae-1f9c-4f84-ab89-f0e42186682d req-47a03d6d-83b7-41ab-b896-54136ac20e5c service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Received event network-vif-unplugged-bc944a2d-ab8f-475a-b276-485ab373860a for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:44 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Instance destroyed successfully.
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.objects.instance [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lazy-loading 'resources' on Instance uuid 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:24:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1233422015',display_name='tempest-AttachVolumeNegativeTest-server-1233422015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1233422015',id=17,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGT2rkGSyXlMbTq/yju1RCH/R39q/wP+8/at2zAYGOJkKVQGAMqmx1u2dapVODLNC31GOE7t50QLv5CBwzfMkoaMIGDOZgz6KtBTHgG1635SSIdlm7b2nzTv0J9CMuDqQ==',key_name='tempest-keypair-1272592606',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:25:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e819e22e590947478d513e1b9ad39494',ramdisk_id='',reservation_id='r-ooxr0ou9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1152214105',owner_user_name='tempest-AttachVolumeNegativeTest-1152214105-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:25:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df18929107a458194a9c528d9bdfeac',uuid=9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc944a2d-ab8f-475a-b276-485ab373860a", "address": "fa:16:3e:de:36:b6", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc944a2d-ab", "ovs_interfaceid": "bc944a2d-ab8f-475a-b276-485ab373860a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converting VIF {"id": "bc944a2d-ab8f-475a-b276-485ab373860a", "address": "fa:16:3e:de:36:b6", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc944a2d-ab", "ovs_interfaceid": "bc944a2d-ab8f-475a-b276-485ab373860a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:36:b6,bridge_name='br-int',has_traffic_filtering=True,id=bc944a2d-ab8f-475a-b276-485ab373860a,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc944a2d-ab') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG os_vif [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:36:b6,bridge_name='br-int',has_traffic_filtering=True,id=bc944a2d-ab8f-475a-b276-485ab373860a,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc944a2d-ab') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc944a2d-ab, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:44 user nova-compute[70243]: INFO os_vif [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:36:b6,bridge_name='br-int',has_traffic_filtering=True,id=bc944a2d-ab8f-475a-b276-485ab373860a,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc944a2d-ab')
Jul 24 16:30:44 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Deleting instance files /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04_del
Jul 24 16:30:44 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Deletion of /opt/stack/data/nova/instances/9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04_del complete
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216244.9090416, 8eb4450c-bf08-4949-a126-d30dbb3ea744 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:30:44 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] VM Resumed (Lifecycle Event)
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-1220bb11-1d10-4c35-8316-9ae6f37e5a49 req-733ea06c-380b-404f-8fde-eda7d8e72f42 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Received event network-vif-plugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1220bb11-1d10-4c35-8316-9ae6f37e5a49 req-733ea06c-380b-404f-8fde-eda7d8e72f42 service nova] Acquiring lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1220bb11-1d10-4c35-8316-9ae6f37e5a49 req-733ea06c-380b-404f-8fde-eda7d8e72f42 service nova] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1220bb11-1d10-4c35-8316-9ae6f37e5a49 req-733ea06c-380b-404f-8fde-eda7d8e72f42 service nova] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-1220bb11-1d10-4c35-8316-9ae6f37e5a49 req-733ea06c-380b-404f-8fde-eda7d8e72f42 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] No waiting events found dispatching network-vif-plugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:30:44 user nova-compute[70243]: WARNING nova.compute.manager [req-1220bb11-1d10-4c35-8316-9ae6f37e5a49 req-733ea06c-380b-404f-8fde-eda7d8e72f42 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Received unexpected event network-vif-plugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 for instance with vm_state building and task_state spawning.
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:30:44 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Instance spawned successfully.
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:30:44 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216244.9128108, 8eb4450c-bf08-4949-a126-d30dbb3ea744 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:30:44 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] VM Started (Lifecycle Event)
Jul 24 16:30:44 user nova-compute[70243]: INFO nova.compute.manager [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Took 0.92 seconds to destroy the instance on the hypervisor.
Jul 24 16:30:44 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:30:44 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:30:45 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:30:45 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:30:45 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:30:45 user nova-compute[70243]: INFO nova.compute.manager [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Took 6.52 seconds to spawn the instance on the hypervisor.
Jul 24 16:30:45 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:30:45 user nova-compute[70243]: INFO nova.compute.manager [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Took 7.27 seconds to build instance.
Jul 24 16:30:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e1641189-8521-4d81-9859-d8e112caeb5b tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.375s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:45 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:30:45 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:30:46 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:30:46 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Took 1.05 seconds to deallocate network for instance.
Jul 24 16:30:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:46 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:30:46 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:30:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:46 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Deleted allocations for instance 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04
Jul 24 16:30:46 user nova-compute[70243]: DEBUG nova.compute.manager [req-827b9467-5349-4193-9b8d-46a9dadfc73e req-e4c22096-895a-4248-adbc-95ddcf9f654e service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Received event network-vif-plugged-bc944a2d-ab8f-475a-b276-485ab373860a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:30:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-827b9467-5349-4193-9b8d-46a9dadfc73e req-e4c22096-895a-4248-adbc-95ddcf9f654e service nova] Acquiring lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-827b9467-5349-4193-9b8d-46a9dadfc73e req-e4c22096-895a-4248-adbc-95ddcf9f654e service nova] Lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-827b9467-5349-4193-9b8d-46a9dadfc73e req-e4c22096-895a-4248-adbc-95ddcf9f654e service nova] Lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:46 user nova-compute[70243]: DEBUG nova.compute.manager [req-827b9467-5349-4193-9b8d-46a9dadfc73e req-e4c22096-895a-4248-adbc-95ddcf9f654e service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] No waiting events found dispatching network-vif-plugged-bc944a2d-ab8f-475a-b276-485ab373860a {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:30:46 user nova-compute[70243]: WARNING nova.compute.manager [req-827b9467-5349-4193-9b8d-46a9dadfc73e req-e4c22096-895a-4248-adbc-95ddcf9f654e service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Received unexpected event network-vif-plugged-bc944a2d-ab8f-475a-b276-485ab373860a for instance with vm_state deleted and task_state None.
Jul 24 16:30:46 user nova-compute[70243]: DEBUG nova.compute.manager [req-827b9467-5349-4193-9b8d-46a9dadfc73e req-e4c22096-895a-4248-adbc-95ddcf9f654e service nova] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Received event network-vif-deleted-bc944a2d-ab8f-475a-b276-485ab373860a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:30:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26a80619-7e5c-4d97-8cde-7e94440dc106 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.489s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:30:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:30:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:30:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOieMPpG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:30:47 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:30:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:30:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:30:47 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:30:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:30:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:30:47 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:30:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:47 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4d636e-bc3c-4c3c-a7a9-620447669251]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:30:47 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:30:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:47 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a94bb2d-c06c-42a2-ba82-ad714b49f9db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1] added
Jul 24 16:30:47 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:30:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:47 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fae034-b403-46cd-a2f6-886b3a7a2bc5]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:30:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:47 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02528c8-4cbf-4603-93f8-e2f4f1ab0c6e]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:30:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cOieMPpG {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cOieMPpG" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[204dd3ea-afe5-4ee4-a0f3-ca5df5e1e77a]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cOieMPpG'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca96ad7b-d59d-4f41-a08e-57404b59c7e8]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf095a0-af18-4e42-a452-deac29ab2544]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:30:48 user nova-compute[70243]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)
Jul 24 16:30:48 user nova-compute[70243]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 (non-flash)
Jul 24 16:30:48 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:30:48 user nova-compute[70243]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)
Jul 24 16:30:48 user nova-compute[70243]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 (non-flash)
Jul 24 16:30:48 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a29c07-9619-46d1-9257-c423f1b53e25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1, portal: 172.16.0.220,3260]
Jul 24 16:30:48 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1, portal: 172.16.0.220,3260] successful.
Jul 24 16:30:48 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1694148-61d8-4764-9561-fe46cfc3b13a]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[37af3b9d-0664-4dfa-9a0e-98a37db0330a]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:30:48 user nova-compute[70243]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)
Jul 24 16:30:48 user nova-compute[70243]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 (non-flash)
Jul 24 16:30:48 user nova-compute[70243]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 (non-flash)
Jul 24 16:30:48 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:30:48 user nova-compute[70243]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)
Jul 24 16:30:48 user nova-compute[70243]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 (non-flash)
Jul 24 16:30:48 user nova-compute[70243]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 (non-flash)
Jul 24 16:30:48 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a56a864-5d32-446c-87d5-89993f9d4389]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:48 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: None {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:30:49 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:30:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOieMPpG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:30:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:30:49 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23361663430303663', 'path': '/dev/sde'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:30:49 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361663430303663', 'path': '/dev/sde'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:30:49 user nova-compute[70243]: DEBUG nova.objects.instance [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'flavor' on Instance uuid 5d5f72a1-afd5-43f1-b803-c8924352acc2 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:30:49 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:30:49 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:30:49 user nova-compute[70243]:   <source dev="/dev/sde"/>
Jul 24 16:30:49 user nova-compute[70243]:   <target dev="vdc" bus="virtio"/>
Jul 24 16:30:49 user nova-compute[70243]:   <serial>aa63f630-73d0-44e5-8f7b-6296789849e1</serial>
Jul 24 16:30:49 user nova-compute[70243]: </disk>
Jul 24 16:30:49 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:30:49 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:30:49 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:30:49 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:30:49 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] No VIF found with MAC fa:16:3e:a7:f1:90, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:30:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d1e29f27-b7ed-40c9-b4a1-efae06f8b916 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.681s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:50 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:30:50 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:30:51 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:30:51 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:30:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:51 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:30:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:30:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:51 user nova-compute[70243]: INFO nova.compute.manager [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Detaching volume 87a58847-d166-4482-9699-9233689364a0
Jul 24 16:30:51 user nova-compute[70243]: INFO nova.virt.block_device [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Attempting to driver detach volume 87a58847-d166-4482-9699-9233689364a0 from mountpoint /dev/vdb
Jul 24 16:30:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Attempting to detach device vdb from instance 5d5f72a1-afd5-43f1-b803-c8924352acc2 from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:30:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:30:51 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:30:51 user nova-compute[70243]:   <source dev="/dev/sdc"/>
Jul 24 16:30:51 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:30:51 user nova-compute[70243]:   <serial>87a58847-d166-4482-9699-9233689364a0</serial>
Jul 24 16:30:51 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:30:51 user nova-compute[70243]: </disk>
Jul 24 16:30:51 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:30:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:51 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Successfully detached device vdb from instance 5d5f72a1-afd5-43f1-b803-c8924352acc2 from the persistent domain config.
Jul 24 16:30:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5d5f72a1-afd5-43f1-b803-c8924352acc2 from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:30:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:30:51 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:30:51 user nova-compute[70243]:   <source dev="/dev/sdc"/>
Jul 24 16:30:51 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:30:51 user nova-compute[70243]:   <serial>87a58847-d166-4482-9699-9233689364a0</serial>
Jul 24 16:30:51 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:30:51 user nova-compute[70243]: </disk>
Jul 24 16:30:51 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690216252.4163475, 5d5f72a1-afd5-43f1-b803-c8924352acc2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5d5f72a1-afd5-43f1-b803-c8924352acc2 {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:30:52 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Successfully detached device vdb from instance 5d5f72a1-afd5-43f1-b803-c8924352acc2 from the live domain config.
Jul 24 16:30:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QSXwfcAl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:30:52 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:30:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4de19bb-9ddb-4840-98fd-3f95b4c3e356]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:30:52 user nova-compute[70243]: No targets found.
Jul 24 16:30:52 user nova-compute[70243]: iSNS:
Jul 24 16:30:52 user nova-compute[70243]: No targets found.
Jul 24 16:30:52 user nova-compute[70243]: STATIC:
Jul 24 16:30:52 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8
Jul 24 16:30:52 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:30:52 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:30:52 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0
Jul 24 16:30:52 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:30:52 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:30:52 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0
Jul 24 16:30:52 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:30:52 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:30:52 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1
Jul 24 16:30:52 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:30:52 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:30:52 user nova-compute[70243]: FIRMWARE:
Jul 24 16:30:52 user nova-compute[70243]: No targets found.
Jul 24 16:30:52 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:30:52 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:30:52 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[75eaf927-0907-47f0-98a9-3673260b98b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0cb48b-a7d2-448c-a128-c9b306c16381]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:30:52 user nova-compute[70243]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)
Jul 24 16:30:52 user nova-compute[70243]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 (non-flash)
Jul 24 16:30:52 user nova-compute[70243]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 (non-flash)
Jul 24 16:30:52 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:30:52 user nova-compute[70243]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)
Jul 24 16:30:52 user nova-compute[70243]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 (non-flash)
Jul 24 16:30:52 user nova-compute[70243]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 (non-flash)
Jul 24 16:30:52 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc4c7640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0'): ({'sdc'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Removing single pathed devices sdc {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[170689c4-612e-4d8a-98f3-038bc8755a5f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d716038-3773-4db4-a86b-761389fb72a2]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Flushing IO for device /dev/sdc {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c82ca1-0ff8-48bf-b3ff-7fac3811c577]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6ed50a-cbc8-4025-aa08-846464d4c018]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] SCSI volumes sdc have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1fc01b-3d8e-440a-9144-b5a776cf3268]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4563c9e7-c979-4394-a2f8-f14a00f6f1c9]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0, portal: 172.16.0.220,3260]
Jul 24 16:30:52 user nova-compute[70243]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0, portal: 172.16.0.220,3260] successful.
Jul 24 16:30:52 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87a58847-d166-4482-9699-9233689364a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fcdac9-04c0-4c09-b8d8-e4123545afb9]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] <== disconnect_volume: return (370ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:30:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:53 user nova-compute[70243]: DEBUG nova.objects.instance [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'flavor' on Instance uuid 5d5f72a1-afd5-43f1-b803-c8924352acc2 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:30:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0d203af5-8ac4-48f3-85bd-1442481dba90 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.850s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:30:54 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:30:54 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:30:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=7722MB free_disk=24.345294952392578GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:30:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:54 user nova-compute[70243]: INFO nova.compute.manager [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Detaching volume aa63f630-73d0-44e5-8f7b-6296789849e1
Jul 24 16:30:54 user nova-compute[70243]: INFO nova.virt.block_device [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Attempting to driver detach volume aa63f630-73d0-44e5-8f7b-6296789849e1 from mountpoint /dev/vdc
Jul 24 16:30:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Attempting to detach device vdc from instance 5d5f72a1-afd5-43f1-b803-c8924352acc2 from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:30:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:30:54 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:30:54 user nova-compute[70243]:   <source dev="/dev/sde"/>
Jul 24 16:30:54 user nova-compute[70243]:   <target dev="vdc" bus="virtio"/>
Jul 24 16:30:54 user nova-compute[70243]:   <serial>aa63f630-73d0-44e5-8f7b-6296789849e1</serial>
Jul 24 16:30:54 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 24 16:30:54 user nova-compute[70243]: </disk>
Jul 24 16:30:54 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:30:54 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Successfully detached device vdc from instance 5d5f72a1-afd5-43f1-b803-c8924352acc2 from the persistent domain config.
Jul 24 16:30:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5d5f72a1-afd5-43f1-b803-c8924352acc2 from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:30:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:30:54 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:30:54 user nova-compute[70243]:   <source dev="/dev/sde"/>
Jul 24 16:30:54 user nova-compute[70243]:   <target dev="vdc" bus="virtio"/>
Jul 24 16:30:54 user nova-compute[70243]:   <serial>aa63f630-73d0-44e5-8f7b-6296789849e1</serial>
Jul 24 16:30:54 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 24 16:30:54 user nova-compute[70243]: </disk>
Jul 24 16:30:54 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:30:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance de22ea98-b041-4f3f-8986-435c43267a2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:30:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 50fecb3a-8f06-4822-8c84-76df51acfe50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:30:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6f2258de-6b31-48af-81df-37b64da4ca99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:30:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 4c394c36-5163-4739-964a-7350ee4814ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:30:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5d5f72a1-afd5-43f1-b803-c8924352acc2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:30:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6ed1935d-3a60-418e-bc44-ed65452afc1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:30:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8eb4450c-bf08-4949-a126-d30dbb3ea744 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:30:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:30:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:30:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:54 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:30:54 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:30:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:30:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690216255.0965967, 5d5f72a1-afd5-43f1-b803-c8924352acc2 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5d5f72a1-afd5-43f1-b803-c8924352acc2 {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:30:55 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Successfully detached device vdc from instance 5d5f72a1-afd5-43f1-b803-c8924352acc2 from the live domain config.
Jul 24 16:30:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOieMPpG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:30:55 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:30:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d3720e-fd46-4f2f-92ba-d2713f40220d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:30:55 user nova-compute[70243]: No targets found.
Jul 24 16:30:55 user nova-compute[70243]: iSNS:
Jul 24 16:30:55 user nova-compute[70243]: No targets found.
Jul 24 16:30:55 user nova-compute[70243]: STATIC:
Jul 24 16:30:55 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8
Jul 24 16:30:55 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:30:55 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:30:55 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0
Jul 24 16:30:55 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:30:55 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:30:55 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1
Jul 24 16:30:55 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:30:55 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:30:55 user nova-compute[70243]: FIRMWARE:
Jul 24 16:30:55 user nova-compute[70243]: No targets found.
Jul 24 16:30:55 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:30:55 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:30:55 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1355567c-e2b4-4638-97c6-3a7009613fb5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2f6b15-0301-41c8-9eed-265d78a157f5]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:30:55 user nova-compute[70243]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)
Jul 24 16:30:55 user nova-compute[70243]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 (non-flash)
Jul 24 16:30:55 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:30:55 user nova-compute[70243]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)
Jul 24 16:30:55 user nova-compute[70243]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 (non-flash)
Jul 24 16:30:55 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc4c6170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1'): ({'sde'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Removing single pathed devices sde {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[455c469a-778a-470a-99e8-ec11f6fe13bf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a769f251-db3c-4167-8294-7775c897980a]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Flushing IO for device /dev/sde {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b1b769-9ee3-4d3b-984e-ebcf68b6ff3e]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6456a854-d201-4fbf-9aa1-e1734b7959eb]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] SCSI volumes sde have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1061b19-00ca-439f-9df4-969eb8f62d2b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb6de69-9c76-438c-9d37-54c5b81c4f03]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1, portal: 172.16.0.220,3260]
Jul 24 16:30:55 user nova-compute[70243]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1, portal: 172.16.0.220,3260] successful.
Jul 24 16:30:55 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa63f630-73d0-44e5-8f7b-6296789849e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9ee9bf-6c7a-4fa9-a5ec-00b566bacb8b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] <== disconnect_volume: return (328ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:30:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:30:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-50fecb3a-8f06-4822-8c84-76df51acfe50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:30:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-50fecb3a-8f06-4822-8c84-76df51acfe50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:30:56 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:30:56 user nova-compute[70243]: DEBUG nova.objects.instance [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'flavor' on Instance uuid 5d5f72a1-afd5-43f1-b803-c8924352acc2 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:30:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ecb77ff-860f-4777-9557-3a691f3c39a3 tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.734s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:56 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Updating instance_info_cache with network_info: [{"id": "657cc261-2d12-42c2-a879-f8cc121bd811", "address": "fa:16:3e:93:0d:e3", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657cc261-2d", "ovs_interfaceid": "657cc261-2d12-42c2-a879-f8cc121bd811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:30:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-50fecb3a-8f06-4822-8c84-76df51acfe50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:30:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:30:56 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:30:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "5d5f72a1-afd5-43f1-b803-c8924352acc2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:56 user nova-compute[70243]: INFO nova.compute.manager [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Terminating instance
Jul 24 16:30:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:30:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:57 user nova-compute[70243]: DEBUG nova.compute.manager [req-10a59ada-6960-43ad-9ea9-5441aabe1a2d req-5238669d-6517-45e1-8cbc-cfe48ed64a5d service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Received event network-vif-unplugged-238f8b90-f497-46f5-9edd-0de67b62d546 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:30:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-10a59ada-6960-43ad-9ea9-5441aabe1a2d req-5238669d-6517-45e1-8cbc-cfe48ed64a5d service nova] Acquiring lock "5d5f72a1-afd5-43f1-b803-c8924352acc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-10a59ada-6960-43ad-9ea9-5441aabe1a2d req-5238669d-6517-45e1-8cbc-cfe48ed64a5d service nova] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-10a59ada-6960-43ad-9ea9-5441aabe1a2d req-5238669d-6517-45e1-8cbc-cfe48ed64a5d service nova] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:57 user nova-compute[70243]: DEBUG nova.compute.manager [req-10a59ada-6960-43ad-9ea9-5441aabe1a2d req-5238669d-6517-45e1-8cbc-cfe48ed64a5d service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] No waiting events found dispatching network-vif-unplugged-238f8b90-f497-46f5-9edd-0de67b62d546 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:30:57 user nova-compute[70243]: DEBUG nova.compute.manager [req-10a59ada-6960-43ad-9ea9-5441aabe1a2d req-5238669d-6517-45e1-8cbc-cfe48ed64a5d service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Received event network-vif-unplugged-238f8b90-f497-46f5-9edd-0de67b62d546 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:30:57 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Instance destroyed successfully.
Jul 24 16:30:57 user nova-compute[70243]: DEBUG nova.objects.instance [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lazy-loading 'resources' on Instance uuid 5d5f72a1-afd5-43f1-b803-c8924352acc2 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:30:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:28:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1586144779',display_name='tempest-AttachVolumeTestJSON-server-1586144779',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1586144779',id=24,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKg0ZONl+5spwbU3OpYganUPRYkH+/KA/VPO8l5I1QChjbB3asB66UGA2xZaNRzLwUJuX9BzASENmcjoUZKdOFhtWP1GnroSqNqauJUbqcsmSRiJGYhkjv0npUpk3j9SPg==',key_name='tempest-keypair-218761919',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:28:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d099632b940545b9bbe000e5cc323ec1',ramdisk_id='',reservation_id='r-t8x5s887',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1836925262',owner_user_name='tempest-AttachVolumeTestJSON-1836925262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:28:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7de0cd9dd23d4569939884728bde772c',uuid=5d5f72a1-afd5-43f1-b803-c8924352acc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "238f8b90-f497-46f5-9edd-0de67b62d546", "address": "fa:16:3e:a7:f1:90", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f8b90-f4", "ovs_interfaceid": "238f8b90-f497-46f5-9edd-0de67b62d546", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:30:57 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converting VIF {"id": "238f8b90-f497-46f5-9edd-0de67b62d546", "address": "fa:16:3e:a7:f1:90", "network": {"id": "2a0d59d2-df47-4cca-9d62-4cb9fca85262", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1884500661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d099632b940545b9bbe000e5cc323ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f8b90-f4", "ovs_interfaceid": "238f8b90-f497-46f5-9edd-0de67b62d546", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:30:57 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:f1:90,bridge_name='br-int',has_traffic_filtering=True,id=238f8b90-f497-46f5-9edd-0de67b62d546,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238f8b90-f4') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:30:57 user nova-compute[70243]: DEBUG os_vif [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:f1:90,bridge_name='br-int',has_traffic_filtering=True,id=238f8b90-f497-46f5-9edd-0de67b62d546,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238f8b90-f4') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:30:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap238f8b90-f4, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:30:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:30:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:57 user nova-compute[70243]: INFO os_vif [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:f1:90,bridge_name='br-int',has_traffic_filtering=True,id=238f8b90-f497-46f5-9edd-0de67b62d546,network=Network(2a0d59d2-df47-4cca-9d62-4cb9fca85262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238f8b90-f4')
Jul 24 16:30:57 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Deleting instance files /opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2_del
Jul 24 16:30:57 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Deletion of /opt/stack/data/nova/instances/5d5f72a1-afd5-43f1-b803-c8924352acc2_del complete
Jul 24 16:30:57 user nova-compute[70243]: INFO nova.compute.manager [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 24 16:30:57 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:30:57 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:30:57 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:30:58 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:30:58 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Took 0.97 seconds to deallocate network for instance.
Jul 24 16:30:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-1c4297bf-910c-49e9-bc11-e0cb57e90c7f req-3aadf0da-7137-4a2e-b727-5080c7792a7e service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Received event network-vif-deleted-238f8b90-f497-46f5-9edd-0de67b62d546 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:30:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:59 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:30:59 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:30:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:59 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Deleted allocations for instance 5d5f72a1-afd5-43f1-b803-c8924352acc2
Jul 24 16:30:59 user nova-compute[70243]: DEBUG nova.compute.manager [req-390c7ba8-d0b9-4458-b7b8-28e00dd8994e req-f7920c53-d255-417b-abc4-c4c1fca52dd2 service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Received event network-vif-plugged-238f8b90-f497-46f5-9edd-0de67b62d546 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:30:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-390c7ba8-d0b9-4458-b7b8-28e00dd8994e req-f7920c53-d255-417b-abc4-c4c1fca52dd2 service nova] Acquiring lock "5d5f72a1-afd5-43f1-b803-c8924352acc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:30:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-390c7ba8-d0b9-4458-b7b8-28e00dd8994e req-f7920c53-d255-417b-abc4-c4c1fca52dd2 service nova] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:30:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-390c7ba8-d0b9-4458-b7b8-28e00dd8994e req-f7920c53-d255-417b-abc4-c4c1fca52dd2 service nova] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:59 user nova-compute[70243]: DEBUG nova.compute.manager [req-390c7ba8-d0b9-4458-b7b8-28e00dd8994e req-f7920c53-d255-417b-abc4-c4c1fca52dd2 service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] No waiting events found dispatching network-vif-plugged-238f8b90-f497-46f5-9edd-0de67b62d546 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:30:59 user nova-compute[70243]: WARNING nova.compute.manager [req-390c7ba8-d0b9-4458-b7b8-28e00dd8994e req-f7920c53-d255-417b-abc4-c4c1fca52dd2 service nova] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Received unexpected event network-vif-plugged-238f8b90-f497-46f5-9edd-0de67b62d546 for instance with vm_state deleted and task_state None.
Jul 24 16:30:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-462cb31b-862f-464a-ba0a-d41088a9659c tempest-AttachVolumeTestJSON-1836925262 tempest-AttachVolumeTestJSON-1836925262-project-member] Lock "5d5f72a1-afd5-43f1-b803-c8924352acc2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.355s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:30:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:30:59 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216244.8370981, 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:30:59 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] VM Stopped (Lifecycle Event)
Jul 24 16:30:59 user nova-compute[70243]: DEBUG nova.compute.manager [None req-1518a128-6f38-423c-9a0f-4873440840a0 None None] [instance: 9d3ea2a6-6585-4a99-8bfc-951bd5c1fd04] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:31:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:12 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216257.7953103, 5d5f72a1-afd5-43f1-b803-c8924352acc2 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:31:12 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] VM Stopped (Lifecycle Event)
Jul 24 16:31:12 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e6ef5b73-ed30-4ca4-946a-1908e396c5fd None None] [instance: 5d5f72a1-afd5-43f1-b803-c8924352acc2] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:31:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Acquiring lock "1bf21ddb-9e24-49e7-946a-e3bb75bb3a98" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:31:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "1bf21ddb-9e24-49e7-946a-e3bb75bb3a98" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:31:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:31:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:31:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:31:16 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:31:16 user nova-compute[70243]: INFO nova.compute.claims [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Claim successful on node user
Jul 24 16:31:16 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:31:16 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:31:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:31:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:31:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:31:16 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:31:16 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:31:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:31:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:31:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:31:16 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Creating image(s)
Jul 24 16:31:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Acquiring lock "/opt/stack/data/nova/instances/1bf21ddb-9e24-49e7-946a-e3bb75bb3a98/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:31:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "/opt/stack/data/nova/instances/1bf21ddb-9e24-49e7-946a-e3bb75bb3a98/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:31:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "/opt/stack/data/nova/instances/1bf21ddb-9e24-49e7-946a-e3bb75bb3a98/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:31:16 user nova-compute[70243]: DEBUG nova.policy [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ec427ff69094ac7a8647c0811c2af7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb3c0ed911674b69a05524f555ea6e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:31:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:16 user nova-compute[70243]: DEBUG nova.compute.manager [req-f0faf8b7-e8e3-48ba-8dec-041e58986f19 req-8938cdd9-beb7-46ff-8b5f-709a61cc4b7e service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Received event network-changed-7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:31:16 user nova-compute[70243]: DEBUG nova.compute.manager [req-f0faf8b7-e8e3-48ba-8dec-041e58986f19 req-8938cdd9-beb7-46ff-8b5f-709a61cc4b7e service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Refreshing instance network info cache due to event network-changed-7d075a00-69b3-4a37-8752-46f3c3a35cb5. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:31:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f0faf8b7-e8e3-48ba-8dec-041e58986f19 req-8938cdd9-beb7-46ff-8b5f-709a61cc4b7e service nova] Acquiring lock "refresh_cache-4c394c36-5163-4739-964a-7350ee4814ae" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:31:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f0faf8b7-e8e3-48ba-8dec-041e58986f19 req-8938cdd9-beb7-46ff-8b5f-709a61cc4b7e service nova] Acquired lock "refresh_cache-4c394c36-5163-4739-964a-7350ee4814ae" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:31:16 user nova-compute[70243]: DEBUG nova.network.neutron [req-f0faf8b7-e8e3-48ba-8dec-041e58986f19 req-8938cdd9-beb7-46ff-8b5f-709a61cc4b7e service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Refreshing network info cache for port 7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.142s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/1bf21ddb-9e24-49e7-946a-e3bb75bb3a98/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/1bf21ddb-9e24-49e7-946a-e3bb75bb3a98/disk 1073741824" returned: 0 in 0.050s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.153s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1bf21ddb-9e24-49e7-946a-e3bb75bb3a98/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bf21ddb-9e24-49e7-946a-e3bb75bb3a98/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bf21ddb-9e24-49e7-946a-e3bb75bb3a98/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Cannot resize image /opt/stack/data/nova/instances/1bf21ddb-9e24-49e7-946a-e3bb75bb3a98/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG nova.objects.instance [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lazy-loading 'migration_context' on Instance uuid 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Ensure instance console log exists: /opt/stack/data/nova/instances/1bf21ddb-9e24-49e7-946a-e3bb75bb3a98/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Successfully created port: bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG nova.network.neutron [req-f0faf8b7-e8e3-48ba-8dec-041e58986f19 req-8938cdd9-beb7-46ff-8b5f-709a61cc4b7e service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Updated VIF entry in instance network info cache for port 7d075a00-69b3-4a37-8752-46f3c3a35cb5. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG nova.network.neutron [req-f0faf8b7-e8e3-48ba-8dec-041e58986f19 req-8938cdd9-beb7-46ff-8b5f-709a61cc4b7e service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Updating instance_info_cache with network_info: [{"id": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "address": "fa:16:3e:56:fb:e8", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d075a00-69", "ovs_interfaceid": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG nova.compute.manager [req-d8502f61-efaf-4159-9915-6c957e531514 req-93aabdc9-f856-40a3-b2b6-cf6c50786144 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Received event network-changed-7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG nova.compute.manager [req-d8502f61-efaf-4159-9915-6c957e531514 req-93aabdc9-f856-40a3-b2b6-cf6c50786144 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Refreshing instance network info cache due to event network-changed-7d075a00-69b3-4a37-8752-46f3c3a35cb5. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d8502f61-efaf-4159-9915-6c957e531514 req-93aabdc9-f856-40a3-b2b6-cf6c50786144 service nova] Acquiring lock "refresh_cache-4c394c36-5163-4739-964a-7350ee4814ae" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f0faf8b7-e8e3-48ba-8dec-041e58986f19 req-8938cdd9-beb7-46ff-8b5f-709a61cc4b7e service nova] Releasing lock "refresh_cache-4c394c36-5163-4739-964a-7350ee4814ae" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d8502f61-efaf-4159-9915-6c957e531514 req-93aabdc9-f856-40a3-b2b6-cf6c50786144 service nova] Acquired lock "refresh_cache-4c394c36-5163-4739-964a-7350ee4814ae" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:31:17 user nova-compute[70243]: DEBUG nova.network.neutron [req-d8502f61-efaf-4159-9915-6c957e531514 req-93aabdc9-f856-40a3-b2b6-cf6c50786144 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Refreshing network info cache for port 7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "4c394c36-5163-4739-964a-7350ee4814ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "4c394c36-5163-4739-964a-7350ee4814ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:31:18 user nova-compute[70243]: INFO nova.compute.manager [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Detaching volume 4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0
Jul 24 16:31:18 user nova-compute[70243]: INFO nova.virt.block_device [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Attempting to driver detach volume 4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 from mountpoint /dev/vdb
Jul 24 16:31:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Attempting to detach device vdb from instance 4c394c36-5163-4739-964a-7350ee4814ae from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:31:18 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:31:18 user nova-compute[70243]:   <source dev="/dev/sdd"/>
Jul 24 16:31:18 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:31:18 user nova-compute[70243]:   <serial>4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0</serial>
Jul 24 16:31:18 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:31:18 user nova-compute[70243]: </disk>
Jul 24 16:31:18 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:31:18 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Successfully detached device vdb from instance 4c394c36-5163-4739-964a-7350ee4814ae from the persistent domain config.
Jul 24 16:31:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4c394c36-5163-4739-964a-7350ee4814ae from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:31:18 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:31:18 user nova-compute[70243]:   <source dev="/dev/sdd"/>
Jul 24 16:31:18 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:31:18 user nova-compute[70243]:   <serial>4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0</serial>
Jul 24 16:31:18 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:31:18 user nova-compute[70243]: </disk>
Jul 24 16:31:18 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690216278.5470512, 4c394c36-5163-4739-964a-7350ee4814ae => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4c394c36-5163-4739-964a-7350ee4814ae {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:31:18 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Successfully detached device vdb from instance 4c394c36-5163-4739-964a-7350ee4814ae from the live domain config.
Jul 24 16:31:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjToEWcg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:31:18 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:31:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c4bd86-6ab5-447f-8ce3-07acf9754f8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:31:18 user nova-compute[70243]: No targets found.
Jul 24 16:31:18 user nova-compute[70243]: iSNS:
Jul 24 16:31:18 user nova-compute[70243]: No targets found.
Jul 24 16:31:18 user nova-compute[70243]: STATIC:
Jul 24 16:31:18 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8
Jul 24 16:31:18 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:31:18 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:31:18 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0
Jul 24 16:31:18 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:31:18 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:31:18 user nova-compute[70243]: FIRMWARE:
Jul 24 16:31:18 user nova-compute[70243]: No targets found.
Jul 24 16:31:18 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:31:18 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:31:18 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9a8c71-f574-4eb9-b232-89b8397c54ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG nova.network.neutron [req-d8502f61-efaf-4159-9915-6c957e531514 req-93aabdc9-f856-40a3-b2b6-cf6c50786144 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Updated VIF entry in instance network info cache for port 7d075a00-69b3-4a37-8752-46f3c3a35cb5. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG nova.network.neutron [req-d8502f61-efaf-4159-9915-6c957e531514 req-93aabdc9-f856-40a3-b2b6-cf6c50786144 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Updating instance_info_cache with network_info: [{"id": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "address": "fa:16:3e:56:fb:e8", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d075a00-69", "ovs_interfaceid": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee83cdf7-f82e-4fcc-8621-297f5fee38e5]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:31:18 user nova-compute[70243]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)
Jul 24 16:31:18 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:31:18 user nova-compute[70243]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 (non-flash)
Jul 24 16:31:18 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91f00735b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0'): ({'sdd'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Removing single pathed devices sdd {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d8502f61-efaf-4159-9915-6c957e531514 req-93aabdc9-f856-40a3-b2b6-cf6c50786144 service nova] Releasing lock "refresh_cache-4c394c36-5163-4739-964a-7350ee4814ae" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c82510-c298-4017-9a1c-5466c1a5bc19]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd3236e-532d-43cf-a144-643d37caad8e]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Flushing IO for device /dev/sdd {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d744bdea-75c8-4d90-9bc0-28676d12d4c2]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[60225265-ca98-40cc-bce3-340993bed3cf]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] SCSI volumes sdd have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f54d91-ba5b-436b-a76a-b52140799093]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d69b26b-6645-4a77-a68e-019c4288c5b3]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0, portal: 172.16.0.220,3260]
Jul 24 16:31:18 user nova-compute[70243]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0, portal: 172.16.0.220,3260] successful.
Jul 24 16:31:18 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ceabea8-0ac3-437f-9d9b-1eac79aa7ca0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f197136-fa99-468d-8e59-4a99d522678a]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] <== disconnect_volume: return (327ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Successfully updated port: bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Acquiring lock "refresh_cache-1bf21ddb-9e24-49e7-946a-e3bb75bb3a98" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Acquired lock "refresh_cache-1bf21ddb-9e24-49e7-946a-e3bb75bb3a98" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:31:18 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-df91075e-f6d9-467c-a134-da42349ac7fd req-613ed728-0a64-4280-a526-f2327171877e service nova] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Received event network-changed-bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-df91075e-f6d9-467c-a134-da42349ac7fd req-613ed728-0a64-4280-a526-f2327171877e service nova] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Refreshing instance network info cache due to event network-changed-bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-df91075e-f6d9-467c-a134-da42349ac7fd req-613ed728-0a64-4280-a526-f2327171877e service nova] Acquiring lock "refresh_cache-1bf21ddb-9e24-49e7-946a-e3bb75bb3a98" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.network.neutron [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Updating instance_info_cache with network_info: [{"id": "bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb", "address": "fa:16:3e:b9:19:7e", "network": {"id": "26f40e99-b090-4a8e-8d72-6b8674b2f716", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919802542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3c0ed911674b69a05524f555ea6e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2fdad9-a6", "ovs_interfaceid": "bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Releasing lock "refresh_cache-1bf21ddb-9e24-49e7-946a-e3bb75bb3a98" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Instance network_info: |[{"id": "bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb", "address": "fa:16:3e:b9:19:7e", "network": {"id": "26f40e99-b090-4a8e-8d72-6b8674b2f716", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919802542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3c0ed911674b69a05524f555ea6e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2fdad9-a6", "ovs_interfaceid": "bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-df91075e-f6d9-467c-a134-da42349ac7fd req-613ed728-0a64-4280-a526-f2327171877e service nova] Acquired lock "refresh_cache-1bf21ddb-9e24-49e7-946a-e3bb75bb3a98" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.network.neutron [req-df91075e-f6d9-467c-a134-da42349ac7fd req-613ed728-0a64-4280-a526-f2327171877e service nova] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Refreshing network info cache for port bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Start _get_guest_xml network_info=[{"id": "bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb", "address": "fa:16:3e:b9:19:7e", "network": {"id": "26f40e99-b090-4a8e-8d72-6b8674b2f716", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919802542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3c0ed911674b69a05524f555ea6e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2fdad9-a6", "ovs_interfaceid": "bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:31:19 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:31:19 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:31:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1558408339',display_name='tempest-VolumesActionsTest-instance-1558408339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1558408339',id=27,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb3c0ed911674b69a05524f555ea6e0e',ramdisk_id='',reservation_id='r-pi027e7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-137271236',owner_user_name='tempest-VolumesActionsTest-137271236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:31:17Z,user_data=None,user_id='8ec427ff69094ac7a8647c0811c2af7c',uuid=1bf21ddb-9e24-49e7-946a-e3bb75bb3a98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb", "address": "fa:16:3e:b9:19:7e", "network": {"id": "26f40e99-b090-4a8e-8d72-6b8674b2f716", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919802542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3c0ed911674b69a05524f555ea6e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2fdad9-a6", "ovs_interfaceid": "bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Converting VIF {"id": "bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb", "address": "fa:16:3e:b9:19:7e", "network": {"id": "26f40e99-b090-4a8e-8d72-6b8674b2f716", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919802542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3c0ed911674b69a05524f555ea6e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2fdad9-a6", "ovs_interfaceid": "bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:19:7e,bridge_name='br-int',has_traffic_filtering=True,id=bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb,network=Network(26f40e99-b090-4a8e-8d72-6b8674b2f716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd2fdad9-a6') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.objects.instance [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lazy-loading 'pci_devices' on Instance uuid 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:31:19 user nova-compute[70243]:   <uuid>1bf21ddb-9e24-49e7-946a-e3bb75bb3a98</uuid>
Jul 24 16:31:19 user nova-compute[70243]:   <name>instance-0000001b</name>
Jul 24 16:31:19 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:31:19 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:31:19 user nova-compute[70243]:   <metadata>
Jul 24 16:31:19 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:31:19 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:31:19 user nova-compute[70243]:       <nova:name>tempest-VolumesActionsTest-instance-1558408339</nova:name>
Jul 24 16:31:19 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:31:19</nova:creationTime>
Jul 24 16:31:19 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:31:19 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:31:19 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:31:19 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:31:19 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:31:19 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:31:19 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:31:19 user nova-compute[70243]:       <nova:owner>
Jul 24 16:31:19 user nova-compute[70243]:         <nova:user uuid="8ec427ff69094ac7a8647c0811c2af7c">tempest-VolumesActionsTest-137271236-project-member</nova:user>
Jul 24 16:31:19 user nova-compute[70243]:         <nova:project uuid="fb3c0ed911674b69a05524f555ea6e0e">tempest-VolumesActionsTest-137271236</nova:project>
Jul 24 16:31:19 user nova-compute[70243]:       </nova:owner>
Jul 24 16:31:19 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:31:19 user nova-compute[70243]:       <nova:ports>
Jul 24 16:31:19 user nova-compute[70243]:         <nova:port uuid="bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb">
Jul 24 16:31:19 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 24 16:31:19 user nova-compute[70243]:         </nova:port>
Jul 24 16:31:19 user nova-compute[70243]:       </nova:ports>
Jul 24 16:31:19 user nova-compute[70243]:     </nova:instance>
Jul 24 16:31:19 user nova-compute[70243]:   </metadata>
Jul 24 16:31:19 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:31:19 user nova-compute[70243]:     <system>
Jul 24 16:31:19 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:31:19 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:31:19 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:31:19 user nova-compute[70243]:       <entry name="serial">1bf21ddb-9e24-49e7-946a-e3bb75bb3a98</entry>
Jul 24 16:31:19 user nova-compute[70243]:       <entry name="uuid">1bf21ddb-9e24-49e7-946a-e3bb75bb3a98</entry>
Jul 24 16:31:19 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:31:19 user nova-compute[70243]:     </system>
Jul 24 16:31:19 user nova-compute[70243]:   </sysinfo>
Jul 24 16:31:19 user nova-compute[70243]:   <os>
Jul 24 16:31:19 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:31:19 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:31:19 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:31:19 user nova-compute[70243]:   </os>
Jul 24 16:31:19 user nova-compute[70243]:   <features>
Jul 24 16:31:19 user nova-compute[70243]:     <acpi/>
Jul 24 16:31:19 user nova-compute[70243]:     <apic/>
Jul 24 16:31:19 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:31:19 user nova-compute[70243]:   </features>
Jul 24 16:31:19 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:31:19 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:31:19 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:31:19 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:31:19 user nova-compute[70243]:   </clock>
Jul 24 16:31:19 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:31:19 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:31:19 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:31:19 user nova-compute[70243]:   </cpu>
Jul 24 16:31:19 user nova-compute[70243]:   <devices>
Jul 24 16:31:19 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:31:19 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:31:19 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/1bf21ddb-9e24-49e7-946a-e3bb75bb3a98/disk"/>
Jul 24 16:31:19 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:31:19 user nova-compute[70243]:     </disk>
Jul 24 16:31:19 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:31:19 user nova-compute[70243]:       <mac address="fa:16:3e:b9:19:7e"/>
Jul 24 16:31:19 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:31:19 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:31:19 user nova-compute[70243]:       <target dev="tapbd2fdad9-a6"/>
Jul 24 16:31:19 user nova-compute[70243]:     </interface>
Jul 24 16:31:19 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:31:19 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/1bf21ddb-9e24-49e7-946a-e3bb75bb3a98/console.log" append="off"/>
Jul 24 16:31:19 user nova-compute[70243]:     </serial>
Jul 24 16:31:19 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:31:19 user nova-compute[70243]:     <video>
Jul 24 16:31:19 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:31:19 user nova-compute[70243]:     </video>
Jul 24 16:31:19 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:31:19 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:31:19 user nova-compute[70243]:     </rng>
Jul 24 16:31:19 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:31:19 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:31:19 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:31:19 user nova-compute[70243]:     </memballoon>
Jul 24 16:31:19 user nova-compute[70243]:   </devices>
Jul 24 16:31:19 user nova-compute[70243]: </domain>
Jul 24 16:31:19 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:31:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1558408339',display_name='tempest-VolumesActionsTest-instance-1558408339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1558408339',id=27,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb3c0ed911674b69a05524f555ea6e0e',ramdisk_id='',reservation_id='r-pi027e7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-137271236',owner_user_name='tempest-VolumesActionsTest-137271236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:31:17Z,user_data=None,user_id='8ec427ff69094ac7a8647c0811c2af7c',uuid=1bf21ddb-9e24-49e7-946a-e3bb75bb3a98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb", "address": "fa:16:3e:b9:19:7e", "network": {"id": "26f40e99-b090-4a8e-8d72-6b8674b2f716", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919802542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3c0ed911674b69a05524f555ea6e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2fdad9-a6", "ovs_interfaceid": "bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Converting VIF {"id": "bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb", "address": "fa:16:3e:b9:19:7e", "network": {"id": "26f40e99-b090-4a8e-8d72-6b8674b2f716", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919802542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3c0ed911674b69a05524f555ea6e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2fdad9-a6", "ovs_interfaceid": "bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:19:7e,bridge_name='br-int',has_traffic_filtering=True,id=bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb,network=Network(26f40e99-b090-4a8e-8d72-6b8674b2f716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd2fdad9-a6') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG os_vif [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:19:7e,bridge_name='br-int',has_traffic_filtering=True,id=bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb,network=Network(26f40e99-b090-4a8e-8d72-6b8674b2f716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd2fdad9-a6') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd2fdad9-a6, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbd2fdad9-a6, col_values=(('external_ids', {'iface-id': 'bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:19:7e', 'vm-uuid': '1bf21ddb-9e24-49e7-946a-e3bb75bb3a98'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:19 user nova-compute[70243]: INFO os_vif [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:19:7e,bridge_name='br-int',has_traffic_filtering=True,id=bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb,network=Network(26f40e99-b090-4a8e-8d72-6b8674b2f716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd2fdad9-a6')
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] No VIF found with MAC fa:16:3e:b9:19:7e, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.objects.instance [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lazy-loading 'flavor' on Instance uuid 4c394c36-5163-4739-964a-7350ee4814ae {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-afb04a70-cd00-4721-a200-6a249b0068e7 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "4c394c36-5163-4739-964a-7350ee4814ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.674s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.network.neutron [req-df91075e-f6d9-467c-a134-da42349ac7fd req-613ed728-0a64-4280-a526-f2327171877e service nova] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Updated VIF entry in instance network info cache for port bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG nova.network.neutron [req-df91075e-f6d9-467c-a134-da42349ac7fd req-613ed728-0a64-4280-a526-f2327171877e service nova] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Updating instance_info_cache with network_info: [{"id": "bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb", "address": "fa:16:3e:b9:19:7e", "network": {"id": "26f40e99-b090-4a8e-8d72-6b8674b2f716", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919802542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3c0ed911674b69a05524f555ea6e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2fdad9-a6", "ovs_interfaceid": "bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-df91075e-f6d9-467c-a134-da42349ac7fd req-613ed728-0a64-4280-a526-f2327171877e service nova] Releasing lock "refresh_cache-1bf21ddb-9e24-49e7-946a-e3bb75bb3a98" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:31:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-999e5e2b-bf3d-4554-b689-ff6ce8dca2a0 req-32a865a9-a91b-46a2-81e1-a5132d09f621 service nova] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Received event network-vif-plugged-bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:31:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-999e5e2b-bf3d-4554-b689-ff6ce8dca2a0 req-32a865a9-a91b-46a2-81e1-a5132d09f621 service nova] Acquiring lock "1bf21ddb-9e24-49e7-946a-e3bb75bb3a98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:31:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-999e5e2b-bf3d-4554-b689-ff6ce8dca2a0 req-32a865a9-a91b-46a2-81e1-a5132d09f621 service nova] Lock "1bf21ddb-9e24-49e7-946a-e3bb75bb3a98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:31:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-999e5e2b-bf3d-4554-b689-ff6ce8dca2a0 req-32a865a9-a91b-46a2-81e1-a5132d09f621 service nova] Lock "1bf21ddb-9e24-49e7-946a-e3bb75bb3a98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:31:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-999e5e2b-bf3d-4554-b689-ff6ce8dca2a0 req-32a865a9-a91b-46a2-81e1-a5132d09f621 service nova] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] No waiting events found dispatching network-vif-plugged-bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:31:20 user nova-compute[70243]: WARNING nova.compute.manager [req-999e5e2b-bf3d-4554-b689-ff6ce8dca2a0 req-32a865a9-a91b-46a2-81e1-a5132d09f621 service nova] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Received unexpected event network-vif-plugged-bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb for instance with vm_state building and task_state spawning.
Jul 24 16:31:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:22 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216282.961589, 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:31:22 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] VM Resumed (Lifecycle Event)
Jul 24 16:31:22 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:31:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:31:22 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Instance spawned successfully.
Jul 24 16:31:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:31:22 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:31:22 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:31:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:31:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:31:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:31:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:31:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:31:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:31:23 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:31:23 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216282.9646752, 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:31:23 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] VM Started (Lifecycle Event)
Jul 24 16:31:23 user nova-compute[70243]: DEBUG nova.compute.manager [req-f56c3d9c-2e4a-4f6d-ab81-40b0da39a27a req-9ba361ff-b62c-40dd-b9b4-d4c6faf5cbb4 service nova] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Received event network-vif-plugged-bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:31:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f56c3d9c-2e4a-4f6d-ab81-40b0da39a27a req-9ba361ff-b62c-40dd-b9b4-d4c6faf5cbb4 service nova] Acquiring lock "1bf21ddb-9e24-49e7-946a-e3bb75bb3a98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:31:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f56c3d9c-2e4a-4f6d-ab81-40b0da39a27a req-9ba361ff-b62c-40dd-b9b4-d4c6faf5cbb4 service nova] Lock "1bf21ddb-9e24-49e7-946a-e3bb75bb3a98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:31:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f56c3d9c-2e4a-4f6d-ab81-40b0da39a27a req-9ba361ff-b62c-40dd-b9b4-d4c6faf5cbb4 service nova] Lock "1bf21ddb-9e24-49e7-946a-e3bb75bb3a98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:31:23 user nova-compute[70243]: DEBUG nova.compute.manager [req-f56c3d9c-2e4a-4f6d-ab81-40b0da39a27a req-9ba361ff-b62c-40dd-b9b4-d4c6faf5cbb4 service nova] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] No waiting events found dispatching network-vif-plugged-bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:31:23 user nova-compute[70243]: WARNING nova.compute.manager [req-f56c3d9c-2e4a-4f6d-ab81-40b0da39a27a req-9ba361ff-b62c-40dd-b9b4-d4c6faf5cbb4 service nova] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Received unexpected event network-vif-plugged-bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb for instance with vm_state building and task_state spawning.
Jul 24 16:31:23 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:31:23 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:31:23 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:31:23 user nova-compute[70243]: INFO nova.compute.manager [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Took 6.20 seconds to spawn the instance on the hypervisor.
Jul 24 16:31:23 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:31:23 user nova-compute[70243]: INFO nova.compute.manager [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Took 6.86 seconds to build instance.
Jul 24 16:31:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b7beb89-e38e-48ae-90d3-793eaedd3a4d tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "1bf21ddb-9e24-49e7-946a-e3bb75bb3a98" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.955s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:31:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "8fe2f619-2090-4653-96ab-937e0438a319" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:31:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "8fe2f619-2090-4653-96ab-937e0438a319" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:31:37 user nova-compute[70243]: DEBUG nova.compute.manager [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:31:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:31:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:31:37 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:31:37 user nova-compute[70243]: INFO nova.compute.claims [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Claim successful on node user
Jul 24 16:31:38 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG nova.compute.manager [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG nova.compute.manager [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG nova.network.neutron [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:31:38 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:31:38 user nova-compute[70243]: DEBUG nova.compute.manager [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG nova.compute.manager [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:31:38 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Creating image(s)
Jul 24 16:31:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "/opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "/opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG nova.policy [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8df18929107a458194a9c528d9bdfeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e819e22e590947478d513e1b9ad39494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.167s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/disk 1073741824" returned: 0 in 0.048s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.132s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Cannot resize image /opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG nova.objects.instance [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lazy-loading 'migration_context' on Instance uuid 8fe2f619-2090-4653-96ab-937e0438a319 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Ensure instance console log exists: /opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:31:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:31:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:39 user nova-compute[70243]: DEBUG nova.network.neutron [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Successfully created port: 424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:31:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.network.neutron [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Successfully updated port: 424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "refresh_cache-8fe2f619-2090-4653-96ab-937e0438a319" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquired lock "refresh_cache-8fe2f619-2090-4653-96ab-937e0438a319" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.network.neutron [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.compute.manager [req-79d46ddd-2315-47f4-82b9-3cbf418b6cfd req-2f628ccb-8e88-4956-93bc-e54d3a84dab1 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Received event network-changed-424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.compute.manager [req-79d46ddd-2315-47f4-82b9-3cbf418b6cfd req-2f628ccb-8e88-4956-93bc-e54d3a84dab1 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Refreshing instance network info cache due to event network-changed-424118a7-f3d3-4351-ae2e-8ee2208b19c5. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-79d46ddd-2315-47f4-82b9-3cbf418b6cfd req-2f628ccb-8e88-4956-93bc-e54d3a84dab1 service nova] Acquiring lock "refresh_cache-8fe2f619-2090-4653-96ab-937e0438a319" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.network.neutron [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.network.neutron [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Updating instance_info_cache with network_info: [{"id": "424118a7-f3d3-4351-ae2e-8ee2208b19c5", "address": "fa:16:3e:e8:f5:92", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424118a7-f3", "ovs_interfaceid": "424118a7-f3d3-4351-ae2e-8ee2208b19c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Releasing lock "refresh_cache-8fe2f619-2090-4653-96ab-937e0438a319" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Instance network_info: |[{"id": "424118a7-f3d3-4351-ae2e-8ee2208b19c5", "address": "fa:16:3e:e8:f5:92", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424118a7-f3", "ovs_interfaceid": "424118a7-f3d3-4351-ae2e-8ee2208b19c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-79d46ddd-2315-47f4-82b9-3cbf418b6cfd req-2f628ccb-8e88-4956-93bc-e54d3a84dab1 service nova] Acquired lock "refresh_cache-8fe2f619-2090-4653-96ab-937e0438a319" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.network.neutron [req-79d46ddd-2315-47f4-82b9-3cbf418b6cfd req-2f628ccb-8e88-4956-93bc-e54d3a84dab1 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Refreshing network info cache for port 424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Start _get_guest_xml network_info=[{"id": "424118a7-f3d3-4351-ae2e-8ee2208b19c5", "address": "fa:16:3e:e8:f5:92", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424118a7-f3", "ovs_interfaceid": "424118a7-f3d3-4351-ae2e-8ee2208b19c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:31:40 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:31:40 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:31:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1683650322',display_name='tempest-AttachVolumeNegativeTest-server-1683650322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1683650322',id=28,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPpRVYexM2uymQwadWK9qU/wMGEjmtuDYPGgm1i2xUzjg4gw5iqUJQA5vMVKHFWQNr2SKj4N/1Il8VKuXsUbWR/hvhKmvrpzRurEj/I9J2qJERmvqTgLh76CP3SnkMeRw==',key_name='tempest-keypair-76493656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e819e22e590947478d513e1b9ad39494',ramdisk_id='',reservation_id='r-vlnyota7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1152214105',owner_user_name='tempest-AttachVolumeNegativeTest-1152214105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:31:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df18929107a458194a9c528d9bdfeac',uuid=8fe2f619-2090-4653-96ab-937e0438a319,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "424118a7-f3d3-4351-ae2e-8ee2208b19c5", "address": "fa:16:3e:e8:f5:92", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424118a7-f3", "ovs_interfaceid": "424118a7-f3d3-4351-ae2e-8ee2208b19c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converting VIF {"id": "424118a7-f3d3-4351-ae2e-8ee2208b19c5", "address": "fa:16:3e:e8:f5:92", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424118a7-f3", "ovs_interfaceid": "424118a7-f3d3-4351-ae2e-8ee2208b19c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f5:92,bridge_name='br-int',has_traffic_filtering=True,id=424118a7-f3d3-4351-ae2e-8ee2208b19c5,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424118a7-f3') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.objects.instance [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fe2f619-2090-4653-96ab-937e0438a319 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:31:40 user nova-compute[70243]:   <uuid>8fe2f619-2090-4653-96ab-937e0438a319</uuid>
Jul 24 16:31:40 user nova-compute[70243]:   <name>instance-0000001c</name>
Jul 24 16:31:40 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:31:40 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:31:40 user nova-compute[70243]:   <metadata>
Jul 24 16:31:40 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:31:40 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:31:40 user nova-compute[70243]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1683650322</nova:name>
Jul 24 16:31:40 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:31:40</nova:creationTime>
Jul 24 16:31:40 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:31:40 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:31:40 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:31:40 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:31:40 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:31:40 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:31:40 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:31:40 user nova-compute[70243]:       <nova:owner>
Jul 24 16:31:40 user nova-compute[70243]:         <nova:user uuid="8df18929107a458194a9c528d9bdfeac">tempest-AttachVolumeNegativeTest-1152214105-project-member</nova:user>
Jul 24 16:31:40 user nova-compute[70243]:         <nova:project uuid="e819e22e590947478d513e1b9ad39494">tempest-AttachVolumeNegativeTest-1152214105</nova:project>
Jul 24 16:31:40 user nova-compute[70243]:       </nova:owner>
Jul 24 16:31:40 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:31:40 user nova-compute[70243]:       <nova:ports>
Jul 24 16:31:40 user nova-compute[70243]:         <nova:port uuid="424118a7-f3d3-4351-ae2e-8ee2208b19c5">
Jul 24 16:31:40 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 24 16:31:40 user nova-compute[70243]:         </nova:port>
Jul 24 16:31:40 user nova-compute[70243]:       </nova:ports>
Jul 24 16:31:40 user nova-compute[70243]:     </nova:instance>
Jul 24 16:31:40 user nova-compute[70243]:   </metadata>
Jul 24 16:31:40 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:31:40 user nova-compute[70243]:     <system>
Jul 24 16:31:40 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:31:40 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:31:40 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:31:40 user nova-compute[70243]:       <entry name="serial">8fe2f619-2090-4653-96ab-937e0438a319</entry>
Jul 24 16:31:40 user nova-compute[70243]:       <entry name="uuid">8fe2f619-2090-4653-96ab-937e0438a319</entry>
Jul 24 16:31:40 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:31:40 user nova-compute[70243]:     </system>
Jul 24 16:31:40 user nova-compute[70243]:   </sysinfo>
Jul 24 16:31:40 user nova-compute[70243]:   <os>
Jul 24 16:31:40 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:31:40 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:31:40 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:31:40 user nova-compute[70243]:   </os>
Jul 24 16:31:40 user nova-compute[70243]:   <features>
Jul 24 16:31:40 user nova-compute[70243]:     <acpi/>
Jul 24 16:31:40 user nova-compute[70243]:     <apic/>
Jul 24 16:31:40 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:31:40 user nova-compute[70243]:   </features>
Jul 24 16:31:40 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:31:40 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:31:40 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:31:40 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:31:40 user nova-compute[70243]:   </clock>
Jul 24 16:31:40 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:31:40 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:31:40 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:31:40 user nova-compute[70243]:   </cpu>
Jul 24 16:31:40 user nova-compute[70243]:   <devices>
Jul 24 16:31:40 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:31:40 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:31:40 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/disk"/>
Jul 24 16:31:40 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:31:40 user nova-compute[70243]:     </disk>
Jul 24 16:31:40 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:31:40 user nova-compute[70243]:       <mac address="fa:16:3e:e8:f5:92"/>
Jul 24 16:31:40 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:31:40 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:31:40 user nova-compute[70243]:       <target dev="tap424118a7-f3"/>
Jul 24 16:31:40 user nova-compute[70243]:     </interface>
Jul 24 16:31:40 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:31:40 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/console.log" append="off"/>
Jul 24 16:31:40 user nova-compute[70243]:     </serial>
Jul 24 16:31:40 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:31:40 user nova-compute[70243]:     <video>
Jul 24 16:31:40 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:31:40 user nova-compute[70243]:     </video>
Jul 24 16:31:40 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:31:40 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:31:40 user nova-compute[70243]:     </rng>
Jul 24 16:31:40 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:31:40 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:31:40 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:31:40 user nova-compute[70243]:     </memballoon>
Jul 24 16:31:40 user nova-compute[70243]:   </devices>
Jul 24 16:31:40 user nova-compute[70243]: </domain>
Jul 24 16:31:40 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:31:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1683650322',display_name='tempest-AttachVolumeNegativeTest-server-1683650322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1683650322',id=28,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPpRVYexM2uymQwadWK9qU/wMGEjmtuDYPGgm1i2xUzjg4gw5iqUJQA5vMVKHFWQNr2SKj4N/1Il8VKuXsUbWR/hvhKmvrpzRurEj/I9J2qJERmvqTgLh76CP3SnkMeRw==',key_name='tempest-keypair-76493656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e819e22e590947478d513e1b9ad39494',ramdisk_id='',reservation_id='r-vlnyota7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1152214105',owner_user_name='tempest-AttachVolumeNegativeTest-1152214105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:31:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df18929107a458194a9c528d9bdfeac',uuid=8fe2f619-2090-4653-96ab-937e0438a319,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "424118a7-f3d3-4351-ae2e-8ee2208b19c5", "address": "fa:16:3e:e8:f5:92", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424118a7-f3", "ovs_interfaceid": "424118a7-f3d3-4351-ae2e-8ee2208b19c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converting VIF {"id": "424118a7-f3d3-4351-ae2e-8ee2208b19c5", "address": "fa:16:3e:e8:f5:92", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424118a7-f3", "ovs_interfaceid": "424118a7-f3d3-4351-ae2e-8ee2208b19c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f5:92,bridge_name='br-int',has_traffic_filtering=True,id=424118a7-f3d3-4351-ae2e-8ee2208b19c5,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424118a7-f3') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG os_vif [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f5:92,bridge_name='br-int',has_traffic_filtering=True,id=424118a7-f3d3-4351-ae2e-8ee2208b19c5,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424118a7-f3') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap424118a7-f3, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap424118a7-f3, col_values=(('external_ids', {'iface-id': '424118a7-f3d3-4351-ae2e-8ee2208b19c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:f5:92', 'vm-uuid': '8fe2f619-2090-4653-96ab-937e0438a319'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:40 user nova-compute[70243]: INFO os_vif [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:f5:92,bridge_name='br-int',has_traffic_filtering=True,id=424118a7-f3d3-4351-ae2e-8ee2208b19c5,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424118a7-f3')
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] No VIF found with MAC fa:16:3e:e8:f5:92, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.network.neutron [req-79d46ddd-2315-47f4-82b9-3cbf418b6cfd req-2f628ccb-8e88-4956-93bc-e54d3a84dab1 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Updated VIF entry in instance network info cache for port 424118a7-f3d3-4351-ae2e-8ee2208b19c5. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG nova.network.neutron [req-79d46ddd-2315-47f4-82b9-3cbf418b6cfd req-2f628ccb-8e88-4956-93bc-e54d3a84dab1 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Updating instance_info_cache with network_info: [{"id": "424118a7-f3d3-4351-ae2e-8ee2208b19c5", "address": "fa:16:3e:e8:f5:92", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424118a7-f3", "ovs_interfaceid": "424118a7-f3d3-4351-ae2e-8ee2208b19c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:31:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-79d46ddd-2315-47f4-82b9-3cbf418b6cfd req-2f628ccb-8e88-4956-93bc-e54d3a84dab1 service nova] Releasing lock "refresh_cache-8fe2f619-2090-4653-96ab-937e0438a319" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:31:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:42 user nova-compute[70243]: DEBUG nova.compute.manager [req-da05582e-2372-474c-b6aa-f007020e0845 req-5430b6a8-efbc-42db-b01a-ef75f5e2475e service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Received event network-vif-plugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:31:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-da05582e-2372-474c-b6aa-f007020e0845 req-5430b6a8-efbc-42db-b01a-ef75f5e2475e service nova] Acquiring lock "8fe2f619-2090-4653-96ab-937e0438a319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:31:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-da05582e-2372-474c-b6aa-f007020e0845 req-5430b6a8-efbc-42db-b01a-ef75f5e2475e service nova] Lock "8fe2f619-2090-4653-96ab-937e0438a319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:31:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-da05582e-2372-474c-b6aa-f007020e0845 req-5430b6a8-efbc-42db-b01a-ef75f5e2475e service nova] Lock "8fe2f619-2090-4653-96ab-937e0438a319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:31:42 user nova-compute[70243]: DEBUG nova.compute.manager [req-da05582e-2372-474c-b6aa-f007020e0845 req-5430b6a8-efbc-42db-b01a-ef75f5e2475e service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] No waiting events found dispatching network-vif-plugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:31:42 user nova-compute[70243]: WARNING nova.compute.manager [req-da05582e-2372-474c-b6aa-f007020e0845 req-5430b6a8-efbc-42db-b01a-ef75f5e2475e service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Received unexpected event network-vif-plugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 for instance with vm_state building and task_state spawning.
Jul 24 16:31:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:43 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216303.9770274, 8fe2f619-2090-4653-96ab-937e0438a319 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:31:43 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] VM Resumed (Lifecycle Event)
Jul 24 16:31:43 user nova-compute[70243]: DEBUG nova.compute.manager [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:31:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:31:43 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Instance spawned successfully.
Jul 24 16:31:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:31:43 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:31:44 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:31:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:31:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:31:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:31:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:31:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:31:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:31:44 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:31:44 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216303.9772866, 8fe2f619-2090-4653-96ab-937e0438a319 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:31:44 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] VM Started (Lifecycle Event)
Jul 24 16:31:44 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:31:44 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:31:44 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:31:44 user nova-compute[70243]: INFO nova.compute.manager [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Took 5.82 seconds to spawn the instance on the hypervisor.
Jul 24 16:31:44 user nova-compute[70243]: DEBUG nova.compute.manager [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:31:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-f466ca17-a26c-4a12-b269-8cc7b07dab06 req-e924d00e-8fa3-4675-aeab-75586d14616d service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Received event network-vif-plugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:31:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f466ca17-a26c-4a12-b269-8cc7b07dab06 req-e924d00e-8fa3-4675-aeab-75586d14616d service nova] Acquiring lock "8fe2f619-2090-4653-96ab-937e0438a319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:31:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f466ca17-a26c-4a12-b269-8cc7b07dab06 req-e924d00e-8fa3-4675-aeab-75586d14616d service nova] Lock "8fe2f619-2090-4653-96ab-937e0438a319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:31:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f466ca17-a26c-4a12-b269-8cc7b07dab06 req-e924d00e-8fa3-4675-aeab-75586d14616d service nova] Lock "8fe2f619-2090-4653-96ab-937e0438a319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:31:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-f466ca17-a26c-4a12-b269-8cc7b07dab06 req-e924d00e-8fa3-4675-aeab-75586d14616d service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] No waiting events found dispatching network-vif-plugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:31:44 user nova-compute[70243]: WARNING nova.compute.manager [req-f466ca17-a26c-4a12-b269-8cc7b07dab06 req-e924d00e-8fa3-4675-aeab-75586d14616d service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Received unexpected event network-vif-plugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 for instance with vm_state building and task_state spawning.
Jul 24 16:31:44 user nova-compute[70243]: INFO nova.compute.manager [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Took 6.47 seconds to build instance.
Jul 24 16:31:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-24dd0abe-1757-454e-a684-548664338451 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "8fe2f619-2090-4653-96ab-937e0438a319" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.562s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:31:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:45 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:31:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:31:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:31:48 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:31:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:51 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:31:51 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:31:52 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:31:53 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:31:53 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:31:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:31:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:31:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:31:53 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:31:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:31:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:31:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bf21ddb-9e24-49e7-946a-e3bb75bb3a98/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bf21ddb-9e24-49e7-946a-e3bb75bb3a98/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bf21ddb-9e24-49e7-946a-e3bb75bb3a98/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bf21ddb-9e24-49e7-946a-e3bb75bb3a98/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:31:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:31:56 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:31:56 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:31:56 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=7741MB free_disk=24.312725067138672GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:31:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:31:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:31:56 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance de22ea98-b041-4f3f-8986-435c43267a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:31:56 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 50fecb3a-8f06-4822-8c84-76df51acfe50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:31:56 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6f2258de-6b31-48af-81df-37b64da4ca99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:31:56 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 4c394c36-5163-4739-964a-7350ee4814ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:31:56 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6ed1935d-3a60-418e-bc44-ed65452afc1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:31:56 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8eb4450c-bf08-4949-a126-d30dbb3ea744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:31:56 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:31:56 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8fe2f619-2090-4653-96ab-937e0438a319 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:31:56 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:31:56 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:31:57 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:31:57 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:31:57 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:31:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.420s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:31:58 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:31:58 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:31:58 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:31:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-6f2258de-6b31-48af-81df-37b64da4ca99" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:31:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-6f2258de-6b31-48af-81df-37b64da4ca99" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:31:58 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:31:58 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Updating instance_info_cache with network_info: [{"id": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "address": "fa:16:3e:d4:bf:cd", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a2f7cb-1b", "ovs_interfaceid": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:31:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-6f2258de-6b31-48af-81df-37b64da4ca99" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:31:58 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:31:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "4c394c36-5163-4739-964a-7350ee4814ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:32:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "4c394c36-5163-4739-964a-7350ee4814ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:32:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "4c394c36-5163-4739-964a-7350ee4814ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:32:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "4c394c36-5163-4739-964a-7350ee4814ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:32:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "4c394c36-5163-4739-964a-7350ee4814ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:32:13 user nova-compute[70243]: INFO nova.compute.manager [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Terminating instance
Jul 24 16:32:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:32:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:14 user nova-compute[70243]: DEBUG nova.compute.manager [req-ceec83d1-d16a-4128-a857-e2aba4c1bdb6 req-04606990-afa2-4664-a127-95e9f78c5d0e service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Received event network-vif-unplugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:32:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ceec83d1-d16a-4128-a857-e2aba4c1bdb6 req-04606990-afa2-4664-a127-95e9f78c5d0e service nova] Acquiring lock "4c394c36-5163-4739-964a-7350ee4814ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:32:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ceec83d1-d16a-4128-a857-e2aba4c1bdb6 req-04606990-afa2-4664-a127-95e9f78c5d0e service nova] Lock "4c394c36-5163-4739-964a-7350ee4814ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:32:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ceec83d1-d16a-4128-a857-e2aba4c1bdb6 req-04606990-afa2-4664-a127-95e9f78c5d0e service nova] Lock "4c394c36-5163-4739-964a-7350ee4814ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:32:14 user nova-compute[70243]: DEBUG nova.compute.manager [req-ceec83d1-d16a-4128-a857-e2aba4c1bdb6 req-04606990-afa2-4664-a127-95e9f78c5d0e service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] No waiting events found dispatching network-vif-unplugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:32:14 user nova-compute[70243]: DEBUG nova.compute.manager [req-ceec83d1-d16a-4128-a857-e2aba4c1bdb6 req-04606990-afa2-4664-a127-95e9f78c5d0e service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Received event network-vif-unplugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:32:14 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Instance destroyed successfully.
Jul 24 16:32:14 user nova-compute[70243]: DEBUG nova.objects.instance [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lazy-loading 'resources' on Instance uuid 4c394c36-5163-4739-964a-7350ee4814ae {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:32:14 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:27:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1003531418',display_name='tempest-TestMinimumBasicScenario-server-1003531418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1003531418',id=23,image_ref='8f8fd556-f664-448f-b667-80b448018026',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNkjb5r2/g/V5n55dyM7qTp72KvMoMWkUbOP/7Xr3UKE06R1edaMfwJPZBKwpYmD1+1bZ1ekXUYg1HJSnh00XC2vLaS4f/AR/5e9eyxfwb4gUOfLcXs+sna9q/7Iw0kmg==',key_name='tempest-TestMinimumBasicScenario-1308615724',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:27:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65ea0e23a23640a5b71e3269c6f1115c',ramdisk_id='',reservation_id='r-sdnbs626',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8f8fd556-f664-448f-b667-80b448018026',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2131001827',owner_user_name='tempest-TestMinimumBasicScenario-2131001827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:29:32Z,user_data=None,user_id='83ec3411adf049b190874e4923f49472',uuid=4c394c36-5163-4739-964a-7350ee4814ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "address": "fa:16:3e:56:fb:e8", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d075a00-69", "ovs_interfaceid": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:32:14 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Converting VIF {"id": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "address": "fa:16:3e:56:fb:e8", "network": {"id": "8320b285-1c9b-4a9a-980a-5a37682cfde2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1727431368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65ea0e23a23640a5b71e3269c6f1115c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d075a00-69", "ovs_interfaceid": "7d075a00-69b3-4a37-8752-46f3c3a35cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:32:14 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:fb:e8,bridge_name='br-int',has_traffic_filtering=True,id=7d075a00-69b3-4a37-8752-46f3c3a35cb5,network=Network(8320b285-1c9b-4a9a-980a-5a37682cfde2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d075a00-69') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:32:14 user nova-compute[70243]: DEBUG os_vif [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:fb:e8,bridge_name='br-int',has_traffic_filtering=True,id=7d075a00-69b3-4a37-8752-46f3c3a35cb5,network=Network(8320b285-1c9b-4a9a-980a-5a37682cfde2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d075a00-69') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:32:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d075a00-69, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:32:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:14 user nova-compute[70243]: INFO os_vif [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:fb:e8,bridge_name='br-int',has_traffic_filtering=True,id=7d075a00-69b3-4a37-8752-46f3c3a35cb5,network=Network(8320b285-1c9b-4a9a-980a-5a37682cfde2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d075a00-69')
Jul 24 16:32:14 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Deleting instance files /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae_del
Jul 24 16:32:14 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Deletion of /opt/stack/data/nova/instances/4c394c36-5163-4739-964a-7350ee4814ae_del complete
Jul 24 16:32:14 user nova-compute[70243]: INFO nova.compute.manager [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 24 16:32:14 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:32:14 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:32:14 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:32:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:15 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:32:15 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Took 0.57 seconds to deallocate network for instance.
Jul 24 16:32:15 user nova-compute[70243]: DEBUG nova.compute.manager [req-9a15160d-4f2c-4805-a48e-c903fd95a8f6 req-dd36f582-2a30-4283-a6a9-94105ad83da2 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Received event network-vif-deleted-7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:32:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:32:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:32:15 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:32:15 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:32:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:32:15 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Deleted allocations for instance 4c394c36-5163-4739-964a-7350ee4814ae
Jul 24 16:32:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-721c9422-76bb-4186-8a6b-087570891078 tempest-TestMinimumBasicScenario-2131001827 tempest-TestMinimumBasicScenario-2131001827-project-member] Lock "4c394c36-5163-4739-964a-7350ee4814ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.955s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:32:16 user nova-compute[70243]: DEBUG nova.compute.manager [req-bd40b78e-efb9-4b04-a666-9993689dddae req-05ced523-4202-4cb4-84c4-39dd12b65109 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Received event network-vif-plugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:32:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-bd40b78e-efb9-4b04-a666-9993689dddae req-05ced523-4202-4cb4-84c4-39dd12b65109 service nova] Acquiring lock "4c394c36-5163-4739-964a-7350ee4814ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:32:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-bd40b78e-efb9-4b04-a666-9993689dddae req-05ced523-4202-4cb4-84c4-39dd12b65109 service nova] Lock "4c394c36-5163-4739-964a-7350ee4814ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:32:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-bd40b78e-efb9-4b04-a666-9993689dddae req-05ced523-4202-4cb4-84c4-39dd12b65109 service nova] Lock "4c394c36-5163-4739-964a-7350ee4814ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:32:16 user nova-compute[70243]: DEBUG nova.compute.manager [req-bd40b78e-efb9-4b04-a666-9993689dddae req-05ced523-4202-4cb4-84c4-39dd12b65109 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] No waiting events found dispatching network-vif-plugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:32:16 user nova-compute[70243]: WARNING nova.compute.manager [req-bd40b78e-efb9-4b04-a666-9993689dddae req-05ced523-4202-4cb4-84c4-39dd12b65109 service nova] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Received unexpected event network-vif-plugged-7d075a00-69b3-4a37-8752-46f3c3a35cb5 for instance with vm_state deleted and task_state None.
Jul 24 16:32:16 user nova-compute[70243]: INFO nova.compute.manager [None req-ff7e1be1-7e54-4475-ae53-b173219c3802 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Unrescuing
Jul 24 16:32:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ff7e1be1-7e54-4475-ae53-b173219c3802 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "refresh_cache-50fecb3a-8f06-4822-8c84-76df51acfe50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:32:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ff7e1be1-7e54-4475-ae53-b173219c3802 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquired lock "refresh_cache-50fecb3a-8f06-4822-8c84-76df51acfe50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:32:16 user nova-compute[70243]: DEBUG nova.network.neutron [None req-ff7e1be1-7e54-4475-ae53-b173219c3802 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:32:17 user nova-compute[70243]: DEBUG nova.network.neutron [None req-ff7e1be1-7e54-4475-ae53-b173219c3802 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Updating instance_info_cache with network_info: [{"id": "657cc261-2d12-42c2-a879-f8cc121bd811", "address": "fa:16:3e:93:0d:e3", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657cc261-2d", "ovs_interfaceid": "657cc261-2d12-42c2-a879-f8cc121bd811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:32:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ff7e1be1-7e54-4475-ae53-b173219c3802 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Releasing lock "refresh_cache-50fecb3a-8f06-4822-8c84-76df51acfe50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:32:17 user nova-compute[70243]: DEBUG nova.objects.instance [None req-ff7e1be1-7e54-4475-ae53-b173219c3802 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'flavor' on Instance uuid 50fecb3a-8f06-4822-8c84-76df51acfe50 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:32:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:17 user nova-compute[70243]: DEBUG nova.compute.manager [req-cdf40d37-79cb-427a-b41c-1cb6d1b172d5 req-99e3f31e-9ff1-4d19-a04d-2d9358e4bd3c service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received event network-vif-unplugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:32:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cdf40d37-79cb-427a-b41c-1cb6d1b172d5 req-99e3f31e-9ff1-4d19-a04d-2d9358e4bd3c service nova] Acquiring lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:32:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cdf40d37-79cb-427a-b41c-1cb6d1b172d5 req-99e3f31e-9ff1-4d19-a04d-2d9358e4bd3c service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:32:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cdf40d37-79cb-427a-b41c-1cb6d1b172d5 req-99e3f31e-9ff1-4d19-a04d-2d9358e4bd3c service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:32:17 user nova-compute[70243]: DEBUG nova.compute.manager [req-cdf40d37-79cb-427a-b41c-1cb6d1b172d5 req-99e3f31e-9ff1-4d19-a04d-2d9358e4bd3c service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] No waiting events found dispatching network-vif-unplugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:32:17 user nova-compute[70243]: WARNING nova.compute.manager [req-cdf40d37-79cb-427a-b41c-1cb6d1b172d5 req-99e3f31e-9ff1-4d19-a04d-2d9358e4bd3c service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received unexpected event network-vif-unplugged-657cc261-2d12-42c2-a879-f8cc121bd811 for instance with vm_state rescued and task_state unrescuing.
Jul 24 16:32:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:18 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Instance destroyed successfully.
Jul 24 16:32:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-1e9859a7-e46c-456b-adf7-c81c328c0457 req-765bd8d1-e169-4c9d-bdf4-0d9aa1ccb457 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received event network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:32:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1e9859a7-e46c-456b-adf7-c81c328c0457 req-765bd8d1-e169-4c9d-bdf4-0d9aa1ccb457 service nova] Acquiring lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:32:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1e9859a7-e46c-456b-adf7-c81c328c0457 req-765bd8d1-e169-4c9d-bdf4-0d9aa1ccb457 service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:32:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1e9859a7-e46c-456b-adf7-c81c328c0457 req-765bd8d1-e169-4c9d-bdf4-0d9aa1ccb457 service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:32:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-1e9859a7-e46c-456b-adf7-c81c328c0457 req-765bd8d1-e169-4c9d-bdf4-0d9aa1ccb457 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] No waiting events found dispatching network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:32:19 user nova-compute[70243]: WARNING nova.compute.manager [req-1e9859a7-e46c-456b-adf7-c81c328c0457 req-765bd8d1-e169-4c9d-bdf4-0d9aa1ccb457 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received unexpected event network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 for instance with vm_state rescued and task_state unrescuing.
Jul 24 16:32:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-1e9859a7-e46c-456b-adf7-c81c328c0457 req-765bd8d1-e169-4c9d-bdf4-0d9aa1ccb457 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received event network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:32:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1e9859a7-e46c-456b-adf7-c81c328c0457 req-765bd8d1-e169-4c9d-bdf4-0d9aa1ccb457 service nova] Acquiring lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:32:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1e9859a7-e46c-456b-adf7-c81c328c0457 req-765bd8d1-e169-4c9d-bdf4-0d9aa1ccb457 service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:32:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1e9859a7-e46c-456b-adf7-c81c328c0457 req-765bd8d1-e169-4c9d-bdf4-0d9aa1ccb457 service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:32:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-1e9859a7-e46c-456b-adf7-c81c328c0457 req-765bd8d1-e169-4c9d-bdf4-0d9aa1ccb457 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] No waiting events found dispatching network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:32:19 user nova-compute[70243]: WARNING nova.compute.manager [req-1e9859a7-e46c-456b-adf7-c81c328c0457 req-765bd8d1-e169-4c9d-bdf4-0d9aa1ccb457 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received unexpected event network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 for instance with vm_state rescued and task_state unrescuing.
Jul 24 16:32:21 user nova-compute[70243]: INFO nova.compute.manager [None req-28daaaff-dd5e-460b-8b98-2443144fc5de tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Get console output
Jul 24 16:32:21 user nova-compute[70243]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jul 24 16:32:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Removed pending event for 50fecb3a-8f06-4822-8c84-76df51acfe50 due to event {{(pid=70243) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 16:32:21 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216341.8523877, 50fecb3a-8f06-4822-8c84-76df51acfe50 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:32:21 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] VM Resumed (Lifecycle Event)
Jul 24 16:32:21 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ff7e1be1-7e54-4475-ae53-b173219c3802 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:32:21 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:32:21 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:32:21 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 24 16:32:21 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216341.8535192, 50fecb3a-8f06-4822-8c84-76df51acfe50 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:32:21 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] VM Started (Lifecycle Event)
Jul 24 16:32:21 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:32:21 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:32:21 user nova-compute[70243]: DEBUG nova.compute.manager [req-1d8b5102-fd68-4179-91cc-7a12d05776b8 req-e4a1e88b-8996-41c6-9450-a05e38b58a6d service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received event network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:32:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1d8b5102-fd68-4179-91cc-7a12d05776b8 req-e4a1e88b-8996-41c6-9450-a05e38b58a6d service nova] Acquiring lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:32:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1d8b5102-fd68-4179-91cc-7a12d05776b8 req-e4a1e88b-8996-41c6-9450-a05e38b58a6d service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:32:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1d8b5102-fd68-4179-91cc-7a12d05776b8 req-e4a1e88b-8996-41c6-9450-a05e38b58a6d service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:32:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-1d8b5102-fd68-4179-91cc-7a12d05776b8 req-e4a1e88b-8996-41c6-9450-a05e38b58a6d service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] No waiting events found dispatching network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:32:22 user nova-compute[70243]: WARNING nova.compute.manager [req-1d8b5102-fd68-4179-91cc-7a12d05776b8 req-e4a1e88b-8996-41c6-9450-a05e38b58a6d service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received unexpected event network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 for instance with vm_state active and task_state None.
Jul 24 16:32:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:29 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216334.5292249, 4c394c36-5163-4739-964a-7350ee4814ae => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:32:29 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] VM Stopped (Lifecycle Event)
Jul 24 16:32:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:29 user nova-compute[70243]: DEBUG nova.compute.manager [None req-1a42f951-cbf0-4631-bcbb-b6e90440f3ba None None] [instance: 4c394c36-5163-4739-964a-7350ee4814ae] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:32:29 user nova-compute[70243]: DEBUG nova.compute.manager [req-81dd5d9b-ba84-401d-b851-0562286f98b3 req-27aa4e0f-9a2a-46a8-9576-d8a202a5e917 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Received event network-changed-3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:32:29 user nova-compute[70243]: DEBUG nova.compute.manager [req-81dd5d9b-ba84-401d-b851-0562286f98b3 req-27aa4e0f-9a2a-46a8-9576-d8a202a5e917 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Refreshing instance network info cache due to event network-changed-3053b7df-e393-4bc7-a17f-8983f22cdd96. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:32:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-81dd5d9b-ba84-401d-b851-0562286f98b3 req-27aa4e0f-9a2a-46a8-9576-d8a202a5e917 service nova] Acquiring lock "refresh_cache-8eb4450c-bf08-4949-a126-d30dbb3ea744" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:32:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-81dd5d9b-ba84-401d-b851-0562286f98b3 req-27aa4e0f-9a2a-46a8-9576-d8a202a5e917 service nova] Acquired lock "refresh_cache-8eb4450c-bf08-4949-a126-d30dbb3ea744" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:32:29 user nova-compute[70243]: DEBUG nova.network.neutron [req-81dd5d9b-ba84-401d-b851-0562286f98b3 req-27aa4e0f-9a2a-46a8-9576-d8a202a5e917 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Refreshing network info cache for port 3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:32:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:30 user nova-compute[70243]: DEBUG nova.network.neutron [req-81dd5d9b-ba84-401d-b851-0562286f98b3 req-27aa4e0f-9a2a-46a8-9576-d8a202a5e917 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Updated VIF entry in instance network info cache for port 3053b7df-e393-4bc7-a17f-8983f22cdd96. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:32:30 user nova-compute[70243]: DEBUG nova.network.neutron [req-81dd5d9b-ba84-401d-b851-0562286f98b3 req-27aa4e0f-9a2a-46a8-9576-d8a202a5e917 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Updating instance_info_cache with network_info: [{"id": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "address": "fa:16:3e:ad:37:16", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3053b7df-e3", "ovs_interfaceid": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:32:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-81dd5d9b-ba84-401d-b851-0562286f98b3 req-27aa4e0f-9a2a-46a8-9576-d8a202a5e917 service nova] Releasing lock "refresh_cache-8eb4450c-bf08-4949-a126-d30dbb3ea744" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:32:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "8eb4450c-bf08-4949-a126-d30dbb3ea744" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:32:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:32:33 user nova-compute[70243]: INFO nova.compute.manager [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Shelving
Jul 24 16:32:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:33 user nova-compute[70243]: DEBUG nova.compute.manager [req-53da1f85-afb2-4b48-87d4-f7d6b4ff7c7d req-96283dcd-f849-41cb-939e-87484edb87f5 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Received event network-vif-unplugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:32:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-53da1f85-afb2-4b48-87d4-f7d6b4ff7c7d req-96283dcd-f849-41cb-939e-87484edb87f5 service nova] Acquiring lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:32:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-53da1f85-afb2-4b48-87d4-f7d6b4ff7c7d req-96283dcd-f849-41cb-939e-87484edb87f5 service nova] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:32:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-53da1f85-afb2-4b48-87d4-f7d6b4ff7c7d req-96283dcd-f849-41cb-939e-87484edb87f5 service nova] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:32:33 user nova-compute[70243]: DEBUG nova.compute.manager [req-53da1f85-afb2-4b48-87d4-f7d6b4ff7c7d req-96283dcd-f849-41cb-939e-87484edb87f5 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] No waiting events found dispatching network-vif-unplugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:32:33 user nova-compute[70243]: WARNING nova.compute.manager [req-53da1f85-afb2-4b48-87d4-f7d6b4ff7c7d req-96283dcd-f849-41cb-939e-87484edb87f5 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Received unexpected event network-vif-unplugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 for instance with vm_state active and task_state shelving.
Jul 24 16:32:34 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Instance destroyed successfully.
Jul 24 16:32:34 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Beginning cold snapshot process
Jul 24 16:32:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:34 user nova-compute[70243]: DEBUG nova.privsep.utils [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70243) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 16:32:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk /opt/stack/data/nova/instances/snapshots/tmpjbxg2nvs/7500b928e96a4fe7b7ab884c398d2529 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:32:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:35 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk /opt/stack/data/nova/instances/snapshots/tmpjbxg2nvs/7500b928e96a4fe7b7ab884c398d2529" returned: 0 in 0.473s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:32:35 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Snapshot extracted, beginning image upload
Jul 24 16:32:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-8d64c39c-a8b1-4860-a1d7-4d7924b0a8ff req-67e4b5b7-793c-492d-8ad4-2f9348627651 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Received event network-vif-plugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:32:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8d64c39c-a8b1-4860-a1d7-4d7924b0a8ff req-67e4b5b7-793c-492d-8ad4-2f9348627651 service nova] Acquiring lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:32:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8d64c39c-a8b1-4860-a1d7-4d7924b0a8ff req-67e4b5b7-793c-492d-8ad4-2f9348627651 service nova] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:32:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8d64c39c-a8b1-4860-a1d7-4d7924b0a8ff req-67e4b5b7-793c-492d-8ad4-2f9348627651 service nova] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:32:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-8d64c39c-a8b1-4860-a1d7-4d7924b0a8ff req-67e4b5b7-793c-492d-8ad4-2f9348627651 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] No waiting events found dispatching network-vif-plugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:32:35 user nova-compute[70243]: WARNING nova.compute.manager [req-8d64c39c-a8b1-4860-a1d7-4d7924b0a8ff req-67e4b5b7-793c-492d-8ad4-2f9348627651 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Received unexpected event network-vif-plugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 for instance with vm_state active and task_state shelving_image_uploading.
Jul 24 16:32:37 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Snapshot image upload complete
Jul 24 16:32:37 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:32:37 user nova-compute[70243]: INFO nova.compute.manager [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Shelve offloading
Jul 24 16:32:37 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Instance destroyed successfully.
Jul 24 16:32:37 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:32:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "refresh_cache-8eb4450c-bf08-4949-a126-d30dbb3ea744" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:32:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquired lock "refresh_cache-8eb4450c-bf08-4949-a126-d30dbb3ea744" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:32:37 user nova-compute[70243]: DEBUG nova.network.neutron [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:32:38 user nova-compute[70243]: DEBUG nova.network.neutron [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Updating instance_info_cache with network_info: [{"id": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "address": "fa:16:3e:ad:37:16", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3053b7df-e3", "ovs_interfaceid": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:32:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Releasing lock "refresh_cache-8eb4450c-bf08-4949-a126-d30dbb3ea744" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:32:38 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Instance destroyed successfully.
Jul 24 16:32:38 user nova-compute[70243]: DEBUG nova.objects.instance [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'resources' on Instance uuid 8eb4450c-bf08-4949-a126-d30dbb3ea744 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:32:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:30:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-980705664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-980705664',id=26,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyki4BvM4FzSdqhAROYG3ucB3rK6iVcLMVb2n52uMdJxxSOHetAHehA+zLslPea930abAZjc/5HN/NJZ5DpCSRZj9LlXJOIRzDCsIj02zLX2xeAqDz0U2rfyStUNE+81g==',key_name='tempest-keypair-1565290298',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:30:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9fcf70d1092145a2bda67106833fe84d',ramdisk_id='',reservation_id='r-0b0cga8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-372850833',owner_user_name='tempest-AttachVolumeShelveTestJSON-372850833-project-member',shelved_at='2023-07-24T16:32:37.609287',shelved_host='user',shelved_image_id='eeb6bdd4-1dfe-45dc-8176-9bb81eaaa23c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:32:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62f8a994029a48608bfdcb15f14b2067',uuid=8eb4450c-bf08-4949-a126-d30dbb3ea744,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "address": "fa:16:3e:ad:37:16", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3053b7df-e3", "ovs_interfaceid": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:32:38 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converting VIF {"id": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "address": "fa:16:3e:ad:37:16", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3053b7df-e3", "ovs_interfaceid": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:32:38 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:37:16,bridge_name='br-int',has_traffic_filtering=True,id=3053b7df-e393-4bc7-a17f-8983f22cdd96,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3053b7df-e3') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:32:38 user nova-compute[70243]: DEBUG os_vif [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:37:16,bridge_name='br-int',has_traffic_filtering=True,id=3053b7df-e393-4bc7-a17f-8983f22cdd96,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3053b7df-e3') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:32:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3053b7df-e3, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:32:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:38 user nova-compute[70243]: DEBUG nova.compute.manager [req-cb561f66-d69a-42c2-97fb-ab8f7d937258 req-7f89533e-c5cc-44fd-bdf3-3a72eec6317f service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Received event network-changed-3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:32:38 user nova-compute[70243]: DEBUG nova.compute.manager [req-cb561f66-d69a-42c2-97fb-ab8f7d937258 req-7f89533e-c5cc-44fd-bdf3-3a72eec6317f service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Refreshing instance network info cache due to event network-changed-3053b7df-e393-4bc7-a17f-8983f22cdd96. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:32:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cb561f66-d69a-42c2-97fb-ab8f7d937258 req-7f89533e-c5cc-44fd-bdf3-3a72eec6317f service nova] Acquiring lock "refresh_cache-8eb4450c-bf08-4949-a126-d30dbb3ea744" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:32:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cb561f66-d69a-42c2-97fb-ab8f7d937258 req-7f89533e-c5cc-44fd-bdf3-3a72eec6317f service nova] Acquired lock "refresh_cache-8eb4450c-bf08-4949-a126-d30dbb3ea744" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:32:38 user nova-compute[70243]: DEBUG nova.network.neutron [req-cb561f66-d69a-42c2-97fb-ab8f7d937258 req-7f89533e-c5cc-44fd-bdf3-3a72eec6317f service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Refreshing network info cache for port 3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:32:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:38 user nova-compute[70243]: INFO os_vif [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:37:16,bridge_name='br-int',has_traffic_filtering=True,id=3053b7df-e393-4bc7-a17f-8983f22cdd96,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3053b7df-e3')
Jul 24 16:32:38 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Deleting instance files /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744_del
Jul 24 16:32:38 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Deletion of /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744_del complete
Jul 24 16:32:39 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Deleted allocations for instance 8eb4450c-bf08-4949-a126-d30dbb3ea744
Jul 24 16:32:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:32:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:32:39 user nova-compute[70243]: DEBUG nova.objects.instance [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'numa_topology' on Instance uuid 8eb4450c-bf08-4949-a126-d30dbb3ea744 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:32:39 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:32:39 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:32:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:32:39 user nova-compute[70243]: DEBUG nova.network.neutron [req-cb561f66-d69a-42c2-97fb-ab8f7d937258 req-7f89533e-c5cc-44fd-bdf3-3a72eec6317f service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Updated VIF entry in instance network info cache for port 3053b7df-e393-4bc7-a17f-8983f22cdd96. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:32:39 user nova-compute[70243]: DEBUG nova.network.neutron [req-cb561f66-d69a-42c2-97fb-ab8f7d937258 req-7f89533e-c5cc-44fd-bdf3-3a72eec6317f service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Updating instance_info_cache with network_info: [{"id": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "address": "fa:16:3e:ad:37:16", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3053b7df-e3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:32:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cb561f66-d69a-42c2-97fb-ab8f7d937258 req-7f89533e-c5cc-44fd-bdf3-3a72eec6317f service nova] Releasing lock "refresh_cache-8eb4450c-bf08-4949-a126-d30dbb3ea744" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:32:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba3c3afb-f4d0-4a95-8e4b-42da599587e7 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.820s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:32:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:46 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:32:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:32:48 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:32:48 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:32:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:49 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216354.354468, 8eb4450c-bf08-4949-a126-d30dbb3ea744 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:32:49 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] VM Stopped (Lifecycle Event)
Jul 24 16:32:49 user nova-compute[70243]: DEBUG nova.compute.manager [None req-5a5bf0b7-17ea-4bdd-a093-03840bdd0dc6 None None] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:32:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:52 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:32:53 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:32:53 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:32:53 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:32:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:54 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:32:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:32:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:32:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:32:54 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:32:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:32:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:32:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:32:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:32:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:32:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:32:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:32:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:32:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:32:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:32:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:32:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:32:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:32:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:32:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:32:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:32:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:32:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:32:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:32:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:32:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:32:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:32:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bf21ddb-9e24-49e7-946a-e3bb75bb3a98/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:32:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bf21ddb-9e24-49e7-946a-e3bb75bb3a98/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:32:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bf21ddb-9e24-49e7-946a-e3bb75bb3a98/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:32:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bf21ddb-9e24-49e7-946a-e3bb75bb3a98/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:32:56 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:32:56 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:32:56 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=7890MB free_disk=24.280906677246094GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:32:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:32:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:32:56 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance de22ea98-b041-4f3f-8986-435c43267a2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:32:56 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 50fecb3a-8f06-4822-8c84-76df51acfe50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:32:56 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6f2258de-6b31-48af-81df-37b64da4ca99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:32:56 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6ed1935d-3a60-418e-bc44-ed65452afc1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:32:56 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:32:56 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8fe2f619-2090-4653-96ab-937e0438a319 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:32:56 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:32:56 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:32:56 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:32:56 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:32:56 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:32:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.372s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:32:58 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:32:58 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:32:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-6ed1935d-3a60-418e-bc44-ed65452afc1a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:32:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-6ed1935d-3a60-418e-bc44-ed65452afc1a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:32:58 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:32:58 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Updating instance_info_cache with network_info: [{"id": "021971db-1e79-467f-8f5b-5361f205fceb", "address": "fa:16:3e:4a:88:70", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021971db-1e", "ovs_interfaceid": "021971db-1e79-467f-8f5b-5361f205fceb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:32:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-6ed1935d-3a60-418e-bc44-ed65452afc1a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:32:58 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:32:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Acquiring lock "1bf21ddb-9e24-49e7-946a-e3bb75bb3a98" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:33:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "1bf21ddb-9e24-49e7-946a-e3bb75bb3a98" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:33:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Acquiring lock "1bf21ddb-9e24-49e7-946a-e3bb75bb3a98-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:33:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "1bf21ddb-9e24-49e7-946a-e3bb75bb3a98-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:33:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "1bf21ddb-9e24-49e7-946a-e3bb75bb3a98-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:33:06 user nova-compute[70243]: INFO nova.compute.manager [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Terminating instance
Jul 24 16:33:06 user nova-compute[70243]: DEBUG nova.compute.manager [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:33:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:07 user nova-compute[70243]: DEBUG nova.compute.manager [req-a2ba121c-e8b3-4743-9c27-e093497f19ff req-b6975760-02f6-4fda-affd-99313f74ff90 service nova] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Received event network-vif-unplugged-bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:33:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a2ba121c-e8b3-4743-9c27-e093497f19ff req-b6975760-02f6-4fda-affd-99313f74ff90 service nova] Acquiring lock "1bf21ddb-9e24-49e7-946a-e3bb75bb3a98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:33:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a2ba121c-e8b3-4743-9c27-e093497f19ff req-b6975760-02f6-4fda-affd-99313f74ff90 service nova] Lock "1bf21ddb-9e24-49e7-946a-e3bb75bb3a98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:33:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a2ba121c-e8b3-4743-9c27-e093497f19ff req-b6975760-02f6-4fda-affd-99313f74ff90 service nova] Lock "1bf21ddb-9e24-49e7-946a-e3bb75bb3a98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:33:07 user nova-compute[70243]: DEBUG nova.compute.manager [req-a2ba121c-e8b3-4743-9c27-e093497f19ff req-b6975760-02f6-4fda-affd-99313f74ff90 service nova] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] No waiting events found dispatching network-vif-unplugged-bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:33:07 user nova-compute[70243]: DEBUG nova.compute.manager [req-a2ba121c-e8b3-4743-9c27-e093497f19ff req-b6975760-02f6-4fda-affd-99313f74ff90 service nova] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Received event network-vif-unplugged-bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:33:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:07 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Instance destroyed successfully.
Jul 24 16:33:07 user nova-compute[70243]: DEBUG nova.objects.instance [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lazy-loading 'resources' on Instance uuid 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:33:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:31:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1558408339',display_name='tempest-VolumesActionsTest-instance-1558408339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1558408339',id=27,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:31:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb3c0ed911674b69a05524f555ea6e0e',ramdisk_id='',reservation_id='r-pi027e7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-137271236',owner_user_name='tempest-VolumesActionsTest-137271236-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:31:23Z,user_data=None,user_id='8ec427ff69094ac7a8647c0811c2af7c',uuid=1bf21ddb-9e24-49e7-946a-e3bb75bb3a98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb", "address": "fa:16:3e:b9:19:7e", "network": {"id": "26f40e99-b090-4a8e-8d72-6b8674b2f716", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919802542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3c0ed911674b69a05524f555ea6e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2fdad9-a6", "ovs_interfaceid": "bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:33:07 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Converting VIF {"id": "bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb", "address": "fa:16:3e:b9:19:7e", "network": {"id": "26f40e99-b090-4a8e-8d72-6b8674b2f716", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919802542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb3c0ed911674b69a05524f555ea6e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd2fdad9-a6", "ovs_interfaceid": "bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:33:07 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:19:7e,bridge_name='br-int',has_traffic_filtering=True,id=bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb,network=Network(26f40e99-b090-4a8e-8d72-6b8674b2f716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd2fdad9-a6') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:33:07 user nova-compute[70243]: DEBUG os_vif [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:19:7e,bridge_name='br-int',has_traffic_filtering=True,id=bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb,network=Network(26f40e99-b090-4a8e-8d72-6b8674b2f716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd2fdad9-a6') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:33:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd2fdad9-a6, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:33:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:33:07 user nova-compute[70243]: INFO os_vif [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:19:7e,bridge_name='br-int',has_traffic_filtering=True,id=bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb,network=Network(26f40e99-b090-4a8e-8d72-6b8674b2f716),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd2fdad9-a6')
Jul 24 16:33:07 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Deleting instance files /opt/stack/data/nova/instances/1bf21ddb-9e24-49e7-946a-e3bb75bb3a98_del
Jul 24 16:33:07 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Deletion of /opt/stack/data/nova/instances/1bf21ddb-9e24-49e7-946a-e3bb75bb3a98_del complete
Jul 24 16:33:07 user nova-compute[70243]: INFO nova.compute.manager [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 24 16:33:07 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:33:07 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:33:07 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:33:08 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:33:08 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Took 0.47 seconds to deallocate network for instance.
Jul 24 16:33:08 user nova-compute[70243]: DEBUG nova.compute.manager [req-4378955d-df13-496b-a1a0-7c3d9df0d1a6 req-80c3d903-0c52-46dc-8341-7106811c2943 service nova] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Received event network-vif-deleted-bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:33:08 user nova-compute[70243]: INFO nova.compute.manager [req-4378955d-df13-496b-a1a0-7c3d9df0d1a6 req-80c3d903-0c52-46dc-8341-7106811c2943 service nova] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Neutron deleted interface bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb; detaching it from the instance and deleting it from the info cache
Jul 24 16:33:08 user nova-compute[70243]: DEBUG nova.network.neutron [req-4378955d-df13-496b-a1a0-7c3d9df0d1a6 req-80c3d903-0c52-46dc-8341-7106811c2943 service nova] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:33:08 user nova-compute[70243]: DEBUG nova.compute.manager [req-4378955d-df13-496b-a1a0-7c3d9df0d1a6 req-80c3d903-0c52-46dc-8341-7106811c2943 service nova] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Detach interface failed, port_id=bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb, reason: Instance 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98 could not be found. {{(pid=70243) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 16:33:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:33:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:33:08 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:33:08 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:33:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:33:08 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Deleted allocations for instance 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98
Jul 24 16:33:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a142f84a-3ddc-4d89-8ef8-22727e8dd173 tempest-VolumesActionsTest-137271236 tempest-VolumesActionsTest-137271236-project-member] Lock "1bf21ddb-9e24-49e7-946a-e3bb75bb3a98" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.780s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:33:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-135cef6e-2d00-4a9d-9ec2-476b2157c0fd req-2eea2820-58e6-4c15-abb1-19e7692f5252 service nova] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Received event network-vif-plugged-bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:33:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-135cef6e-2d00-4a9d-9ec2-476b2157c0fd req-2eea2820-58e6-4c15-abb1-19e7692f5252 service nova] Acquiring lock "1bf21ddb-9e24-49e7-946a-e3bb75bb3a98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:33:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-135cef6e-2d00-4a9d-9ec2-476b2157c0fd req-2eea2820-58e6-4c15-abb1-19e7692f5252 service nova] Lock "1bf21ddb-9e24-49e7-946a-e3bb75bb3a98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:33:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-135cef6e-2d00-4a9d-9ec2-476b2157c0fd req-2eea2820-58e6-4c15-abb1-19e7692f5252 service nova] Lock "1bf21ddb-9e24-49e7-946a-e3bb75bb3a98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:33:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-135cef6e-2d00-4a9d-9ec2-476b2157c0fd req-2eea2820-58e6-4c15-abb1-19e7692f5252 service nova] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] No waiting events found dispatching network-vif-plugged-bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:33:09 user nova-compute[70243]: WARNING nova.compute.manager [req-135cef6e-2d00-4a9d-9ec2-476b2157c0fd req-2eea2820-58e6-4c15-abb1-19e7692f5252 service nova] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Received unexpected event network-vif-plugged-bd2fdad9-a6a9-406e-9641-8ce3d7d11bfb for instance with vm_state deleted and task_state None.
Jul 24 16:33:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:33:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:33:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:33:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:33:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "6ed1935d-3a60-418e-bc44-ed65452afc1a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:33:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:33:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:33:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:33:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:33:22 user nova-compute[70243]: INFO nova.compute.manager [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Terminating instance
Jul 24 16:33:22 user nova-compute[70243]: DEBUG nova.compute.manager [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:33:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-626394f8-cfac-49b9-8fde-13c7bf0a6818 req-52584952-b5f3-4ed7-84e0-0bfd6b353dbe service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Received event network-vif-unplugged-021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:33:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-626394f8-cfac-49b9-8fde-13c7bf0a6818 req-52584952-b5f3-4ed7-84e0-0bfd6b353dbe service nova] Acquiring lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:33:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-626394f8-cfac-49b9-8fde-13c7bf0a6818 req-52584952-b5f3-4ed7-84e0-0bfd6b353dbe service nova] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:33:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-626394f8-cfac-49b9-8fde-13c7bf0a6818 req-52584952-b5f3-4ed7-84e0-0bfd6b353dbe service nova] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:33:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-626394f8-cfac-49b9-8fde-13c7bf0a6818 req-52584952-b5f3-4ed7-84e0-0bfd6b353dbe service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] No waiting events found dispatching network-vif-unplugged-021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:33:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-626394f8-cfac-49b9-8fde-13c7bf0a6818 req-52584952-b5f3-4ed7-84e0-0bfd6b353dbe service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Received event network-vif-unplugged-021971db-1e79-467f-8f5b-5361f205fceb for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:33:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:22 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216387.711529, 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:33:22 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] VM Stopped (Lifecycle Event)
Jul 24 16:33:22 user nova-compute[70243]: DEBUG nova.compute.manager [None req-3f2a929c-1553-4d3d-b0dd-d403387d1ecd None None] [instance: 1bf21ddb-9e24-49e7-946a-e3bb75bb3a98] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:33:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:23 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Instance destroyed successfully.
Jul 24 16:33:23 user nova-compute[70243]: DEBUG nova.objects.instance [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lazy-loading 'resources' on Instance uuid 6ed1935d-3a60-418e-bc44-ed65452afc1a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:26:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1036526617',display_name='tempest-ServerActionsTestOtherA-server-1036526617',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1036526617',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNt4ywOtyDbY3gzVxioiadq0RHvp3ujVzU7+egeM9QHVtvP6DGqg4hSRwxq8r4OyAFnfBqKPWEeStDLSLwfjx+5dISRxZesWLAiccd5P+5WMBwka91+aa63O7dxU+RVwA==',key_name='tempest-keypair-283031417',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:28:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebdb3cb079814db091227f80b2ed1b9d',ramdisk_id='',reservation_id='r-bvklrqc6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-39125821',owner_user_name='tempest-ServerActionsTestOtherA-39125821-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:30:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa3936255d31421184e585e2fd17d7ef',uuid=6ed1935d-3a60-418e-bc44-ed65452afc1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "021971db-1e79-467f-8f5b-5361f205fceb", "address": "fa:16:3e:4a:88:70", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021971db-1e", "ovs_interfaceid": "021971db-1e79-467f-8f5b-5361f205fceb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converting VIF {"id": "021971db-1e79-467f-8f5b-5361f205fceb", "address": "fa:16:3e:4a:88:70", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021971db-1e", "ovs_interfaceid": "021971db-1e79-467f-8f5b-5361f205fceb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:88:70,bridge_name='br-int',has_traffic_filtering=True,id=021971db-1e79-467f-8f5b-5361f205fceb,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021971db-1e') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG os_vif [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:88:70,bridge_name='br-int',has_traffic_filtering=True,id=021971db-1e79-467f-8f5b-5361f205fceb,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021971db-1e') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap021971db-1e, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:33:23 user nova-compute[70243]: INFO os_vif [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:88:70,bridge_name='br-int',has_traffic_filtering=True,id=021971db-1e79-467f-8f5b-5361f205fceb,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021971db-1e')
Jul 24 16:33:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVOWQZzq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:33:23 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:33:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bab01b-0c74-47fe-9ec4-2550027182c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:33:23 user nova-compute[70243]: No targets found.
Jul 24 16:33:23 user nova-compute[70243]: iSNS:
Jul 24 16:33:23 user nova-compute[70243]: No targets found.
Jul 24 16:33:23 user nova-compute[70243]: STATIC:
Jul 24 16:33:23 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8
Jul 24 16:33:23 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:33:23 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:33:23 user nova-compute[70243]: FIRMWARE:
Jul 24 16:33:23 user nova-compute[70243]: No targets found.
Jul 24 16:33:23 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:33:23 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:33:23 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f7cb68-1ab4-43cf-9d6b-ffd10ab3ee62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[894575c9-55cf-483f-abca-90574706e131]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:33:23 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 (non-flash)
Jul 24 16:33:23 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc191750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8'): ({'sdb'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Removing single pathed devices sdb {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2153997-1d50-4d57-ac40-7b0f3d3b6d92]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6a870f-fdce-4b7a-888c-aaf1dde2c12e]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Flushing IO for device /dev/sdb {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40fc154-df9e-4faa-a4fe-b3f385b8e15a]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42f5e49-9617-4488-9a9c-d69786d881f7]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b216c318', '/dev/disk/by-id/scsi-26562303032373133', '/dev/disk/by-id/scsi-1SCST_BIOb216c318-eb002713f8ec5879') {{(pid=81266) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce154952-126a-453c-9cb3-64f75832b729]: (4, None) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ed1399-783b-4eea-b3f3-0e9d14ead363]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b43648-52d0-4a6f-ba53-36253cdb0695]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8, portal: 172.16.0.220,3260]
Jul 24 16:33:23 user nova-compute[70243]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8, portal: 172.16.0.220,3260] successful.
Jul 24 16:33:23 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7390a0-1192-49ab-b8a9-9c449d89ecd8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b23b8e-12f6-44ef-9ee7-e45e59c1c82c]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] <== disconnect_volume: return (345ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:33:23 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Deleting instance files /opt/stack/data/nova/instances/6ed1935d-3a60-418e-bc44-ed65452afc1a_del
Jul 24 16:33:23 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Deletion of /opt/stack/data/nova/instances/6ed1935d-3a60-418e-bc44-ed65452afc1a_del complete
Jul 24 16:33:23 user nova-compute[70243]: INFO nova.compute.manager [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Took 1.26 seconds to destroy the instance on the hypervisor.
Jul 24 16:33:23 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:33:23 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:33:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-7b889c0b-9e01-4161-92a2-17ec0f13a549 req-1aa0e2d9-b4a5-4ee6-9ade-28892289b7db service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Received event network-vif-plugged-021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:33:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7b889c0b-9e01-4161-92a2-17ec0f13a549 req-1aa0e2d9-b4a5-4ee6-9ade-28892289b7db service nova] Acquiring lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:33:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7b889c0b-9e01-4161-92a2-17ec0f13a549 req-1aa0e2d9-b4a5-4ee6-9ade-28892289b7db service nova] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:33:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7b889c0b-9e01-4161-92a2-17ec0f13a549 req-1aa0e2d9-b4a5-4ee6-9ade-28892289b7db service nova] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:33:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-7b889c0b-9e01-4161-92a2-17ec0f13a549 req-1aa0e2d9-b4a5-4ee6-9ade-28892289b7db service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] No waiting events found dispatching network-vif-plugged-021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:33:24 user nova-compute[70243]: WARNING nova.compute.manager [req-7b889c0b-9e01-4161-92a2-17ec0f13a549 req-1aa0e2d9-b4a5-4ee6-9ade-28892289b7db service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Received unexpected event network-vif-plugged-021971db-1e79-467f-8f5b-5361f205fceb for instance with vm_state active and task_state deleting.
Jul 24 16:33:24 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:33:24 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Took 1.28 seconds to deallocate network for instance.
Jul 24 16:33:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-e9cde189-119e-4b3f-9fce-559a92745203 req-debba435-aad5-43fa-be69-36b254f35d4b service nova] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Received event network-vif-deleted-021971db-1e79-467f-8f5b-5361f205fceb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:33:25 user nova-compute[70243]: INFO nova.compute.manager [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Took 0.81 seconds to detach 1 volumes for instance.
Jul 24 16:33:25 user nova-compute[70243]: DEBUG nova.compute.manager [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Deleting volume: 8d7390a0-1192-49ab-b8a9-9c449d89ecd8 {{(pid=70243) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 24 16:33:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:33:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:33:25 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:33:25 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:33:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:33:26 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Deleted allocations for instance 6ed1935d-3a60-418e-bc44-ed65452afc1a
Jul 24 16:33:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-57034522-5342-4963-9352-76113a5e0f90 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "6ed1935d-3a60-418e-bc44-ed65452afc1a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.825s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:33:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:30 user nova-compute[70243]: DEBUG nova.compute.manager [req-86557aa9-0e35-4527-bfa0-146b86f2b80b req-187e9fd9-9726-4a39-9b23-16bd5b00d588 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Received event network-changed-424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:33:30 user nova-compute[70243]: DEBUG nova.compute.manager [req-86557aa9-0e35-4527-bfa0-146b86f2b80b req-187e9fd9-9726-4a39-9b23-16bd5b00d588 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Refreshing instance network info cache due to event network-changed-424118a7-f3d3-4351-ae2e-8ee2208b19c5. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:33:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-86557aa9-0e35-4527-bfa0-146b86f2b80b req-187e9fd9-9726-4a39-9b23-16bd5b00d588 service nova] Acquiring lock "refresh_cache-8fe2f619-2090-4653-96ab-937e0438a319" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:33:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-86557aa9-0e35-4527-bfa0-146b86f2b80b req-187e9fd9-9726-4a39-9b23-16bd5b00d588 service nova] Acquired lock "refresh_cache-8fe2f619-2090-4653-96ab-937e0438a319" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:33:30 user nova-compute[70243]: DEBUG nova.network.neutron [req-86557aa9-0e35-4527-bfa0-146b86f2b80b req-187e9fd9-9726-4a39-9b23-16bd5b00d588 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Refreshing network info cache for port 424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:33:30 user nova-compute[70243]: DEBUG nova.network.neutron [req-86557aa9-0e35-4527-bfa0-146b86f2b80b req-187e9fd9-9726-4a39-9b23-16bd5b00d588 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Updated VIF entry in instance network info cache for port 424118a7-f3d3-4351-ae2e-8ee2208b19c5. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:33:30 user nova-compute[70243]: DEBUG nova.network.neutron [req-86557aa9-0e35-4527-bfa0-146b86f2b80b req-187e9fd9-9726-4a39-9b23-16bd5b00d588 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Updating instance_info_cache with network_info: [{"id": "424118a7-f3d3-4351-ae2e-8ee2208b19c5", "address": "fa:16:3e:e8:f5:92", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424118a7-f3", "ovs_interfaceid": "424118a7-f3d3-4351-ae2e-8ee2208b19c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:33:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-86557aa9-0e35-4527-bfa0-146b86f2b80b req-187e9fd9-9726-4a39-9b23-16bd5b00d588 service nova] Releasing lock "refresh_cache-8fe2f619-2090-4653-96ab-937e0438a319" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:33:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "8fe2f619-2090-4653-96ab-937e0438a319" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:33:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "8fe2f619-2090-4653-96ab-937e0438a319" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:33:32 user nova-compute[70243]: DEBUG nova.objects.instance [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lazy-loading 'flavor' on Instance uuid 8fe2f619-2090-4653-96ab-937e0438a319 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:33:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "8fe2f619-2090-4653-96ab-937e0438a319" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "8fe2f619-2090-4653-96ab-937e0438a319" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "8fe2f619-2090-4653-96ab-937e0438a319" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:33:33 user nova-compute[70243]: INFO nova.compute.manager [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Attaching volume 2c50614b-848e-4fae-825d-b0cb24d69002 to /dev/vdb
Jul 24 16:33:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG os_brick.utils [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ed366a-5f8a-46df-b548-446c91a86230]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc3f846-86f4-4cca-8629-d011630b2cc4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[895cd28a-335a-4642-8d32-380456410e70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e2929a-dbc7-418d-ab47-6b1585b43091]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:33:33 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:33:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[52080a57-1f35-4dd3-b6ca-20f476fc0913]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG os_brick.utils [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:33:33 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Updating existing volume attachment record: f5932b07-df28-4582-96a6-0a86a0b61c78 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:33:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:38 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216403.1341248, 6ed1935d-3a60-418e-bc44-ed65452afc1a => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:33:38 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] VM Stopped (Lifecycle Event)
Jul 24 16:33:38 user nova-compute[70243]: DEBUG nova.compute.manager [None req-569febc1-b312-446f-b737-f7bd23e9fdfc None None] [instance: 6ed1935d-3a60-418e-bc44-ed65452afc1a] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:33:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'itwbVsWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:33:39 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:33:39 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:33:39 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec96219-0a5b-4b5c-859a-c750c8fddf01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:33:39 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc39912-3066-40cb-b699-aaa4b72be78c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002] added
Jul 24 16:33:39 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fa7bb1-20ab-4799-acd0-259463ab5a32]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[702a5832-3353-47ec-b9b0-0a064fe7c695]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v itwbVsWJ {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v itwbVsWJ" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0462f9-bb99-4ba7-9dac-ed32b8aeeb00]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'itwbVsWJ'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[747c43be-92a6-4c2d-b09d-ac9225d56424]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec2b97e-79c9-4726-ac15-80c234b88d7b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 16:33:39 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 16:33:39 user nova-compute[70243]:  {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:33:39 user nova-compute[70243]: WARNING os_brick.initiator.connectors.iscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 16:33:39 user nova-compute[70243]: 
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[452cb1f2-8e8b-4cff-996f-ca14c6c84dbd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002, portal: 172.16.0.220,3260]
Jul 24 16:33:39 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002, portal: 172.16.0.220,3260] successful.
Jul 24 16:33:39 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37a3ca9-01ff-48a1-b4fc-e923a3471915]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12b587b-50ca-4714-acbe-f2dc9228a3e8]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 (non-flash)
Jul 24 16:33:39 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 (non-flash)
Jul 24 16:33:39 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9859fcac-036f-4ea6-9ba0-97b27bad68f6]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'itwbVsWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:33:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:33:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23931373733633237', 'path': '/dev/sdb'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:33:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931373733633237', 'path': '/dev/sdb'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:33:40 user nova-compute[70243]: DEBUG nova.objects.instance [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lazy-loading 'flavor' on Instance uuid 8fe2f619-2090-4653-96ab-937e0438a319 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:33:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:33:40 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:33:40 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:33:40 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:33:40 user nova-compute[70243]:   <serial>2c50614b-848e-4fae-825d-b0cb24d69002</serial>
Jul 24 16:33:40 user nova-compute[70243]: </disk>
Jul 24 16:33:40 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:33:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:33:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:33:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] No VIF found with MAC fa:16:3e:e8:f5:92, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:33:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4c82d660-8db8-44c6-a1fe-d3a20426b04e tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "8fe2f619-2090-4653-96ab-937e0438a319" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.305s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "8fe2f619-2090-4653-96ab-937e0438a319" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "8fe2f619-2090-4653-96ab-937e0438a319" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:33:42 user nova-compute[70243]: INFO nova.compute.manager [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Detaching volume 2c50614b-848e-4fae-825d-b0cb24d69002
Jul 24 16:33:42 user nova-compute[70243]: INFO nova.virt.block_device [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Attempting to driver detach volume 2c50614b-848e-4fae-825d-b0cb24d69002 from mountpoint /dev/vdb
Jul 24 16:33:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Attempting to detach device vdb from instance 8fe2f619-2090-4653-96ab-937e0438a319 from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:33:42 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:33:42 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:33:42 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:33:42 user nova-compute[70243]:   <serial>2c50614b-848e-4fae-825d-b0cb24d69002</serial>
Jul 24 16:33:42 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:33:42 user nova-compute[70243]: </disk>
Jul 24 16:33:42 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:33:42 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Successfully detached device vdb from instance 8fe2f619-2090-4653-96ab-937e0438a319 from the persistent domain config.
Jul 24 16:33:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8fe2f619-2090-4653-96ab-937e0438a319 from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:33:42 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:33:42 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:33:42 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:33:42 user nova-compute[70243]:   <serial>2c50614b-848e-4fae-825d-b0cb24d69002</serial>
Jul 24 16:33:42 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:33:42 user nova-compute[70243]: </disk>
Jul 24 16:33:42 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690216422.669554, 8fe2f619-2090-4653-96ab-937e0438a319 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8fe2f619-2090-4653-96ab-937e0438a319 {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:33:42 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Successfully detached device vdb from instance 8fe2f619-2090-4653-96ab-937e0438a319 from the live domain config.
Jul 24 16:33:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'itwbVsWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:33:42 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:33:42 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80dcd3a-446e-4809-ad64-bf92627c4baa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:33:42 user nova-compute[70243]: No targets found.
Jul 24 16:33:42 user nova-compute[70243]: iSNS:
Jul 24 16:33:42 user nova-compute[70243]: No targets found.
Jul 24 16:33:42 user nova-compute[70243]: STATIC:
Jul 24 16:33:42 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002
Jul 24 16:33:42 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:33:42 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:33:42 user nova-compute[70243]: FIRMWARE:
Jul 24 16:33:42 user nova-compute[70243]: No targets found.
Jul 24 16:33:42 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:33:42 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:33:42 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[febebb0c-020b-4047-b83d-35c659826577]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1ad12b-96fd-41ff-8a72-55e37055407b]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 (non-flash)
Jul 24 16:33:42 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 (non-flash)
Jul 24 16:33:42 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc6120e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002'): ({'sdb'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Removing single pathed devices sdb {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[359f3596-e1b4-46ec-8a95-6b24c5687cab]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7fc6e8-7b58-44b6-868c-f1d05b195a24]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Flushing IO for device /dev/sdb {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a0b507-1aa6-47af-bb84-dfa8c840c014]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6c4614-f70e-4306-8744-61d298f11258]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5e7c1a-01b3-4231-9f68-67ce45c95c6f]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e26f75-6781-49ef-866f-c0198f29b29e]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002, portal: 172.16.0.220,3260]
Jul 24 16:33:42 user nova-compute[70243]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002, portal: 172.16.0.220,3260] successful.
Jul 24 16:33:42 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c50614b-848e-4fae-825d-b0cb24d69002 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f134c19e-7952-4f4f-8859-39f21850cf5d]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] <== disconnect_volume: return (305ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:33:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:33:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:43 user nova-compute[70243]: DEBUG nova.objects.instance [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lazy-loading 'flavor' on Instance uuid 8fe2f619-2090-4653-96ab-937e0438a319 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:33:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d33cbd32-40aa-4506-8985-17f0523292e1 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "8fe2f619-2090-4653-96ab-937e0438a319" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.589s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:33:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:33:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:48 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:33:48 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:33:48 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:33:52 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:33:52 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70243) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 16:33:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:53 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:33:53 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:33:54 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:33:55 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:33:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:33:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Didn't find any instances for network info cache update. {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 16:33:55 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:33:55 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:33:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:33:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:33:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:33:55 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:33:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:33:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:33:57 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:33:57 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:33:57 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8300MB free_disk=24.345115661621094GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:33:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:33:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:33:57 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance de22ea98-b041-4f3f-8986-435c43267a2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:33:57 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 50fecb3a-8f06-4822-8c84-76df51acfe50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:33:57 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6f2258de-6b31-48af-81df-37b64da4ca99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:33:57 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8fe2f619-2090-4653-96ab-937e0438a319 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:33:57 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:33:57 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:33:57 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:33:57 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:33:57 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:33:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:33:57 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:33:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:33:59 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:34:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Acquiring lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:34:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:01 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:34:01 user nova-compute[70243]: INFO nova.compute.claims [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Claim successful on node user
Jul 24 16:34:01 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:34:01 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:34:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:34:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:34:01 user nova-compute[70243]: DEBUG nova.network.neutron [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:34:01 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:34:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:34:01 user nova-compute[70243]: DEBUG nova.policy [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb51eee63719438daaf0a9575f518068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9902b100289b42d4b8202bc3f46cbb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:34:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:34:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:34:01 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Creating image(s)
Jul 24 16:34:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Acquiring lock "/opt/stack/data/nova/instances/05bfd953-bb4b-4eaf-a304-ccb040d8f429/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Lock "/opt/stack/data/nova/instances/05bfd953-bb4b-4eaf-a304-ccb040d8f429/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Lock "/opt/stack/data/nova/instances/05bfd953-bb4b-4eaf-a304-ccb040d8f429/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.131s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.129s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/05bfd953-bb4b-4eaf-a304-ccb040d8f429/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/05bfd953-bb4b-4eaf-a304-ccb040d8f429/disk 1073741824" returned: 0 in 0.049s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:02 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05bfd953-bb4b-4eaf-a304-ccb040d8f429/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:34:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bfd953-bb4b-4eaf-a304-ccb040d8f429/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bfd953-bb4b-4eaf-a304-ccb040d8f429/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:02 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Cannot resize image /opt/stack/data/nova/instances/05bfd953-bb4b-4eaf-a304-ccb040d8f429/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:34:02 user nova-compute[70243]: DEBUG nova.objects.instance [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Lazy-loading 'migration_context' on Instance uuid 05bfd953-bb4b-4eaf-a304-ccb040d8f429 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:34:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:34:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Ensure instance console log exists: /opt/stack/data/nova/instances/05bfd953-bb4b-4eaf-a304-ccb040d8f429/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:34:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:02 user nova-compute[70243]: DEBUG nova.network.neutron [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Successfully created port: 94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:34:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:34:03 user nova-compute[70243]: DEBUG nova.network.neutron [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Successfully updated port: 94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:34:03 user nova-compute[70243]: DEBUG nova.compute.manager [req-2a210080-5cd9-4a19-a71a-8822e813921e req-3b4b1bb0-961b-498f-a873-9dc18733e604 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Received event network-changed-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:34:03 user nova-compute[70243]: DEBUG nova.compute.manager [req-2a210080-5cd9-4a19-a71a-8822e813921e req-3b4b1bb0-961b-498f-a873-9dc18733e604 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Refreshing instance network info cache due to event network-changed-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:34:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2a210080-5cd9-4a19-a71a-8822e813921e req-3b4b1bb0-961b-498f-a873-9dc18733e604 service nova] Acquiring lock "refresh_cache-05bfd953-bb4b-4eaf-a304-ccb040d8f429" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:34:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2a210080-5cd9-4a19-a71a-8822e813921e req-3b4b1bb0-961b-498f-a873-9dc18733e604 service nova] Acquired lock "refresh_cache-05bfd953-bb4b-4eaf-a304-ccb040d8f429" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:34:03 user nova-compute[70243]: DEBUG nova.network.neutron [req-2a210080-5cd9-4a19-a71a-8822e813921e req-3b4b1bb0-961b-498f-a873-9dc18733e604 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Refreshing network info cache for port 94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:34:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Acquiring lock "refresh_cache-05bfd953-bb4b-4eaf-a304-ccb040d8f429" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:34:03 user nova-compute[70243]: DEBUG nova.network.neutron [req-2a210080-5cd9-4a19-a71a-8822e813921e req-3b4b1bb0-961b-498f-a873-9dc18733e604 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:34:03 user nova-compute[70243]: DEBUG nova.network.neutron [req-2a210080-5cd9-4a19-a71a-8822e813921e req-3b4b1bb0-961b-498f-a873-9dc18733e604 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:34:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2a210080-5cd9-4a19-a71a-8822e813921e req-3b4b1bb0-961b-498f-a873-9dc18733e604 service nova] Releasing lock "refresh_cache-05bfd953-bb4b-4eaf-a304-ccb040d8f429" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:34:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Acquired lock "refresh_cache-05bfd953-bb4b-4eaf-a304-ccb040d8f429" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:34:03 user nova-compute[70243]: DEBUG nova.network.neutron [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:34:03 user nova-compute[70243]: DEBUG nova.network.neutron [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.network.neutron [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Updating instance_info_cache with network_info: [{"id": "94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0", "address": "fa:16:3e:8b:1f:a1", "network": {"id": "9cb7b437-8cb6-4435-9d32-6ade2468c7fd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ea761b45d5e428287fb9fa480f5d4c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f5dae4-4b", "ovs_interfaceid": "94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Releasing lock "refresh_cache-05bfd953-bb4b-4eaf-a304-ccb040d8f429" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.compute.manager [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Instance network_info: |[{"id": "94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0", "address": "fa:16:3e:8b:1f:a1", "network": {"id": "9cb7b437-8cb6-4435-9d32-6ade2468c7fd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ea761b45d5e428287fb9fa480f5d4c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f5dae4-4b", "ovs_interfaceid": "94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Start _get_guest_xml network_info=[{"id": "94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0", "address": "fa:16:3e:8b:1f:a1", "network": {"id": "9cb7b437-8cb6-4435-9d32-6ade2468c7fd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ea761b45d5e428287fb9fa480f5d4c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f5dae4-4b", "ovs_interfaceid": "94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:34:04 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:34:04 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:34:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1463520658',display_name='tempest-VolumesNegativeTest-instance-1463520658',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1463520658',id=29,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9902b100289b42d4b8202bc3f46cbb2a',ramdisk_id='',reservation_id='r-4877am03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2096213440',owner_user_name='tempest-VolumesNegativeTest-2096213440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:34:02Z,user_data=None,user_id='cb51eee63719438daaf0a9575f518068',uuid=05bfd953-bb4b-4eaf-a304-ccb040d8f429,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0", "address": "fa:16:3e:8b:1f:a1", "network": {"id": "9cb7b437-8cb6-4435-9d32-6ade2468c7fd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ea761b45d5e428287fb9fa480f5d4c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f5dae4-4b", "ovs_interfaceid": "94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Converting VIF {"id": "94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0", "address": "fa:16:3e:8b:1f:a1", "network": {"id": "9cb7b437-8cb6-4435-9d32-6ade2468c7fd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ea761b45d5e428287fb9fa480f5d4c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f5dae4-4b", "ovs_interfaceid": "94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0,network=Network(9cb7b437-8cb6-4435-9d32-6ade2468c7fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f5dae4-4b') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.objects.instance [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Lazy-loading 'pci_devices' on Instance uuid 05bfd953-bb4b-4eaf-a304-ccb040d8f429 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Cleaning up deleted instances {{(pid=70243) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:34:04 user nova-compute[70243]:   <uuid>05bfd953-bb4b-4eaf-a304-ccb040d8f429</uuid>
Jul 24 16:34:04 user nova-compute[70243]:   <name>instance-0000001d</name>
Jul 24 16:34:04 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:34:04 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:34:04 user nova-compute[70243]:   <metadata>
Jul 24 16:34:04 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:34:04 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:34:04 user nova-compute[70243]:       <nova:name>tempest-VolumesNegativeTest-instance-1463520658</nova:name>
Jul 24 16:34:04 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:34:04</nova:creationTime>
Jul 24 16:34:04 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:34:04 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:34:04 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:34:04 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:34:04 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:34:04 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:34:04 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:34:04 user nova-compute[70243]:       <nova:owner>
Jul 24 16:34:04 user nova-compute[70243]:         <nova:user uuid="cb51eee63719438daaf0a9575f518068">tempest-VolumesNegativeTest-2096213440-project-member</nova:user>
Jul 24 16:34:04 user nova-compute[70243]:         <nova:project uuid="9902b100289b42d4b8202bc3f46cbb2a">tempest-VolumesNegativeTest-2096213440</nova:project>
Jul 24 16:34:04 user nova-compute[70243]:       </nova:owner>
Jul 24 16:34:04 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:34:04 user nova-compute[70243]:       <nova:ports>
Jul 24 16:34:04 user nova-compute[70243]:         <nova:port uuid="94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0">
Jul 24 16:34:04 user nova-compute[70243]:           <nova:ip type="fixed" address="192.168.233.99" ipVersion="4"/>
Jul 24 16:34:04 user nova-compute[70243]:         </nova:port>
Jul 24 16:34:04 user nova-compute[70243]:       </nova:ports>
Jul 24 16:34:04 user nova-compute[70243]:     </nova:instance>
Jul 24 16:34:04 user nova-compute[70243]:   </metadata>
Jul 24 16:34:04 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:34:04 user nova-compute[70243]:     <system>
Jul 24 16:34:04 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:34:04 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:34:04 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:34:04 user nova-compute[70243]:       <entry name="serial">05bfd953-bb4b-4eaf-a304-ccb040d8f429</entry>
Jul 24 16:34:04 user nova-compute[70243]:       <entry name="uuid">05bfd953-bb4b-4eaf-a304-ccb040d8f429</entry>
Jul 24 16:34:04 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:34:04 user nova-compute[70243]:     </system>
Jul 24 16:34:04 user nova-compute[70243]:   </sysinfo>
Jul 24 16:34:04 user nova-compute[70243]:   <os>
Jul 24 16:34:04 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:34:04 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:34:04 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:34:04 user nova-compute[70243]:   </os>
Jul 24 16:34:04 user nova-compute[70243]:   <features>
Jul 24 16:34:04 user nova-compute[70243]:     <acpi/>
Jul 24 16:34:04 user nova-compute[70243]:     <apic/>
Jul 24 16:34:04 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:34:04 user nova-compute[70243]:   </features>
Jul 24 16:34:04 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:34:04 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:34:04 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:34:04 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:34:04 user nova-compute[70243]:   </clock>
Jul 24 16:34:04 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:34:04 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:34:04 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:34:04 user nova-compute[70243]:   </cpu>
Jul 24 16:34:04 user nova-compute[70243]:   <devices>
Jul 24 16:34:04 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:34:04 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:34:04 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/05bfd953-bb4b-4eaf-a304-ccb040d8f429/disk"/>
Jul 24 16:34:04 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:34:04 user nova-compute[70243]:     </disk>
Jul 24 16:34:04 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:34:04 user nova-compute[70243]:       <mac address="fa:16:3e:8b:1f:a1"/>
Jul 24 16:34:04 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:34:04 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:34:04 user nova-compute[70243]:       <target dev="tap94f5dae4-4b"/>
Jul 24 16:34:04 user nova-compute[70243]:     </interface>
Jul 24 16:34:04 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:34:04 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/05bfd953-bb4b-4eaf-a304-ccb040d8f429/console.log" append="off"/>
Jul 24 16:34:04 user nova-compute[70243]:     </serial>
Jul 24 16:34:04 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:34:04 user nova-compute[70243]:     <video>
Jul 24 16:34:04 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:34:04 user nova-compute[70243]:     </video>
Jul 24 16:34:04 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:34:04 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:34:04 user nova-compute[70243]:     </rng>
Jul 24 16:34:04 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:34:04 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:34:04 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:34:04 user nova-compute[70243]:     </memballoon>
Jul 24 16:34:04 user nova-compute[70243]:   </devices>
Jul 24 16:34:04 user nova-compute[70243]: </domain>
Jul 24 16:34:04 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:34:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1463520658',display_name='tempest-VolumesNegativeTest-instance-1463520658',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1463520658',id=29,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9902b100289b42d4b8202bc3f46cbb2a',ramdisk_id='',reservation_id='r-4877am03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2096213440',owner_user_name='tempest-VolumesNegativeTest-2096213440-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:34:02Z,user_data=None,user_id='cb51eee63719438daaf0a9575f518068',uuid=05bfd953-bb4b-4eaf-a304-ccb040d8f429,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0", "address": "fa:16:3e:8b:1f:a1", "network": {"id": "9cb7b437-8cb6-4435-9d32-6ade2468c7fd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ea761b45d5e428287fb9fa480f5d4c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f5dae4-4b", "ovs_interfaceid": "94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Converting VIF {"id": "94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0", "address": "fa:16:3e:8b:1f:a1", "network": {"id": "9cb7b437-8cb6-4435-9d32-6ade2468c7fd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ea761b45d5e428287fb9fa480f5d4c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f5dae4-4b", "ovs_interfaceid": "94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0,network=Network(9cb7b437-8cb6-4435-9d32-6ade2468c7fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f5dae4-4b') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG os_vif [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0,network=Network(9cb7b437-8cb6-4435-9d32-6ade2468c7fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f5dae4-4b') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94f5dae4-4b, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94f5dae4-4b, col_values=(('external_ids', {'iface-id': '94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:1f:a1', 'vm-uuid': '05bfd953-bb4b-4eaf-a304-ccb040d8f429'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] There are 0 instances to clean {{(pid=70243) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:04 user nova-compute[70243]: INFO os_vif [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0,network=Network(9cb7b437-8cb6-4435-9d32-6ade2468c7fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f5dae4-4b')
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] No VIF found with MAC fa:16:3e:8b:1f:a1, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:34:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-13954745-0ceb-48af-8ece-a16b45a36725 req-a752facd-ff58-4c8f-9978-d0e5c156fefd service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Received event network-vif-plugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:34:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-13954745-0ceb-48af-8ece-a16b45a36725 req-a752facd-ff58-4c8f-9978-d0e5c156fefd service nova] Acquiring lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-13954745-0ceb-48af-8ece-a16b45a36725 req-a752facd-ff58-4c8f-9978-d0e5c156fefd service nova] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-13954745-0ceb-48af-8ece-a16b45a36725 req-a752facd-ff58-4c8f-9978-d0e5c156fefd service nova] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-13954745-0ceb-48af-8ece-a16b45a36725 req-a752facd-ff58-4c8f-9978-d0e5c156fefd service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] No waiting events found dispatching network-vif-plugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:34:05 user nova-compute[70243]: WARNING nova.compute.manager [req-13954745-0ceb-48af-8ece-a16b45a36725 req-a752facd-ff58-4c8f-9978-d0e5c156fefd service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Received unexpected event network-vif-plugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 for instance with vm_state building and task_state spawning.
Jul 24 16:34:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:07 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216447.705795, 05bfd953-bb4b-4eaf-a304-ccb040d8f429 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:34:07 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] VM Resumed (Lifecycle Event)
Jul 24 16:34:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:34:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:34:07 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Instance spawned successfully.
Jul 24 16:34:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:34:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:34:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:34:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:34:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:34:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:34:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:34:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:34:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:34:07 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:34:07 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216447.710695, 05bfd953-bb4b-4eaf-a304-ccb040d8f429 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:34:07 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] VM Started (Lifecycle Event)
Jul 24 16:34:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:34:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:34:07 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:34:07 user nova-compute[70243]: INFO nova.compute.manager [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Took 5.86 seconds to spawn the instance on the hypervisor.
Jul 24 16:34:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:34:07 user nova-compute[70243]: INFO nova.compute.manager [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Took 6.53 seconds to build instance.
Jul 24 16:34:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc54fbb5-e391-43e3-b394-395ea14ed12e tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.628s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:07 user nova-compute[70243]: DEBUG nova.compute.manager [req-7c7ce9b2-78d0-456d-a38f-c6376544ffcf req-53462f8c-863b-443a-a179-0e4e305eff31 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Received event network-vif-plugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:34:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7c7ce9b2-78d0-456d-a38f-c6376544ffcf req-53462f8c-863b-443a-a179-0e4e305eff31 service nova] Acquiring lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7c7ce9b2-78d0-456d-a38f-c6376544ffcf req-53462f8c-863b-443a-a179-0e4e305eff31 service nova] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7c7ce9b2-78d0-456d-a38f-c6376544ffcf req-53462f8c-863b-443a-a179-0e4e305eff31 service nova] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:07 user nova-compute[70243]: DEBUG nova.compute.manager [req-7c7ce9b2-78d0-456d-a38f-c6376544ffcf req-53462f8c-863b-443a-a179-0e4e305eff31 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] No waiting events found dispatching network-vif-plugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:34:07 user nova-compute[70243]: WARNING nova.compute.manager [req-7c7ce9b2-78d0-456d-a38f-c6376544ffcf req-53462f8c-863b-443a-a179-0e4e305eff31 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Received unexpected event network-vif-plugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 for instance with vm_state active and task_state None.
Jul 24 16:34:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "0cceb071-c478-4914-8243-77c3efbdb5d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:14 user nova-compute[70243]: DEBUG nova.compute.manager [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:34:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:14 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:34:14 user nova-compute[70243]: INFO nova.compute.claims [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Claim successful on node user
Jul 24 16:34:15 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:34:15 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:34:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:34:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:34:15 user nova-compute[70243]: DEBUG nova.network.neutron [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:34:15 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:34:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:34:15 user nova-compute[70243]: DEBUG nova.policy [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fcb7fb5c11bb4d65b9c39923840685c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c25474ae9fb49cb92c611e77f2dbc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:34:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:34:15 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:34:15 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Creating image(s)
Jul 24 16:34:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "/opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "/opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "/opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.154s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.152s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk 1073741824" returned: 0 in 0.054s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.150s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:16 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:34:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:16 user nova-compute[70243]: DEBUG nova.network.neutron [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Successfully created port: 31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:34:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:16 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Cannot resize image /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:34:16 user nova-compute[70243]: DEBUG nova.objects.instance [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'migration_context' on Instance uuid 0cceb071-c478-4914-8243-77c3efbdb5d3 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:34:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:34:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Ensure instance console log exists: /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:34:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:18 user nova-compute[70243]: DEBUG nova.network.neutron [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Successfully updated port: 31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:34:18 user nova-compute[70243]: DEBUG nova.compute.manager [req-f39819af-666e-4b11-855c-5243239dd697 req-10827a69-7e2e-486f-b7b1-527f3f1478c3 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received event network-changed-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:34:18 user nova-compute[70243]: DEBUG nova.compute.manager [req-f39819af-666e-4b11-855c-5243239dd697 req-10827a69-7e2e-486f-b7b1-527f3f1478c3 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Refreshing instance network info cache due to event network-changed-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:34:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f39819af-666e-4b11-855c-5243239dd697 req-10827a69-7e2e-486f-b7b1-527f3f1478c3 service nova] Acquiring lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:34:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f39819af-666e-4b11-855c-5243239dd697 req-10827a69-7e2e-486f-b7b1-527f3f1478c3 service nova] Acquired lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:34:18 user nova-compute[70243]: DEBUG nova.network.neutron [req-f39819af-666e-4b11-855c-5243239dd697 req-10827a69-7e2e-486f-b7b1-527f3f1478c3 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Refreshing network info cache for port 31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:34:18 user nova-compute[70243]: DEBUG nova.network.neutron [req-f39819af-666e-4b11-855c-5243239dd697 req-10827a69-7e2e-486f-b7b1-527f3f1478c3 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:34:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:34:18 user nova-compute[70243]: DEBUG nova.network.neutron [req-f39819af-666e-4b11-855c-5243239dd697 req-10827a69-7e2e-486f-b7b1-527f3f1478c3 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:34:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f39819af-666e-4b11-855c-5243239dd697 req-10827a69-7e2e-486f-b7b1-527f3f1478c3 service nova] Releasing lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:34:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquired lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:34:18 user nova-compute[70243]: DEBUG nova.network.neutron [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:34:18 user nova-compute[70243]: DEBUG nova.network.neutron [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.network.neutron [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Updating instance_info_cache with network_info: [{"id": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "address": "fa:16:3e:46:16:b8", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e9e4c6-7d", "ovs_interfaceid": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Releasing lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.compute.manager [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Instance network_info: |[{"id": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "address": "fa:16:3e:46:16:b8", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e9e4c6-7d", "ovs_interfaceid": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Start _get_guest_xml network_info=[{"id": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "address": "fa:16:3e:46:16:b8", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e9e4c6-7d", "ovs_interfaceid": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:34:19 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:34:19 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:34:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-674586026',display_name='tempest-ServerRescueNegativeTestJSON-server-674586026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-674586026',id=30,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuU6JYcS7LI0dMV51kZaOp9oaBO7Yr+j/yzhEYlC/QFScz4HdKIfkBYKmCyDus2pxFhM6QsjAcT5q3iW8P89kzGFTNoGUkewoJ2IFeiomz5ox1neIK2P3bIiJHIeWHoXg==',key_name='tempest-keypair-2085747341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c25474ae9fb49cb92c611e77f2dbc79',ramdisk_id='',reservation_id='r-3rqt6k04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1414931075',owner_user_name='tempest-ServerRescueNegativeTestJSON-1414931075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:34:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcb7fb5c11bb4d65b9c39923840685c6',uuid=0cceb071-c478-4914-8243-77c3efbdb5d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "address": "fa:16:3e:46:16:b8", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e9e4c6-7d", "ovs_interfaceid": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converting VIF {"id": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "address": "fa:16:3e:46:16:b8", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e9e4c6-7d", "ovs_interfaceid": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:16:b8,bridge_name='br-int',has_traffic_filtering=True,id=31e9e4c6-7d4c-4077-a725-02e3b9f6f61a,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e9e4c6-7d') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.objects.instance [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'pci_devices' on Instance uuid 0cceb071-c478-4914-8243-77c3efbdb5d3 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "de22ea98-b041-4f3f-8986-435c43267a2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "de22ea98-b041-4f3f-8986-435c43267a2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:19 user nova-compute[70243]: INFO nova.compute.manager [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Terminating instance
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.compute.manager [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:34:19 user nova-compute[70243]:   <uuid>0cceb071-c478-4914-8243-77c3efbdb5d3</uuid>
Jul 24 16:34:19 user nova-compute[70243]:   <name>instance-0000001e</name>
Jul 24 16:34:19 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:34:19 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:34:19 user nova-compute[70243]:   <metadata>
Jul 24 16:34:19 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:34:19 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:34:19 user nova-compute[70243]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-674586026</nova:name>
Jul 24 16:34:19 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:34:19</nova:creationTime>
Jul 24 16:34:19 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:34:19 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:34:19 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:34:19 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:34:19 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:34:19 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:34:19 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:34:19 user nova-compute[70243]:       <nova:owner>
Jul 24 16:34:19 user nova-compute[70243]:         <nova:user uuid="fcb7fb5c11bb4d65b9c39923840685c6">tempest-ServerRescueNegativeTestJSON-1414931075-project-member</nova:user>
Jul 24 16:34:19 user nova-compute[70243]:         <nova:project uuid="9c25474ae9fb49cb92c611e77f2dbc79">tempest-ServerRescueNegativeTestJSON-1414931075</nova:project>
Jul 24 16:34:19 user nova-compute[70243]:       </nova:owner>
Jul 24 16:34:19 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:34:19 user nova-compute[70243]:       <nova:ports>
Jul 24 16:34:19 user nova-compute[70243]:         <nova:port uuid="31e9e4c6-7d4c-4077-a725-02e3b9f6f61a">
Jul 24 16:34:19 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 24 16:34:19 user nova-compute[70243]:         </nova:port>
Jul 24 16:34:19 user nova-compute[70243]:       </nova:ports>
Jul 24 16:34:19 user nova-compute[70243]:     </nova:instance>
Jul 24 16:34:19 user nova-compute[70243]:   </metadata>
Jul 24 16:34:19 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:34:19 user nova-compute[70243]:     <system>
Jul 24 16:34:19 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:34:19 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:34:19 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:34:19 user nova-compute[70243]:       <entry name="serial">0cceb071-c478-4914-8243-77c3efbdb5d3</entry>
Jul 24 16:34:19 user nova-compute[70243]:       <entry name="uuid">0cceb071-c478-4914-8243-77c3efbdb5d3</entry>
Jul 24 16:34:19 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:34:19 user nova-compute[70243]:     </system>
Jul 24 16:34:19 user nova-compute[70243]:   </sysinfo>
Jul 24 16:34:19 user nova-compute[70243]:   <os>
Jul 24 16:34:19 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:34:19 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:34:19 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:34:19 user nova-compute[70243]:   </os>
Jul 24 16:34:19 user nova-compute[70243]:   <features>
Jul 24 16:34:19 user nova-compute[70243]:     <acpi/>
Jul 24 16:34:19 user nova-compute[70243]:     <apic/>
Jul 24 16:34:19 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:34:19 user nova-compute[70243]:   </features>
Jul 24 16:34:19 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:34:19 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:34:19 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:34:19 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:34:19 user nova-compute[70243]:   </clock>
Jul 24 16:34:19 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:34:19 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:34:19 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:34:19 user nova-compute[70243]:   </cpu>
Jul 24 16:34:19 user nova-compute[70243]:   <devices>
Jul 24 16:34:19 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:34:19 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:34:19 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk"/>
Jul 24 16:34:19 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:34:19 user nova-compute[70243]:     </disk>
Jul 24 16:34:19 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:34:19 user nova-compute[70243]:       <mac address="fa:16:3e:46:16:b8"/>
Jul 24 16:34:19 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:34:19 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:34:19 user nova-compute[70243]:       <target dev="tap31e9e4c6-7d"/>
Jul 24 16:34:19 user nova-compute[70243]:     </interface>
Jul 24 16:34:19 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:34:19 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/console.log" append="off"/>
Jul 24 16:34:19 user nova-compute[70243]:     </serial>
Jul 24 16:34:19 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:34:19 user nova-compute[70243]:     <video>
Jul 24 16:34:19 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:34:19 user nova-compute[70243]:     </video>
Jul 24 16:34:19 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:34:19 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:34:19 user nova-compute[70243]:     </rng>
Jul 24 16:34:19 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:34:19 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:34:19 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:34:19 user nova-compute[70243]:     </memballoon>
Jul 24 16:34:19 user nova-compute[70243]:   </devices>
Jul 24 16:34:19 user nova-compute[70243]: </domain>
Jul 24 16:34:19 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:34:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-674586026',display_name='tempest-ServerRescueNegativeTestJSON-server-674586026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-674586026',id=30,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuU6JYcS7LI0dMV51kZaOp9oaBO7Yr+j/yzhEYlC/QFScz4HdKIfkBYKmCyDus2pxFhM6QsjAcT5q3iW8P89kzGFTNoGUkewoJ2IFeiomz5ox1neIK2P3bIiJHIeWHoXg==',key_name='tempest-keypair-2085747341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c25474ae9fb49cb92c611e77f2dbc79',ramdisk_id='',reservation_id='r-3rqt6k04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1414931075',owner_user_name='tempest-ServerRescueNegativeTestJSON-1414931075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:34:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcb7fb5c11bb4d65b9c39923840685c6',uuid=0cceb071-c478-4914-8243-77c3efbdb5d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "address": "fa:16:3e:46:16:b8", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e9e4c6-7d", "ovs_interfaceid": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converting VIF {"id": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "address": "fa:16:3e:46:16:b8", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e9e4c6-7d", "ovs_interfaceid": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:16:b8,bridge_name='br-int',has_traffic_filtering=True,id=31e9e4c6-7d4c-4077-a725-02e3b9f6f61a,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e9e4c6-7d') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG os_vif [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:16:b8,bridge_name='br-int',has_traffic_filtering=True,id=31e9e4c6-7d4c-4077-a725-02e3b9f6f61a,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e9e4c6-7d') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31e9e4c6-7d, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31e9e4c6-7d, col_values=(('external_ids', {'iface-id': '31e9e4c6-7d4c-4077-a725-02e3b9f6f61a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:16:b8', 'vm-uuid': '0cceb071-c478-4914-8243-77c3efbdb5d3'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:19 user nova-compute[70243]: INFO os_vif [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:16:b8,bridge_name='br-int',has_traffic_filtering=True,id=31e9e4c6-7d4c-4077-a725-02e3b9f6f61a,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e9e4c6-7d')
Jul 24 16:34:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] No VIF found with MAC fa:16:3e:46:16:b8, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-fdec311a-6566-4e21-9065-419a9139f886 req-3cc49e77-c8d1-41ea-ad3b-d4ed6ba3558b service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Received event network-vif-unplugged-e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fdec311a-6566-4e21-9065-419a9139f886 req-3cc49e77-c8d1-41ea-ad3b-d4ed6ba3558b service nova] Acquiring lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fdec311a-6566-4e21-9065-419a9139f886 req-3cc49e77-c8d1-41ea-ad3b-d4ed6ba3558b service nova] Lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fdec311a-6566-4e21-9065-419a9139f886 req-3cc49e77-c8d1-41ea-ad3b-d4ed6ba3558b service nova] Lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-fdec311a-6566-4e21-9065-419a9139f886 req-3cc49e77-c8d1-41ea-ad3b-d4ed6ba3558b service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] No waiting events found dispatching network-vif-unplugged-e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:34:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-fdec311a-6566-4e21-9065-419a9139f886 req-3cc49e77-c8d1-41ea-ad3b-d4ed6ba3558b service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Received event network-vif-unplugged-e709e269-eff5-4ac2-8c2a-29048448a422 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:34:21 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Instance destroyed successfully.
Jul 24 16:34:21 user nova-compute[70243]: DEBUG nova.objects.instance [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lazy-loading 'resources' on Instance uuid de22ea98-b041-4f3f-8986-435c43267a2e {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:34:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T16:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-318401571',display_name='tempest-ServerActionsTestOtherA-server-2125239384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-318401571',id=2,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNt4ywOtyDbY3gzVxioiadq0RHvp3ujVzU7+egeM9QHVtvP6DGqg4hSRwxq8r4OyAFnfBqKPWEeStDLSLwfjx+5dISRxZesWLAiccd5P+5WMBwka91+aa63O7dxU+RVwA==',key_name='tempest-keypair-283031417',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:22:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebdb3cb079814db091227f80b2ed1b9d',ramdisk_id='',reservation_id='r-fjhaudds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-39125821',owner_user_name='tempest-ServerActionsTestOtherA-39125821-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:22:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa3936255d31421184e585e2fd17d7ef',uuid=de22ea98-b041-4f3f-8986-435c43267a2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e709e269-eff5-4ac2-8c2a-29048448a422", "address": "fa:16:3e:0a:84:99", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape709e269-ef", "ovs_interfaceid": "e709e269-eff5-4ac2-8c2a-29048448a422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:34:21 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converting VIF {"id": "e709e269-eff5-4ac2-8c2a-29048448a422", "address": "fa:16:3e:0a:84:99", "network": {"id": "01ee5772-e76d-4c85-a817-458760d0f2cd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-757960214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebdb3cb079814db091227f80b2ed1b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape709e269-ef", "ovs_interfaceid": "e709e269-eff5-4ac2-8c2a-29048448a422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:34:21 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:84:99,bridge_name='br-int',has_traffic_filtering=True,id=e709e269-eff5-4ac2-8c2a-29048448a422,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape709e269-ef') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:34:21 user nova-compute[70243]: DEBUG os_vif [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:84:99,bridge_name='br-int',has_traffic_filtering=True,id=e709e269-eff5-4ac2-8c2a-29048448a422,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape709e269-ef') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:34:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape709e269-ef, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:34:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:34:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:21 user nova-compute[70243]: INFO os_vif [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:84:99,bridge_name='br-int',has_traffic_filtering=True,id=e709e269-eff5-4ac2-8c2a-29048448a422,network=Network(01ee5772-e76d-4c85-a817-458760d0f2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape709e269-ef')
Jul 24 16:34:21 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Deleting instance files /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e_del
Jul 24 16:34:21 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Deletion of /opt/stack/data/nova/instances/de22ea98-b041-4f3f-8986-435c43267a2e_del complete
Jul 24 16:34:21 user nova-compute[70243]: INFO nova.compute.manager [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Took 1.79 seconds to destroy the instance on the hypervisor.
Jul 24 16:34:21 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:34:21 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:34:21 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:34:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:21 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:34:21 user nova-compute[70243]: DEBUG nova.compute.manager [req-12e2523b-d211-4e9f-ba81-c9dc8e603f1f req-74ddc867-27a4-4785-9478-cdc018d29e49 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received event network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:34:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-12e2523b-d211-4e9f-ba81-c9dc8e603f1f req-74ddc867-27a4-4785-9478-cdc018d29e49 service nova] Acquiring lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-12e2523b-d211-4e9f-ba81-c9dc8e603f1f req-74ddc867-27a4-4785-9478-cdc018d29e49 service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-12e2523b-d211-4e9f-ba81-c9dc8e603f1f req-74ddc867-27a4-4785-9478-cdc018d29e49 service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:21 user nova-compute[70243]: DEBUG nova.compute.manager [req-12e2523b-d211-4e9f-ba81-c9dc8e603f1f req-74ddc867-27a4-4785-9478-cdc018d29e49 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] No waiting events found dispatching network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:34:21 user nova-compute[70243]: WARNING nova.compute.manager [req-12e2523b-d211-4e9f-ba81-c9dc8e603f1f req-74ddc867-27a4-4785-9478-cdc018d29e49 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received unexpected event network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a for instance with vm_state building and task_state spawning.
Jul 24 16:34:22 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Took 0.70 seconds to deallocate network for instance.
Jul 24 16:34:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-1ecdceb9-e0b4-410e-88f2-c4f63d4aa733 req-5f119121-01f7-4e7a-9786-5e732ecaaa14 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Received event network-vif-plugged-e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:34:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1ecdceb9-e0b4-410e-88f2-c4f63d4aa733 req-5f119121-01f7-4e7a-9786-5e732ecaaa14 service nova] Acquiring lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1ecdceb9-e0b4-410e-88f2-c4f63d4aa733 req-5f119121-01f7-4e7a-9786-5e732ecaaa14 service nova] Lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1ecdceb9-e0b4-410e-88f2-c4f63d4aa733 req-5f119121-01f7-4e7a-9786-5e732ecaaa14 service nova] Lock "de22ea98-b041-4f3f-8986-435c43267a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-1ecdceb9-e0b4-410e-88f2-c4f63d4aa733 req-5f119121-01f7-4e7a-9786-5e732ecaaa14 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] No waiting events found dispatching network-vif-plugged-e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:34:22 user nova-compute[70243]: WARNING nova.compute.manager [req-1ecdceb9-e0b4-410e-88f2-c4f63d4aa733 req-5f119121-01f7-4e7a-9786-5e732ecaaa14 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Received unexpected event network-vif-plugged-e709e269-eff5-4ac2-8c2a-29048448a422 for instance with vm_state active and task_state deleting.
Jul 24 16:34:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-7f7fac6a-802b-44e7-ac0b-7c44cf7f5770 req-cecbc8f8-3bfe-4e9a-96ae-f2878cc54146 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Received event network-vif-deleted-e709e269-eff5-4ac2-8c2a-29048448a422 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:34:22 user nova-compute[70243]: INFO nova.compute.manager [req-7f7fac6a-802b-44e7-ac0b-7c44cf7f5770 req-cecbc8f8-3bfe-4e9a-96ae-f2878cc54146 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Neutron deleted interface e709e269-eff5-4ac2-8c2a-29048448a422; detaching it from the instance and deleting it from the info cache
Jul 24 16:34:22 user nova-compute[70243]: DEBUG nova.network.neutron [req-7f7fac6a-802b-44e7-ac0b-7c44cf7f5770 req-cecbc8f8-3bfe-4e9a-96ae-f2878cc54146 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:34:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-7f7fac6a-802b-44e7-ac0b-7c44cf7f5770 req-cecbc8f8-3bfe-4e9a-96ae-f2878cc54146 service nova] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Detach interface failed, port_id=e709e269-eff5-4ac2-8c2a-29048448a422, reason: Instance de22ea98-b041-4f3f-8986-435c43267a2e could not be found. {{(pid=70243) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 16:34:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:22 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:34:22 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:34:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.475s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:22 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Deleted allocations for instance de22ea98-b041-4f3f-8986-435c43267a2e
Jul 24 16:34:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fa9bb016-3932-463e-9cc7-a66973dae6e2 tempest-ServerActionsTestOtherA-39125821 tempest-ServerActionsTestOtherA-39125821-project-member] Lock "de22ea98-b041-4f3f-8986-435c43267a2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.371s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-7c3c5771-e5a4-402f-8e2a-6f0e88f6d2d1 req-cb16e89f-7bc7-43bb-bb32-291febd82b57 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received event network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:34:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7c3c5771-e5a4-402f-8e2a-6f0e88f6d2d1 req-cb16e89f-7bc7-43bb-bb32-291febd82b57 service nova] Acquiring lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7c3c5771-e5a4-402f-8e2a-6f0e88f6d2d1 req-cb16e89f-7bc7-43bb-bb32-291febd82b57 service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7c3c5771-e5a4-402f-8e2a-6f0e88f6d2d1 req-cb16e89f-7bc7-43bb-bb32-291febd82b57 service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-7c3c5771-e5a4-402f-8e2a-6f0e88f6d2d1 req-cb16e89f-7bc7-43bb-bb32-291febd82b57 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] No waiting events found dispatching network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:34:24 user nova-compute[70243]: WARNING nova.compute.manager [req-7c3c5771-e5a4-402f-8e2a-6f0e88f6d2d1 req-cb16e89f-7bc7-43bb-bb32-291febd82b57 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received unexpected event network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a for instance with vm_state building and task_state spawning.
Jul 24 16:34:24 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216464.2358754, 0cceb071-c478-4914-8243-77c3efbdb5d3 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:34:24 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] VM Resumed (Lifecycle Event)
Jul 24 16:34:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:34:24 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:34:24 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Instance spawned successfully.
Jul 24 16:34:24 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:34:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:34:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:34:24 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:34:24 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:34:24 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:34:24 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:34:24 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:34:24 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:34:24 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:34:24 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216464.2418962, 0cceb071-c478-4914-8243-77c3efbdb5d3 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:34:24 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] VM Started (Lifecycle Event)
Jul 24 16:34:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:34:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:34:24 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:34:24 user nova-compute[70243]: INFO nova.compute.manager [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Took 8.82 seconds to spawn the instance on the hypervisor.
Jul 24 16:34:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:34:24 user nova-compute[70243]: INFO nova.compute.manager [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Took 9.64 seconds to build instance.
Jul 24 16:34:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cda617e8-af98-41c4-a446-3b0576fd2d0b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.769s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "8eb4450c-bf08-4949-a126-d30dbb3ea744" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:26 user nova-compute[70243]: INFO nova.compute.manager [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Unshelving
Jul 24 16:34:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:26 user nova-compute[70243]: DEBUG nova.objects.instance [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'pci_requests' on Instance uuid 8eb4450c-bf08-4949-a126-d30dbb3ea744 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:34:26 user nova-compute[70243]: DEBUG nova.objects.instance [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'numa_topology' on Instance uuid 8eb4450c-bf08-4949-a126-d30dbb3ea744 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:34:26 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:34:26 user nova-compute[70243]: INFO nova.compute.claims [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Claim successful on node user
Jul 24 16:34:27 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:34:27 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:34:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:27 user nova-compute[70243]: INFO nova.network.neutron [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Updating port 3053b7df-e393-4bc7-a17f-8983f22cdd96 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 24 16:34:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "refresh_cache-8eb4450c-bf08-4949-a126-d30dbb3ea744" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:34:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquired lock "refresh_cache-8eb4450c-bf08-4949-a126-d30dbb3ea744" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:34:28 user nova-compute[70243]: DEBUG nova.network.neutron [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:34:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-e8d614d5-b114-4340-8996-b1840053a3e4 req-af1e50da-ff02-442a-9883-eb19f2f1430a service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Received event network-changed-3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:34:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-e8d614d5-b114-4340-8996-b1840053a3e4 req-af1e50da-ff02-442a-9883-eb19f2f1430a service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Refreshing instance network info cache due to event network-changed-3053b7df-e393-4bc7-a17f-8983f22cdd96. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:34:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e8d614d5-b114-4340-8996-b1840053a3e4 req-af1e50da-ff02-442a-9883-eb19f2f1430a service nova] Acquiring lock "refresh_cache-8eb4450c-bf08-4949-a126-d30dbb3ea744" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:34:28 user nova-compute[70243]: DEBUG nova.network.neutron [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Updating instance_info_cache with network_info: [{"id": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "address": "fa:16:3e:ad:37:16", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3053b7df-e3", "ovs_interfaceid": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:34:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Releasing lock "refresh_cache-8eb4450c-bf08-4949-a126-d30dbb3ea744" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:34:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:34:28 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Creating image(s)
Jul 24 16:34:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "/opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "/opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "/opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:28 user nova-compute[70243]: DEBUG nova.objects.instance [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8eb4450c-bf08-4949-a126-d30dbb3ea744 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:34:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e8d614d5-b114-4340-8996-b1840053a3e4 req-af1e50da-ff02-442a-9883-eb19f2f1430a service nova] Acquired lock "refresh_cache-8eb4450c-bf08-4949-a126-d30dbb3ea744" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:34:28 user nova-compute[70243]: DEBUG nova.network.neutron [req-e8d614d5-b114-4340-8996-b1840053a3e4 req-af1e50da-ff02-442a-9883-eb19f2f1430a service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Refreshing network info cache for port 3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:34:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "dfcedca02bec0c0296ea0132613c0dad0cd08e41" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "dfcedca02bec0c0296ea0132613c0dad0cd08e41" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfcedca02bec0c0296ea0132613c0dad0cd08e41.part --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfcedca02bec0c0296ea0132613c0dad0cd08e41.part --force-share --output=json" returned: 0 in 0.161s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:29 user nova-compute[70243]: DEBUG nova.virt.images [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] eeb6bdd4-1dfe-45dc-8176-9bb81eaaa23c was qcow2, converting to raw {{(pid=70243) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 16:34:29 user nova-compute[70243]: DEBUG nova.privsep.utils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70243) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 16:34:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dfcedca02bec0c0296ea0132613c0dad0cd08e41.part /opt/stack/data/nova/instances/_base/dfcedca02bec0c0296ea0132613c0dad0cd08e41.converted {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:29 user nova-compute[70243]: DEBUG nova.network.neutron [req-e8d614d5-b114-4340-8996-b1840053a3e4 req-af1e50da-ff02-442a-9883-eb19f2f1430a service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Updated VIF entry in instance network info cache for port 3053b7df-e393-4bc7-a17f-8983f22cdd96. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:34:29 user nova-compute[70243]: DEBUG nova.network.neutron [req-e8d614d5-b114-4340-8996-b1840053a3e4 req-af1e50da-ff02-442a-9883-eb19f2f1430a service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Updating instance_info_cache with network_info: [{"id": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "address": "fa:16:3e:ad:37:16", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3053b7df-e3", "ovs_interfaceid": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:34:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e8d614d5-b114-4340-8996-b1840053a3e4 req-af1e50da-ff02-442a-9883-eb19f2f1430a service nova] Releasing lock "refresh_cache-8eb4450c-bf08-4949-a126-d30dbb3ea744" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:34:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dfcedca02bec0c0296ea0132613c0dad0cd08e41.part /opt/stack/data/nova/instances/_base/dfcedca02bec0c0296ea0132613c0dad0cd08e41.converted" returned: 0 in 0.330s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfcedca02bec0c0296ea0132613c0dad0cd08e41.converted --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfcedca02bec0c0296ea0132613c0dad0cd08e41.converted --force-share --output=json" returned: 0 in 0.157s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "dfcedca02bec0c0296ea0132613c0dad0cd08e41" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.531s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfcedca02bec0c0296ea0132613c0dad0cd08e41 --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfcedca02bec0c0296ea0132613c0dad0cd08e41 --force-share --output=json" returned: 0 in 0.146s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "dfcedca02bec0c0296ea0132613c0dad0cd08e41" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "dfcedca02bec0c0296ea0132613c0dad0cd08e41" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfcedca02bec0c0296ea0132613c0dad0cd08e41 --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfcedca02bec0c0296ea0132613c0dad0cd08e41 --force-share --output=json" returned: 0 in 0.144s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dfcedca02bec0c0296ea0132613c0dad0cd08e41,backing_fmt=raw /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dfcedca02bec0c0296ea0132613c0dad0cd08e41,backing_fmt=raw /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk 1073741824" returned: 0 in 0.056s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "dfcedca02bec0c0296ea0132613c0dad0cd08e41" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfcedca02bec0c0296ea0132613c0dad0cd08e41 --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfcedca02bec0c0296ea0132613c0dad0cd08e41 --force-share --output=json" returned: 0 in 0.150s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:30 user nova-compute[70243]: DEBUG nova.objects.instance [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'migration_context' on Instance uuid 8eb4450c-bf08-4949-a126-d30dbb3ea744 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:34:30 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Rebasing disk image.
Jul 24 16:34:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d -F raw /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "8fe2f619-2090-4653-96ab-937e0438a319" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "8fe2f619-2090-4653-96ab-937e0438a319" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "8fe2f619-2090-4653-96ab-937e0438a319-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "8fe2f619-2090-4653-96ab-937e0438a319-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "8fe2f619-2090-4653-96ab-937e0438a319-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:32 user nova-compute[70243]: INFO nova.compute.manager [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Terminating instance
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.compute.manager [req-b1a27df3-299b-4e1c-84e4-a098c74503d4 req-ff7bf280-8002-4a12-b22b-0832e7b10578 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Received event network-vif-unplugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b1a27df3-299b-4e1c-84e4-a098c74503d4 req-ff7bf280-8002-4a12-b22b-0832e7b10578 service nova] Acquiring lock "8fe2f619-2090-4653-96ab-937e0438a319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b1a27df3-299b-4e1c-84e4-a098c74503d4 req-ff7bf280-8002-4a12-b22b-0832e7b10578 service nova] Lock "8fe2f619-2090-4653-96ab-937e0438a319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b1a27df3-299b-4e1c-84e4-a098c74503d4 req-ff7bf280-8002-4a12-b22b-0832e7b10578 service nova] Lock "8fe2f619-2090-4653-96ab-937e0438a319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.compute.manager [req-b1a27df3-299b-4e1c-84e4-a098c74503d4 req-ff7bf280-8002-4a12-b22b-0832e7b10578 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] No waiting events found dispatching network-vif-unplugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.compute.manager [req-b1a27df3-299b-4e1c-84e4-a098c74503d4 req-ff7bf280-8002-4a12-b22b-0832e7b10578 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Received event network-vif-unplugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d -F raw /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk" returned: 0 in 2.153s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Ensure instance console log exists: /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Start _get_guest_xml network_info=[{"id": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "address": "fa:16:3e:ad:37:16", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3053b7df-e3", "ovs_interfaceid": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='bb334efcf76c2294d100e84e9c339af8',container_format='bare',created_at=2023-07-24T16:32:33Z,direct_url=<?>,disk_format='qcow2',id=eeb6bdd4-1dfe-45dc-8176-9bb81eaaa23c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-980705664-shelved',owner='9fcf70d1092145a2bda67106833fe84d',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-24T16:32:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:34:32 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:34:32 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='bb334efcf76c2294d100e84e9c339af8',container_format='bare',created_at=2023-07-24T16:32:33Z,direct_url=<?>,disk_format='qcow2',id=eeb6bdd4-1dfe-45dc-8176-9bb81eaaa23c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-980705664-shelved',owner='9fcf70d1092145a2bda67106833fe84d',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-24T16:32:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:34:32 user nova-compute[70243]: DEBUG nova.objects.instance [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8eb4450c-bf08-4949-a126-d30dbb3ea744 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T16:30:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-980705664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-980705664',id=26,image_ref='eeb6bdd4-1dfe-45dc-8176-9bb81eaaa23c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1565290298',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:30:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9fcf70d1092145a2bda67106833fe84d',ramdisk_id='',reservation_id='r-0b0cga8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-372850833',owner_user_name='tempest-AttachVolumeShelveTestJSON-372850833-project-member',shelved_at='2023-07-24T16:32:37.609287',shelved_host='user',shelved_image_id='eeb6bdd4-1dfe-45dc-8176-9bb81eaaa23c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:34:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62f8a994029a48608bfdcb15f14b2067',uuid=8eb4450c-bf08-4949-a126-d30dbb3ea744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "address": "fa:16:3e:ad:37:16", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3053b7df-e3", "ovs_interfaceid": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converting VIF {"id": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "address": "fa:16:3e:ad:37:16", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3053b7df-e3", "ovs_interfaceid": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:37:16,bridge_name='br-int',has_traffic_filtering=True,id=3053b7df-e393-4bc7-a17f-8983f22cdd96,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3053b7df-e3') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG nova.objects.instance [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'pci_devices' on Instance uuid 8eb4450c-bf08-4949-a126-d30dbb3ea744 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:34:33 user nova-compute[70243]:   <uuid>8eb4450c-bf08-4949-a126-d30dbb3ea744</uuid>
Jul 24 16:34:33 user nova-compute[70243]:   <name>instance-0000001a</name>
Jul 24 16:34:33 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:34:33 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:34:33 user nova-compute[70243]:   <metadata>
Jul 24 16:34:33 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:34:33 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:34:33 user nova-compute[70243]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-980705664</nova:name>
Jul 24 16:34:33 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:34:32</nova:creationTime>
Jul 24 16:34:33 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:34:33 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:34:33 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:34:33 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:34:33 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:34:33 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:34:33 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:34:33 user nova-compute[70243]:       <nova:owner>
Jul 24 16:34:33 user nova-compute[70243]:         <nova:user uuid="62f8a994029a48608bfdcb15f14b2067">tempest-AttachVolumeShelveTestJSON-372850833-project-member</nova:user>
Jul 24 16:34:33 user nova-compute[70243]:         <nova:project uuid="9fcf70d1092145a2bda67106833fe84d">tempest-AttachVolumeShelveTestJSON-372850833</nova:project>
Jul 24 16:34:33 user nova-compute[70243]:       </nova:owner>
Jul 24 16:34:33 user nova-compute[70243]:       <nova:root type="image" uuid="eeb6bdd4-1dfe-45dc-8176-9bb81eaaa23c"/>
Jul 24 16:34:33 user nova-compute[70243]:       <nova:ports>
Jul 24 16:34:33 user nova-compute[70243]:         <nova:port uuid="3053b7df-e393-4bc7-a17f-8983f22cdd96">
Jul 24 16:34:33 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 24 16:34:33 user nova-compute[70243]:         </nova:port>
Jul 24 16:34:33 user nova-compute[70243]:       </nova:ports>
Jul 24 16:34:33 user nova-compute[70243]:     </nova:instance>
Jul 24 16:34:33 user nova-compute[70243]:   </metadata>
Jul 24 16:34:33 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:34:33 user nova-compute[70243]:     <system>
Jul 24 16:34:33 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:34:33 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:34:33 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:34:33 user nova-compute[70243]:       <entry name="serial">8eb4450c-bf08-4949-a126-d30dbb3ea744</entry>
Jul 24 16:34:33 user nova-compute[70243]:       <entry name="uuid">8eb4450c-bf08-4949-a126-d30dbb3ea744</entry>
Jul 24 16:34:33 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:34:33 user nova-compute[70243]:     </system>
Jul 24 16:34:33 user nova-compute[70243]:   </sysinfo>
Jul 24 16:34:33 user nova-compute[70243]:   <os>
Jul 24 16:34:33 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:34:33 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:34:33 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:34:33 user nova-compute[70243]:   </os>
Jul 24 16:34:33 user nova-compute[70243]:   <features>
Jul 24 16:34:33 user nova-compute[70243]:     <acpi/>
Jul 24 16:34:33 user nova-compute[70243]:     <apic/>
Jul 24 16:34:33 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:34:33 user nova-compute[70243]:   </features>
Jul 24 16:34:33 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:34:33 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:34:33 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:34:33 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:34:33 user nova-compute[70243]:   </clock>
Jul 24 16:34:33 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:34:33 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:34:33 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:34:33 user nova-compute[70243]:   </cpu>
Jul 24 16:34:33 user nova-compute[70243]:   <devices>
Jul 24 16:34:33 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:34:33 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:34:33 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk"/>
Jul 24 16:34:33 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:34:33 user nova-compute[70243]:     </disk>
Jul 24 16:34:33 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:34:33 user nova-compute[70243]:       <mac address="fa:16:3e:ad:37:16"/>
Jul 24 16:34:33 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:34:33 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:34:33 user nova-compute[70243]:       <target dev="tap3053b7df-e3"/>
Jul 24 16:34:33 user nova-compute[70243]:     </interface>
Jul 24 16:34:33 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:34:33 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/console.log" append="off"/>
Jul 24 16:34:33 user nova-compute[70243]:     </serial>
Jul 24 16:34:33 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:34:33 user nova-compute[70243]:     <video>
Jul 24 16:34:33 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:34:33 user nova-compute[70243]:     </video>
Jul 24 16:34:33 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:34:33 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:34:33 user nova-compute[70243]:     </rng>
Jul 24 16:34:33 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:34:33 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:34:33 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:34:33 user nova-compute[70243]:     </memballoon>
Jul 24 16:34:33 user nova-compute[70243]:   </devices>
Jul 24 16:34:33 user nova-compute[70243]: </domain>
Jul 24 16:34:33 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T16:30:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-980705664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-980705664',id=26,image_ref='eeb6bdd4-1dfe-45dc-8176-9bb81eaaa23c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1565290298',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:30:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9fcf70d1092145a2bda67106833fe84d',ramdisk_id='',reservation_id='r-0b0cga8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-372850833',owner_user_name='tempest-AttachVolumeShelveTestJSON-372850833-project-member',shelved_at='2023-07-24T16:32:37.609287',shelved_host='user',shelved_image_id='eeb6bdd4-1dfe-45dc-8176-9bb81eaaa23c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:34:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62f8a994029a48608bfdcb15f14b2067',uuid=8eb4450c-bf08-4949-a126-d30dbb3ea744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "address": "fa:16:3e:ad:37:16", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3053b7df-e3", "ovs_interfaceid": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converting VIF {"id": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "address": "fa:16:3e:ad:37:16", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3053b7df-e3", "ovs_interfaceid": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:37:16,bridge_name='br-int',has_traffic_filtering=True,id=3053b7df-e393-4bc7-a17f-8983f22cdd96,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3053b7df-e3') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG os_vif [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:37:16,bridge_name='br-int',has_traffic_filtering=True,id=3053b7df-e393-4bc7-a17f-8983f22cdd96,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3053b7df-e3') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3053b7df-e3, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3053b7df-e3, col_values=(('external_ids', {'iface-id': '3053b7df-e393-4bc7-a17f-8983f22cdd96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:37:16', 'vm-uuid': '8eb4450c-bf08-4949-a126-d30dbb3ea744'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:33 user nova-compute[70243]: INFO os_vif [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:37:16,bridge_name='br-int',has_traffic_filtering=True,id=3053b7df-e393-4bc7-a17f-8983f22cdd96,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3053b7df-e3')
Jul 24 16:34:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] No VIF found with MAC fa:16:3e:ad:37:16, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:33 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Instance destroyed successfully.
Jul 24 16:34:33 user nova-compute[70243]: DEBUG nova.objects.instance [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lazy-loading 'resources' on Instance uuid 8fe2f619-2090-4653-96ab-937e0438a319 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:31:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1683650322',display_name='tempest-AttachVolumeNegativeTest-server-1683650322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1683650322',id=28,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPpRVYexM2uymQwadWK9qU/wMGEjmtuDYPGgm1i2xUzjg4gw5iqUJQA5vMVKHFWQNr2SKj4N/1Il8VKuXsUbWR/hvhKmvrpzRurEj/I9J2qJERmvqTgLh76CP3SnkMeRw==',key_name='tempest-keypair-76493656',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:31:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e819e22e590947478d513e1b9ad39494',ramdisk_id='',reservation_id='r-vlnyota7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1152214105',owner_user_name='tempest-AttachVolumeNegativeTest-1152214105-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:31:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df18929107a458194a9c528d9bdfeac',uuid=8fe2f619-2090-4653-96ab-937e0438a319,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "424118a7-f3d3-4351-ae2e-8ee2208b19c5", "address": "fa:16:3e:e8:f5:92", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424118a7-f3", "ovs_interfaceid": "424118a7-f3d3-4351-ae2e-8ee2208b19c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converting VIF {"id": "424118a7-f3d3-4351-ae2e-8ee2208b19c5", "address": "fa:16:3e:e8:f5:92", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424118a7-f3", "ovs_interfaceid": "424118a7-f3d3-4351-ae2e-8ee2208b19c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:f5:92,bridge_name='br-int',has_traffic_filtering=True,id=424118a7-f3d3-4351-ae2e-8ee2208b19c5,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424118a7-f3') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG os_vif [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:f5:92,bridge_name='br-int',has_traffic_filtering=True,id=424118a7-f3d3-4351-ae2e-8ee2208b19c5,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424118a7-f3') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap424118a7-f3, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:33 user nova-compute[70243]: INFO os_vif [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:f5:92,bridge_name='br-int',has_traffic_filtering=True,id=424118a7-f3d3-4351-ae2e-8ee2208b19c5,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424118a7-f3')
Jul 24 16:34:33 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Deleting instance files /opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319_del
Jul 24 16:34:33 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Deletion of /opt/stack/data/nova/instances/8fe2f619-2090-4653-96ab-937e0438a319_del complete
Jul 24 16:34:33 user nova-compute[70243]: INFO nova.compute.manager [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Took 1.28 seconds to destroy the instance on the hypervisor.
Jul 24 16:34:33 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:34:33 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:34:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:34:35 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Took 1.18 seconds to deallocate network for instance.
Jul 24 16:34:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-116cdd16-fc14-4104-95d9-7ac1bca98f63 req-53cbcd57-ecf9-4425-afd1-bf806c54ecc2 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Received event network-vif-deleted-424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Received event network-vif-plugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] Acquiring lock "8fe2f619-2090-4653-96ab-937e0438a319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] Lock "8fe2f619-2090-4653-96ab-937e0438a319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] Lock "8fe2f619-2090-4653-96ab-937e0438a319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] No waiting events found dispatching network-vif-plugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:34:35 user nova-compute[70243]: WARNING nova.compute.manager [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Received unexpected event network-vif-plugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 for instance with vm_state active and task_state deleting.
Jul 24 16:34:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Received event network-vif-plugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] Acquiring lock "8fe2f619-2090-4653-96ab-937e0438a319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] Lock "8fe2f619-2090-4653-96ab-937e0438a319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] Lock "8fe2f619-2090-4653-96ab-937e0438a319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] No waiting events found dispatching network-vif-plugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:34:35 user nova-compute[70243]: WARNING nova.compute.manager [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Received unexpected event network-vif-plugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 for instance with vm_state active and task_state deleting.
Jul 24 16:34:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Received event network-vif-plugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] Acquiring lock "8fe2f619-2090-4653-96ab-937e0438a319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] Lock "8fe2f619-2090-4653-96ab-937e0438a319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] Lock "8fe2f619-2090-4653-96ab-937e0438a319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] No waiting events found dispatching network-vif-plugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:34:35 user nova-compute[70243]: WARNING nova.compute.manager [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Received unexpected event network-vif-plugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 for instance with vm_state active and task_state deleting.
Jul 24 16:34:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Received event network-vif-unplugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] Acquiring lock "8fe2f619-2090-4653-96ab-937e0438a319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] Lock "8fe2f619-2090-4653-96ab-937e0438a319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] Lock "8fe2f619-2090-4653-96ab-937e0438a319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] No waiting events found dispatching network-vif-unplugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Received event network-vif-unplugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Received event network-vif-plugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] Acquiring lock "8fe2f619-2090-4653-96ab-937e0438a319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] Lock "8fe2f619-2090-4653-96ab-937e0438a319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] Lock "8fe2f619-2090-4653-96ab-937e0438a319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] No waiting events found dispatching network-vif-plugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:34:35 user nova-compute[70243]: WARNING nova.compute.manager [req-1a4426d8-1ed1-4c4d-8780-dbdca6efa106 req-027bdc5a-20b9-4401-865e-43dad639a768 service nova] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Received unexpected event network-vif-plugged-424118a7-f3d3-4351-ae2e-8ee2208b19c5 for instance with vm_state active and task_state deleting.
Jul 24 16:34:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:34:35 user nova-compute[70243]: WARNING nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] While synchronizing instance power states, found 6 instances in the database and 5 instances on the hypervisor.
Jul 24 16:34:35 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Triggering sync for uuid 50fecb3a-8f06-4822-8c84-76df51acfe50 {{(pid=70243) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Triggering sync for uuid 6f2258de-6b31-48af-81df-37b64da4ca99 {{(pid=70243) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Triggering sync for uuid 8eb4450c-bf08-4949-a126-d30dbb3ea744 {{(pid=70243) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Triggering sync for uuid 8fe2f619-2090-4653-96ab-937e0438a319 {{(pid=70243) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Triggering sync for uuid 05bfd953-bb4b-4eaf-a304-ccb040d8f429 {{(pid=70243) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Triggering sync for uuid 0cceb071-c478-4914-8243-77c3efbdb5d3 {{(pid=70243) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "50fecb3a-8f06-4822-8c84-76df51acfe50" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "6f2258de-6b31-48af-81df-37b64da4ca99" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "6f2258de-6b31-48af-81df-37b64da4ca99" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "8eb4450c-bf08-4949-a126-d30dbb3ea744" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "8fe2f619-2090-4653-96ab-937e0438a319" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "0cceb071-c478-4914-8243-77c3efbdb5d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "6f2258de-6b31-48af-81df-37b64da4ca99" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:35 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:34:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.513s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:36 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Deleted allocations for instance 8fe2f619-2090-4653-96ab-937e0438a319
Jul 24 16:34:36 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216461.1600468, de22ea98-b041-4f3f-8986-435c43267a2e => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:34:36 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] VM Stopped (Lifecycle Event)
Jul 24 16:34:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2b8955b0-c22a-499a-a9eb-54a588721103 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "8fe2f619-2090-4653-96ab-937e0438a319" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.628s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "8fe2f619-2090-4653-96ab-937e0438a319" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.325s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:36 user nova-compute[70243]: DEBUG nova.compute.manager [None req-85abb894-5833-44ae-be68-956d98d60a22 None None] [instance: de22ea98-b041-4f3f-8986-435c43267a2e] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:34:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "8fe2f619-2090-4653-96ab-937e0438a319" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-073c52ed-44bc-4390-98cb-1383af493f96 req-a53d8ed8-f677-427d-b804-7d8e89518144 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Received event network-vif-plugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:34:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-073c52ed-44bc-4390-98cb-1383af493f96 req-a53d8ed8-f677-427d-b804-7d8e89518144 service nova] Acquiring lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-073c52ed-44bc-4390-98cb-1383af493f96 req-a53d8ed8-f677-427d-b804-7d8e89518144 service nova] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-073c52ed-44bc-4390-98cb-1383af493f96 req-a53d8ed8-f677-427d-b804-7d8e89518144 service nova] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-073c52ed-44bc-4390-98cb-1383af493f96 req-a53d8ed8-f677-427d-b804-7d8e89518144 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] No waiting events found dispatching network-vif-plugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:34:37 user nova-compute[70243]: WARNING nova.compute.manager [req-073c52ed-44bc-4390-98cb-1383af493f96 req-a53d8ed8-f677-427d-b804-7d8e89518144 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Received unexpected event network-vif-plugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 24 16:34:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-073c52ed-44bc-4390-98cb-1383af493f96 req-a53d8ed8-f677-427d-b804-7d8e89518144 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Received event network-vif-plugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:34:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-073c52ed-44bc-4390-98cb-1383af493f96 req-a53d8ed8-f677-427d-b804-7d8e89518144 service nova] Acquiring lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-073c52ed-44bc-4390-98cb-1383af493f96 req-a53d8ed8-f677-427d-b804-7d8e89518144 service nova] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-073c52ed-44bc-4390-98cb-1383af493f96 req-a53d8ed8-f677-427d-b804-7d8e89518144 service nova] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-073c52ed-44bc-4390-98cb-1383af493f96 req-a53d8ed8-f677-427d-b804-7d8e89518144 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] No waiting events found dispatching network-vif-plugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:34:37 user nova-compute[70243]: WARNING nova.compute.manager [req-073c52ed-44bc-4390-98cb-1383af493f96 req-a53d8ed8-f677-427d-b804-7d8e89518144 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Received unexpected event network-vif-plugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 24 16:34:37 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216477.533809, 8eb4450c-bf08-4949-a126-d30dbb3ea744 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:34:37 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] VM Resumed (Lifecycle Event)
Jul 24 16:34:37 user nova-compute[70243]: DEBUG nova.compute.manager [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:34:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:34:37 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Instance spawned successfully.
Jul 24 16:34:37 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:34:37 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:34:37 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:34:37 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216477.5364866, 8eb4450c-bf08-4949-a126-d30dbb3ea744 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:34:37 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] VM Started (Lifecycle Event)
Jul 24 16:34:37 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:34:37 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:34:37 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:34:37 user nova-compute[70243]: DEBUG nova.compute.manager [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:34:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05a3c461-05da-4b4d-914c-3755050f4a75 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.211s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.005s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:37 user nova-compute[70243]: INFO nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:34:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:48 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:34:48 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:34:48 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216473.7215383, 8fe2f619-2090-4653-96ab-937e0438a319 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:34:48 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] VM Stopped (Lifecycle Event)
Jul 24 16:34:48 user nova-compute[70243]: DEBUG nova.compute.manager [None req-8269cbf8-687e-4439-8317-37dc42cd7918 None None] [instance: 8fe2f619-2090-4653-96ab-937e0438a319] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:34:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:49 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:34:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:50 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:34:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:55 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:34:55 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:34:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:34:55 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:34:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:55 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:34:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bfd953-bb4b-4eaf-a304-ccb040d8f429/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bfd953-bb4b-4eaf-a304-ccb040d8f429/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bfd953-bb4b-4eaf-a304-ccb040d8f429/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bfd953-bb4b-4eaf-a304-ccb040d8f429/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:34:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:34:57 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:34:57 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:34:57 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8086MB free_disk=24.306686401367188GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:34:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:34:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:34:58 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 50fecb3a-8f06-4822-8c84-76df51acfe50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:34:58 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6f2258de-6b31-48af-81df-37b64da4ca99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:34:58 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 05bfd953-bb4b-4eaf-a304-ccb040d8f429 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:34:58 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 0cceb071-c478-4914-8243-77c3efbdb5d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:34:58 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8eb4450c-bf08-4949-a126-d30dbb3ea744 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:34:58 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:34:58 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:34:58 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing inventories for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 16:34:58 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Updating ProviderTree inventory for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 16:34:58 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Updating inventory in ProviderTree for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 16:34:58 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing aggregate associations for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0, aggregates: None {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 16:34:58 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing trait associations for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0, traits: HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 16:34:58 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:34:58 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:34:58 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:34:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:34:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:34:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:00 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:35:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:35:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 16:35:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-50fecb3a-8f06-4822-8c84-76df51acfe50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:35:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-50fecb3a-8f06-4822-8c84-76df51acfe50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:35:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:35:00 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lazy-loading 'info_cache' on Instance uuid 50fecb3a-8f06-4822-8c84-76df51acfe50 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:35:01 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Updating instance_info_cache with network_info: [{"id": "657cc261-2d12-42c2-a879-f8cc121bd811", "address": "fa:16:3e:93:0d:e3", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657cc261-2d", "ovs_interfaceid": "657cc261-2d12-42c2-a879-f8cc121bd811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:35:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-50fecb3a-8f06-4822-8c84-76df51acfe50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:35:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:35:01 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:35:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "75b26864-1539-4106-b741-3b3f5c7e898a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:35:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:07 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:35:07 user nova-compute[70243]: INFO nova.compute.claims [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Claim successful on node user
Jul 24 16:35:07 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:35:07 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:35:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:35:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:35:07 user nova-compute[70243]: DEBUG nova.network.neutron [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:35:07 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:35:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:35:07 user nova-compute[70243]: DEBUG nova.policy [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19ffbd1cce754a8a83772a76205e34fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6955ddcb9e244a1beb243d63596cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:35:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:35:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:35:07 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Creating image(s)
Jul 24 16:35:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "/opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "/opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "/opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.131s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.131s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk 1073741824" returned: 0 in 0.060s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:08 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:35:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:08 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Cannot resize image /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:35:08 user nova-compute[70243]: DEBUG nova.objects.instance [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lazy-loading 'migration_context' on Instance uuid 75b26864-1539-4106-b741-3b3f5c7e898a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:35:08 user nova-compute[70243]: DEBUG nova.network.neutron [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Successfully created port: 885f4554-aa56-4402-a61c-dd97f720d0fe {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:35:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:35:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Ensure instance console log exists: /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:35:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.network.neutron [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Successfully updated port: 885f4554-aa56-4402-a61c-dd97f720d0fe {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "refresh_cache-75b26864-1539-4106-b741-3b3f5c7e898a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquired lock "refresh_cache-75b26864-1539-4106-b741-3b3f5c7e898a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.network.neutron [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-0cc18ac5-f24f-4b96-855d-a8779ffb8407 req-8b6c75ab-117d-46c5-b324-8c22e15b578d service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Received event network-changed-885f4554-aa56-4402-a61c-dd97f720d0fe {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-0cc18ac5-f24f-4b96-855d-a8779ffb8407 req-8b6c75ab-117d-46c5-b324-8c22e15b578d service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Refreshing instance network info cache due to event network-changed-885f4554-aa56-4402-a61c-dd97f720d0fe. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0cc18ac5-f24f-4b96-855d-a8779ffb8407 req-8b6c75ab-117d-46c5-b324-8c22e15b578d service nova] Acquiring lock "refresh_cache-75b26864-1539-4106-b741-3b3f5c7e898a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.network.neutron [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.network.neutron [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Updating instance_info_cache with network_info: [{"id": "885f4554-aa56-4402-a61c-dd97f720d0fe", "address": "fa:16:3e:81:5b:1b", "network": {"id": "51126732-2727-4752-b653-16d223e1d827", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-797458544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6955ddcb9e244a1beb243d63596cada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885f4554-aa", "ovs_interfaceid": "885f4554-aa56-4402-a61c-dd97f720d0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Releasing lock "refresh_cache-75b26864-1539-4106-b741-3b3f5c7e898a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.compute.manager [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Instance network_info: |[{"id": "885f4554-aa56-4402-a61c-dd97f720d0fe", "address": "fa:16:3e:81:5b:1b", "network": {"id": "51126732-2727-4752-b653-16d223e1d827", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-797458544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6955ddcb9e244a1beb243d63596cada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885f4554-aa", "ovs_interfaceid": "885f4554-aa56-4402-a61c-dd97f720d0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0cc18ac5-f24f-4b96-855d-a8779ffb8407 req-8b6c75ab-117d-46c5-b324-8c22e15b578d service nova] Acquired lock "refresh_cache-75b26864-1539-4106-b741-3b3f5c7e898a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.network.neutron [req-0cc18ac5-f24f-4b96-855d-a8779ffb8407 req-8b6c75ab-117d-46c5-b324-8c22e15b578d service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Refreshing network info cache for port 885f4554-aa56-4402-a61c-dd97f720d0fe {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Start _get_guest_xml network_info=[{"id": "885f4554-aa56-4402-a61c-dd97f720d0fe", "address": "fa:16:3e:81:5b:1b", "network": {"id": "51126732-2727-4752-b653-16d223e1d827", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-797458544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6955ddcb9e244a1beb243d63596cada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885f4554-aa", "ovs_interfaceid": "885f4554-aa56-4402-a61c-dd97f720d0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:35:09 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:35:09 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-710720691',display_name='tempest-SnapshotDataIntegrityTests-server-710720691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-710720691',id=31,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGrsslzNHkm/l035QP8brFXojPaCGqpMNYRGZskY81NUFwTVIjLpt6FbNleiiDftXlM36f234Lqz3fNof9toAO1JGPoJx9NT8g0tLnFfDFD0Z6Wg7Jt0bqxmdDbh12c0g==',key_name='tempest-keypair-2018840211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6955ddcb9e244a1beb243d63596cada',ramdisk_id='',reservation_id='r-0uefodcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-118169928',owner_user_name='tempest-SnapshotDataIntegrityTests-118169928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:35:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19ffbd1cce754a8a83772a76205e34fc',uuid=75b26864-1539-4106-b741-3b3f5c7e898a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "885f4554-aa56-4402-a61c-dd97f720d0fe", "address": "fa:16:3e:81:5b:1b", "network": {"id": "51126732-2727-4752-b653-16d223e1d827", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-797458544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6955ddcb9e244a1beb243d63596cada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885f4554-aa", "ovs_interfaceid": "885f4554-aa56-4402-a61c-dd97f720d0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Converting VIF {"id": "885f4554-aa56-4402-a61c-dd97f720d0fe", "address": "fa:16:3e:81:5b:1b", "network": {"id": "51126732-2727-4752-b653-16d223e1d827", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-797458544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6955ddcb9e244a1beb243d63596cada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885f4554-aa", "ovs_interfaceid": "885f4554-aa56-4402-a61c-dd97f720d0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:5b:1b,bridge_name='br-int',has_traffic_filtering=True,id=885f4554-aa56-4402-a61c-dd97f720d0fe,network=Network(51126732-2727-4752-b653-16d223e1d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap885f4554-aa') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.objects.instance [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lazy-loading 'pci_devices' on Instance uuid 75b26864-1539-4106-b741-3b3f5c7e898a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:35:09 user nova-compute[70243]:   <uuid>75b26864-1539-4106-b741-3b3f5c7e898a</uuid>
Jul 24 16:35:09 user nova-compute[70243]:   <name>instance-0000001f</name>
Jul 24 16:35:09 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:35:09 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:35:09 user nova-compute[70243]:   <metadata>
Jul 24 16:35:09 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:35:09 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:35:09 user nova-compute[70243]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-710720691</nova:name>
Jul 24 16:35:09 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:35:09</nova:creationTime>
Jul 24 16:35:09 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:35:09 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:35:09 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:35:09 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:35:09 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:35:09 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:35:09 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:35:09 user nova-compute[70243]:       <nova:owner>
Jul 24 16:35:09 user nova-compute[70243]:         <nova:user uuid="19ffbd1cce754a8a83772a76205e34fc">tempest-SnapshotDataIntegrityTests-118169928-project-member</nova:user>
Jul 24 16:35:09 user nova-compute[70243]:         <nova:project uuid="a6955ddcb9e244a1beb243d63596cada">tempest-SnapshotDataIntegrityTests-118169928</nova:project>
Jul 24 16:35:09 user nova-compute[70243]:       </nova:owner>
Jul 24 16:35:09 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:35:09 user nova-compute[70243]:       <nova:ports>
Jul 24 16:35:09 user nova-compute[70243]:         <nova:port uuid="885f4554-aa56-4402-a61c-dd97f720d0fe">
Jul 24 16:35:09 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 16:35:09 user nova-compute[70243]:         </nova:port>
Jul 24 16:35:09 user nova-compute[70243]:       </nova:ports>
Jul 24 16:35:09 user nova-compute[70243]:     </nova:instance>
Jul 24 16:35:09 user nova-compute[70243]:   </metadata>
Jul 24 16:35:09 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:35:09 user nova-compute[70243]:     <system>
Jul 24 16:35:09 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:35:09 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:35:09 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:35:09 user nova-compute[70243]:       <entry name="serial">75b26864-1539-4106-b741-3b3f5c7e898a</entry>
Jul 24 16:35:09 user nova-compute[70243]:       <entry name="uuid">75b26864-1539-4106-b741-3b3f5c7e898a</entry>
Jul 24 16:35:09 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:35:09 user nova-compute[70243]:     </system>
Jul 24 16:35:09 user nova-compute[70243]:   </sysinfo>
Jul 24 16:35:09 user nova-compute[70243]:   <os>
Jul 24 16:35:09 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:35:09 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:35:09 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:35:09 user nova-compute[70243]:   </os>
Jul 24 16:35:09 user nova-compute[70243]:   <features>
Jul 24 16:35:09 user nova-compute[70243]:     <acpi/>
Jul 24 16:35:09 user nova-compute[70243]:     <apic/>
Jul 24 16:35:09 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:35:09 user nova-compute[70243]:   </features>
Jul 24 16:35:09 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:35:09 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:35:09 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:35:09 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:35:09 user nova-compute[70243]:   </clock>
Jul 24 16:35:09 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:35:09 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:35:09 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:35:09 user nova-compute[70243]:   </cpu>
Jul 24 16:35:09 user nova-compute[70243]:   <devices>
Jul 24 16:35:09 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:35:09 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:35:09 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk"/>
Jul 24 16:35:09 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:35:09 user nova-compute[70243]:     </disk>
Jul 24 16:35:09 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:35:09 user nova-compute[70243]:       <mac address="fa:16:3e:81:5b:1b"/>
Jul 24 16:35:09 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:35:09 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:35:09 user nova-compute[70243]:       <target dev="tap885f4554-aa"/>
Jul 24 16:35:09 user nova-compute[70243]:     </interface>
Jul 24 16:35:09 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:35:09 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/console.log" append="off"/>
Jul 24 16:35:09 user nova-compute[70243]:     </serial>
Jul 24 16:35:09 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:35:09 user nova-compute[70243]:     <video>
Jul 24 16:35:09 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:35:09 user nova-compute[70243]:     </video>
Jul 24 16:35:09 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:35:09 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:35:09 user nova-compute[70243]:     </rng>
Jul 24 16:35:09 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:35:09 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:35:09 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:35:09 user nova-compute[70243]:     </memballoon>
Jul 24 16:35:09 user nova-compute[70243]:   </devices>
Jul 24 16:35:09 user nova-compute[70243]: </domain>
Jul 24 16:35:09 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-710720691',display_name='tempest-SnapshotDataIntegrityTests-server-710720691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-710720691',id=31,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGrsslzNHkm/l035QP8brFXojPaCGqpMNYRGZskY81NUFwTVIjLpt6FbNleiiDftXlM36f234Lqz3fNof9toAO1JGPoJx9NT8g0tLnFfDFD0Z6Wg7Jt0bqxmdDbh12c0g==',key_name='tempest-keypair-2018840211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6955ddcb9e244a1beb243d63596cada',ramdisk_id='',reservation_id='r-0uefodcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-118169928',owner_user_name='tempest-SnapshotDataIntegrityTests-118169928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:35:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19ffbd1cce754a8a83772a76205e34fc',uuid=75b26864-1539-4106-b741-3b3f5c7e898a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "885f4554-aa56-4402-a61c-dd97f720d0fe", "address": "fa:16:3e:81:5b:1b", "network": {"id": "51126732-2727-4752-b653-16d223e1d827", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-797458544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6955ddcb9e244a1beb243d63596cada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885f4554-aa", "ovs_interfaceid": "885f4554-aa56-4402-a61c-dd97f720d0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Converting VIF {"id": "885f4554-aa56-4402-a61c-dd97f720d0fe", "address": "fa:16:3e:81:5b:1b", "network": {"id": "51126732-2727-4752-b653-16d223e1d827", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-797458544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6955ddcb9e244a1beb243d63596cada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885f4554-aa", "ovs_interfaceid": "885f4554-aa56-4402-a61c-dd97f720d0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:5b:1b,bridge_name='br-int',has_traffic_filtering=True,id=885f4554-aa56-4402-a61c-dd97f720d0fe,network=Network(51126732-2727-4752-b653-16d223e1d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap885f4554-aa') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG os_vif [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:5b:1b,bridge_name='br-int',has_traffic_filtering=True,id=885f4554-aa56-4402-a61c-dd97f720d0fe,network=Network(51126732-2727-4752-b653-16d223e1d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap885f4554-aa') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap885f4554-aa, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap885f4554-aa, col_values=(('external_ids', {'iface-id': '885f4554-aa56-4402-a61c-dd97f720d0fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:5b:1b', 'vm-uuid': '75b26864-1539-4106-b741-3b3f5c7e898a'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:09 user nova-compute[70243]: INFO os_vif [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:5b:1b,bridge_name='br-int',has_traffic_filtering=True,id=885f4554-aa56-4402-a61c-dd97f720d0fe,network=Network(51126732-2727-4752-b653-16d223e1d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap885f4554-aa')
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] No VIF found with MAC fa:16:3e:81:5b:1b, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:35:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:10 user nova-compute[70243]: DEBUG nova.network.neutron [req-0cc18ac5-f24f-4b96-855d-a8779ffb8407 req-8b6c75ab-117d-46c5-b324-8c22e15b578d service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Updated VIF entry in instance network info cache for port 885f4554-aa56-4402-a61c-dd97f720d0fe. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:35:10 user nova-compute[70243]: DEBUG nova.network.neutron [req-0cc18ac5-f24f-4b96-855d-a8779ffb8407 req-8b6c75ab-117d-46c5-b324-8c22e15b578d service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Updating instance_info_cache with network_info: [{"id": "885f4554-aa56-4402-a61c-dd97f720d0fe", "address": "fa:16:3e:81:5b:1b", "network": {"id": "51126732-2727-4752-b653-16d223e1d827", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-797458544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6955ddcb9e244a1beb243d63596cada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885f4554-aa", "ovs_interfaceid": "885f4554-aa56-4402-a61c-dd97f720d0fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:35:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0cc18ac5-f24f-4b96-855d-a8779ffb8407 req-8b6c75ab-117d-46c5-b324-8c22e15b578d service nova] Releasing lock "refresh_cache-75b26864-1539-4106-b741-3b3f5c7e898a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:35:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:11 user nova-compute[70243]: DEBUG nova.compute.manager [req-3cab2e55-129d-4cb8-b7d9-65a695c6d96e req-7591d79e-0816-4cd8-9b56-9abb866e6c3e service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Received event network-vif-plugged-885f4554-aa56-4402-a61c-dd97f720d0fe {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:35:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3cab2e55-129d-4cb8-b7d9-65a695c6d96e req-7591d79e-0816-4cd8-9b56-9abb866e6c3e service nova] Acquiring lock "75b26864-1539-4106-b741-3b3f5c7e898a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3cab2e55-129d-4cb8-b7d9-65a695c6d96e req-7591d79e-0816-4cd8-9b56-9abb866e6c3e service nova] Lock "75b26864-1539-4106-b741-3b3f5c7e898a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3cab2e55-129d-4cb8-b7d9-65a695c6d96e req-7591d79e-0816-4cd8-9b56-9abb866e6c3e service nova] Lock "75b26864-1539-4106-b741-3b3f5c7e898a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:11 user nova-compute[70243]: DEBUG nova.compute.manager [req-3cab2e55-129d-4cb8-b7d9-65a695c6d96e req-7591d79e-0816-4cd8-9b56-9abb866e6c3e service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] No waiting events found dispatching network-vif-plugged-885f4554-aa56-4402-a61c-dd97f720d0fe {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:35:11 user nova-compute[70243]: WARNING nova.compute.manager [req-3cab2e55-129d-4cb8-b7d9-65a695c6d96e req-7591d79e-0816-4cd8-9b56-9abb866e6c3e service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Received unexpected event network-vif-plugged-885f4554-aa56-4402-a61c-dd97f720d0fe for instance with vm_state building and task_state spawning.
Jul 24 16:35:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:13 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216513.3331196, 75b26864-1539-4106-b741-3b3f5c7e898a => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:35:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] VM Resumed (Lifecycle Event)
Jul 24 16:35:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:35:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:35:13 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Instance spawned successfully.
Jul 24 16:35:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:35:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:35:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:35:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:35:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:35:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:35:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:35:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:35:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:35:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:35:13 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216513.3349483, 75b26864-1539-4106-b741-3b3f5c7e898a => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:35:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] VM Started (Lifecycle Event)
Jul 24 16:35:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:35:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:35:13 user nova-compute[70243]: DEBUG nova.compute.manager [req-66d1a3bb-89b3-4361-8f16-21f007622f79 req-a9b542fd-add8-41ac-92ce-6714abdd8065 service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Received event network-vif-plugged-885f4554-aa56-4402-a61c-dd97f720d0fe {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:35:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-66d1a3bb-89b3-4361-8f16-21f007622f79 req-a9b542fd-add8-41ac-92ce-6714abdd8065 service nova] Acquiring lock "75b26864-1539-4106-b741-3b3f5c7e898a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-66d1a3bb-89b3-4361-8f16-21f007622f79 req-a9b542fd-add8-41ac-92ce-6714abdd8065 service nova] Lock "75b26864-1539-4106-b741-3b3f5c7e898a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-66d1a3bb-89b3-4361-8f16-21f007622f79 req-a9b542fd-add8-41ac-92ce-6714abdd8065 service nova] Lock "75b26864-1539-4106-b741-3b3f5c7e898a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:13 user nova-compute[70243]: DEBUG nova.compute.manager [req-66d1a3bb-89b3-4361-8f16-21f007622f79 req-a9b542fd-add8-41ac-92ce-6714abdd8065 service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] No waiting events found dispatching network-vif-plugged-885f4554-aa56-4402-a61c-dd97f720d0fe {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:35:13 user nova-compute[70243]: WARNING nova.compute.manager [req-66d1a3bb-89b3-4361-8f16-21f007622f79 req-a9b542fd-add8-41ac-92ce-6714abdd8065 service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Received unexpected event network-vif-plugged-885f4554-aa56-4402-a61c-dd97f720d0fe for instance with vm_state building and task_state spawning.
Jul 24 16:35:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:35:13 user nova-compute[70243]: INFO nova.compute.manager [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Took 5.56 seconds to spawn the instance on the hypervisor.
Jul 24 16:35:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:35:13 user nova-compute[70243]: INFO nova.compute.manager [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Took 6.19 seconds to build instance.
Jul 24 16:35:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-db17e14e-9c45-4820-add9-945ae841221b tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.285s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:35:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:24 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:35:24 user nova-compute[70243]: INFO nova.compute.claims [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Claim successful on node user
Jul 24 16:35:24 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:35:24 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:35:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:35:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:35:24 user nova-compute[70243]: DEBUG nova.network.neutron [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:35:24 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:35:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:35:24 user nova-compute[70243]: DEBUG nova.policy [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae306b319e8c4e61b0a73933dc5c330c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06cf84dc406343afa81260614acc8fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:35:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:35:24 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:35:24 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Creating image(s)
Jul 24 16:35:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "/opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "/opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "/opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:25 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.150s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:25 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:25 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.144s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:25 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:25 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk 1073741824" returned: 0 in 0.052s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:25 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:25 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.130s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:25 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Checking if we can resize image /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:35:25 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:25 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:25 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Cannot resize image /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:35:25 user nova-compute[70243]: DEBUG nova.objects.instance [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'migration_context' on Instance uuid 100c6ba5-de96-4c2a-ae0c-9d3a9199948c {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:35:25 user nova-compute[70243]: DEBUG nova.network.neutron [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Successfully created port: 82ce0c89-3921-42d9-bfd8-d6bcab182f73 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:35:25 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:35:25 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Ensure instance console log exists: /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:35:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:26 user nova-compute[70243]: DEBUG nova.network.neutron [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Successfully updated port: 82ce0c89-3921-42d9-bfd8-d6bcab182f73 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:35:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "refresh_cache-100c6ba5-de96-4c2a-ae0c-9d3a9199948c" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:35:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquired lock "refresh_cache-100c6ba5-de96-4c2a-ae0c-9d3a9199948c" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:35:26 user nova-compute[70243]: DEBUG nova.network.neutron [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:35:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-ce28faf4-26e4-4494-9df0-bf9df0c10634 req-d934858e-f58b-4559-b219-77c04bceeda6 service nova] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Received event network-changed-82ce0c89-3921-42d9-bfd8-d6bcab182f73 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:35:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-ce28faf4-26e4-4494-9df0-bf9df0c10634 req-d934858e-f58b-4559-b219-77c04bceeda6 service nova] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Refreshing instance network info cache due to event network-changed-82ce0c89-3921-42d9-bfd8-d6bcab182f73. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:35:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ce28faf4-26e4-4494-9df0-bf9df0c10634 req-d934858e-f58b-4559-b219-77c04bceeda6 service nova] Acquiring lock "refresh_cache-100c6ba5-de96-4c2a-ae0c-9d3a9199948c" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:35:26 user nova-compute[70243]: DEBUG nova.network.neutron [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.network.neutron [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Updating instance_info_cache with network_info: [{"id": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "address": "fa:16:3e:03:1c:93", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ce0c89-39", "ovs_interfaceid": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Releasing lock "refresh_cache-100c6ba5-de96-4c2a-ae0c-9d3a9199948c" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.compute.manager [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Instance network_info: |[{"id": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "address": "fa:16:3e:03:1c:93", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ce0c89-39", "ovs_interfaceid": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ce28faf4-26e4-4494-9df0-bf9df0c10634 req-d934858e-f58b-4559-b219-77c04bceeda6 service nova] Acquired lock "refresh_cache-100c6ba5-de96-4c2a-ae0c-9d3a9199948c" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.network.neutron [req-ce28faf4-26e4-4494-9df0-bf9df0c10634 req-d934858e-f58b-4559-b219-77c04bceeda6 service nova] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Refreshing network info cache for port 82ce0c89-3921-42d9-bfd8-d6bcab182f73 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Start _get_guest_xml network_info=[{"id": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "address": "fa:16:3e:03:1c:93", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ce0c89-39", "ovs_interfaceid": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:35:27 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:35:27 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:35:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1504165506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1504165506',id=32,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06cf84dc406343afa81260614acc8fdd',ramdisk_id='',reservation_id='r-sfo1zb8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:35:25Z,user_data=None,user_id='ae306b319e8c4e61b0a73933dc5c330c',uuid=100c6ba5-de96-4c2a-ae0c-9d3a9199948c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "address": "fa:16:3e:03:1c:93", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ce0c89-39", "ovs_interfaceid": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converting VIF {"id": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "address": "fa:16:3e:03:1c:93", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ce0c89-39", "ovs_interfaceid": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:1c:93,bridge_name='br-int',has_traffic_filtering=True,id=82ce0c89-3921-42d9-bfd8-d6bcab182f73,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ce0c89-39') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.objects.instance [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'pci_devices' on Instance uuid 100c6ba5-de96-4c2a-ae0c-9d3a9199948c {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:35:27 user nova-compute[70243]:   <uuid>100c6ba5-de96-4c2a-ae0c-9d3a9199948c</uuid>
Jul 24 16:35:27 user nova-compute[70243]:   <name>instance-00000020</name>
Jul 24 16:35:27 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:35:27 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:35:27 user nova-compute[70243]:   <metadata>
Jul 24 16:35:27 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:35:27 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:35:27 user nova-compute[70243]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1504165506</nova:name>
Jul 24 16:35:27 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:35:27</nova:creationTime>
Jul 24 16:35:27 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:35:27 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:35:27 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:35:27 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:35:27 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:35:27 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:35:27 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:35:27 user nova-compute[70243]:       <nova:owner>
Jul 24 16:35:27 user nova-compute[70243]:         <nova:user uuid="ae306b319e8c4e61b0a73933dc5c330c">tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member</nova:user>
Jul 24 16:35:27 user nova-compute[70243]:         <nova:project uuid="06cf84dc406343afa81260614acc8fdd">tempest-ServerBootFromVolumeStableRescueTest-1579673828</nova:project>
Jul 24 16:35:27 user nova-compute[70243]:       </nova:owner>
Jul 24 16:35:27 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:35:27 user nova-compute[70243]:       <nova:ports>
Jul 24 16:35:27 user nova-compute[70243]:         <nova:port uuid="82ce0c89-3921-42d9-bfd8-d6bcab182f73">
Jul 24 16:35:27 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 24 16:35:27 user nova-compute[70243]:         </nova:port>
Jul 24 16:35:27 user nova-compute[70243]:       </nova:ports>
Jul 24 16:35:27 user nova-compute[70243]:     </nova:instance>
Jul 24 16:35:27 user nova-compute[70243]:   </metadata>
Jul 24 16:35:27 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:35:27 user nova-compute[70243]:     <system>
Jul 24 16:35:27 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:35:27 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:35:27 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:35:27 user nova-compute[70243]:       <entry name="serial">100c6ba5-de96-4c2a-ae0c-9d3a9199948c</entry>
Jul 24 16:35:27 user nova-compute[70243]:       <entry name="uuid">100c6ba5-de96-4c2a-ae0c-9d3a9199948c</entry>
Jul 24 16:35:27 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:35:27 user nova-compute[70243]:     </system>
Jul 24 16:35:27 user nova-compute[70243]:   </sysinfo>
Jul 24 16:35:27 user nova-compute[70243]:   <os>
Jul 24 16:35:27 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:35:27 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:35:27 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:35:27 user nova-compute[70243]:   </os>
Jul 24 16:35:27 user nova-compute[70243]:   <features>
Jul 24 16:35:27 user nova-compute[70243]:     <acpi/>
Jul 24 16:35:27 user nova-compute[70243]:     <apic/>
Jul 24 16:35:27 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:35:27 user nova-compute[70243]:   </features>
Jul 24 16:35:27 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:35:27 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:35:27 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:35:27 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:35:27 user nova-compute[70243]:   </clock>
Jul 24 16:35:27 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:35:27 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:35:27 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:35:27 user nova-compute[70243]:   </cpu>
Jul 24 16:35:27 user nova-compute[70243]:   <devices>
Jul 24 16:35:27 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:35:27 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:35:27 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk"/>
Jul 24 16:35:27 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:35:27 user nova-compute[70243]:     </disk>
Jul 24 16:35:27 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:35:27 user nova-compute[70243]:       <mac address="fa:16:3e:03:1c:93"/>
Jul 24 16:35:27 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:35:27 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:35:27 user nova-compute[70243]:       <target dev="tap82ce0c89-39"/>
Jul 24 16:35:27 user nova-compute[70243]:     </interface>
Jul 24 16:35:27 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:35:27 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/console.log" append="off"/>
Jul 24 16:35:27 user nova-compute[70243]:     </serial>
Jul 24 16:35:27 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:35:27 user nova-compute[70243]:     <video>
Jul 24 16:35:27 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:35:27 user nova-compute[70243]:     </video>
Jul 24 16:35:27 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:35:27 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:35:27 user nova-compute[70243]:     </rng>
Jul 24 16:35:27 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:35:27 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:35:27 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:35:27 user nova-compute[70243]:     </memballoon>
Jul 24 16:35:27 user nova-compute[70243]:   </devices>
Jul 24 16:35:27 user nova-compute[70243]: </domain>
Jul 24 16:35:27 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:35:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1504165506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1504165506',id=32,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06cf84dc406343afa81260614acc8fdd',ramdisk_id='',reservation_id='r-sfo1zb8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:35:25Z,user_data=None,user_id='ae306b319e8c4e61b0a73933dc5c330c',uuid=100c6ba5-de96-4c2a-ae0c-9d3a9199948c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "address": "fa:16:3e:03:1c:93", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ce0c89-39", "ovs_interfaceid": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converting VIF {"id": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "address": "fa:16:3e:03:1c:93", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ce0c89-39", "ovs_interfaceid": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:1c:93,bridge_name='br-int',has_traffic_filtering=True,id=82ce0c89-3921-42d9-bfd8-d6bcab182f73,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ce0c89-39') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG os_vif [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:1c:93,bridge_name='br-int',has_traffic_filtering=True,id=82ce0c89-3921-42d9-bfd8-d6bcab182f73,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ce0c89-39') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82ce0c89-39, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap82ce0c89-39, col_values=(('external_ids', {'iface-id': '82ce0c89-3921-42d9-bfd8-d6bcab182f73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:1c:93', 'vm-uuid': '100c6ba5-de96-4c2a-ae0c-9d3a9199948c'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:27 user nova-compute[70243]: INFO os_vif [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:1c:93,bridge_name='br-int',has_traffic_filtering=True,id=82ce0c89-3921-42d9-bfd8-d6bcab182f73,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ce0c89-39')
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] No VIF found with MAC fa:16:3e:03:1c:93, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "beab81a6-209a-4d8d-8980-365ff2dc3cff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "beab81a6-209a-4d8d-8980-365ff2dc3cff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.network.neutron [req-ce28faf4-26e4-4494-9df0-bf9df0c10634 req-d934858e-f58b-4559-b219-77c04bceeda6 service nova] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Updated VIF entry in instance network info cache for port 82ce0c89-3921-42d9-bfd8-d6bcab182f73. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.network.neutron [req-ce28faf4-26e4-4494-9df0-bf9df0c10634 req-d934858e-f58b-4559-b219-77c04bceeda6 service nova] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Updating instance_info_cache with network_info: [{"id": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "address": "fa:16:3e:03:1c:93", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ce0c89-39", "ovs_interfaceid": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ce28faf4-26e4-4494-9df0-bf9df0c10634 req-d934858e-f58b-4559-b219-77c04bceeda6 service nova] Releasing lock "refresh_cache-100c6ba5-de96-4c2a-ae0c-9d3a9199948c" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:35:27 user nova-compute[70243]: INFO nova.compute.claims [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Claim successful on node user
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:35:27 user nova-compute[70243]: DEBUG nova.network.neutron [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:35:28 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:35:28 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG nova.policy [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8df18929107a458194a9c528d9bdfeac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e819e22e590947478d513e1b9ad39494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:35:28 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Creating image(s)
Jul 24 16:35:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "/opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "/opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "/opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.134s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.142s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/disk 1073741824" returned: 0 in 0.046s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.165s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Checking if we can resize image /opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-ed60ea64-40ae-405a-b356-bee033669d61 req-04d799c3-8ac1-4a3d-bfe2-08dd5cda4872 service nova] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Received event network-vif-plugged-82ce0c89-3921-42d9-bfd8-d6bcab182f73 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ed60ea64-40ae-405a-b356-bee033669d61 req-04d799c3-8ac1-4a3d-bfe2-08dd5cda4872 service nova] Acquiring lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ed60ea64-40ae-405a-b356-bee033669d61 req-04d799c3-8ac1-4a3d-bfe2-08dd5cda4872 service nova] Lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ed60ea64-40ae-405a-b356-bee033669d61 req-04d799c3-8ac1-4a3d-bfe2-08dd5cda4872 service nova] Lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-ed60ea64-40ae-405a-b356-bee033669d61 req-04d799c3-8ac1-4a3d-bfe2-08dd5cda4872 service nova] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] No waiting events found dispatching network-vif-plugged-82ce0c89-3921-42d9-bfd8-d6bcab182f73 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:35:28 user nova-compute[70243]: WARNING nova.compute.manager [req-ed60ea64-40ae-405a-b356-bee033669d61 req-04d799c3-8ac1-4a3d-bfe2-08dd5cda4872 service nova] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Received unexpected event network-vif-plugged-82ce0c89-3921-42d9-bfd8-d6bcab182f73 for instance with vm_state building and task_state spawning.
Jul 24 16:35:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Cannot resize image /opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG nova.objects.instance [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lazy-loading 'migration_context' on Instance uuid beab81a6-209a-4d8d-8980-365ff2dc3cff {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Ensure instance console log exists: /opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:28 user nova-compute[70243]: DEBUG nova.network.neutron [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Successfully created port: 97c822af-71d3-4352-8cb4-544bc125e38f {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:35:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:29 user nova-compute[70243]: DEBUG nova.network.neutron [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Successfully updated port: 97c822af-71d3-4352-8cb4-544bc125e38f {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:35:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "refresh_cache-beab81a6-209a-4d8d-8980-365ff2dc3cff" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:35:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquired lock "refresh_cache-beab81a6-209a-4d8d-8980-365ff2dc3cff" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:35:29 user nova-compute[70243]: DEBUG nova.network.neutron [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:35:29 user nova-compute[70243]: DEBUG nova.network.neutron [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:35:29 user nova-compute[70243]: DEBUG nova.compute.manager [req-1728b5c2-9cd4-482f-a953-0a5d4fa8b46c req-0ad2416c-0bbb-45b9-8c4b-e1db0799d8ec service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Received event network-changed-97c822af-71d3-4352-8cb4-544bc125e38f {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:35:29 user nova-compute[70243]: DEBUG nova.compute.manager [req-1728b5c2-9cd4-482f-a953-0a5d4fa8b46c req-0ad2416c-0bbb-45b9-8c4b-e1db0799d8ec service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Refreshing instance network info cache due to event network-changed-97c822af-71d3-4352-8cb4-544bc125e38f. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:35:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1728b5c2-9cd4-482f-a953-0a5d4fa8b46c req-0ad2416c-0bbb-45b9-8c4b-e1db0799d8ec service nova] Acquiring lock "refresh_cache-beab81a6-209a-4d8d-8980-365ff2dc3cff" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:35:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.network.neutron [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Updating instance_info_cache with network_info: [{"id": "97c822af-71d3-4352-8cb4-544bc125e38f", "address": "fa:16:3e:86:60:5d", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c822af-71", "ovs_interfaceid": "97c822af-71d3-4352-8cb4-544bc125e38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Releasing lock "refresh_cache-beab81a6-209a-4d8d-8980-365ff2dc3cff" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Instance network_info: |[{"id": "97c822af-71d3-4352-8cb4-544bc125e38f", "address": "fa:16:3e:86:60:5d", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c822af-71", "ovs_interfaceid": "97c822af-71d3-4352-8cb4-544bc125e38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1728b5c2-9cd4-482f-a953-0a5d4fa8b46c req-0ad2416c-0bbb-45b9-8c4b-e1db0799d8ec service nova] Acquired lock "refresh_cache-beab81a6-209a-4d8d-8980-365ff2dc3cff" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.network.neutron [req-1728b5c2-9cd4-482f-a953-0a5d4fa8b46c req-0ad2416c-0bbb-45b9-8c4b-e1db0799d8ec service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Refreshing network info cache for port 97c822af-71d3-4352-8cb4-544bc125e38f {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Start _get_guest_xml network_info=[{"id": "97c822af-71d3-4352-8cb4-544bc125e38f", "address": "fa:16:3e:86:60:5d", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c822af-71", "ovs_interfaceid": "97c822af-71d3-4352-8cb4-544bc125e38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:35:30 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:35:30 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:35:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-239439492',display_name='tempest-AttachVolumeNegativeTest-server-239439492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-239439492',id=33,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcfSPSXZEL8d7XgdpA8txqUaX0Pt0TZeH6YO5c4Soib5lK0PAU+SctMZxUJ8vxQhi+/seD0RMPskzDoDYbf22dR3UDbQkJk2lEoKjqBaZA79itxtkUD0HC+HzGNlsq4YQ==',key_name='tempest-keypair-451306606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e819e22e590947478d513e1b9ad39494',ramdisk_id='',reservation_id='r-vhmw8byx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1152214105',owner_user_name='tempest-AttachVolumeNegativeTest-1152214105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:35:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df18929107a458194a9c528d9bdfeac',uuid=beab81a6-209a-4d8d-8980-365ff2dc3cff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97c822af-71d3-4352-8cb4-544bc125e38f", "address": "fa:16:3e:86:60:5d", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c822af-71", "ovs_interfaceid": "97c822af-71d3-4352-8cb4-544bc125e38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converting VIF {"id": "97c822af-71d3-4352-8cb4-544bc125e38f", "address": "fa:16:3e:86:60:5d", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c822af-71", "ovs_interfaceid": "97c822af-71d3-4352-8cb4-544bc125e38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:60:5d,bridge_name='br-int',has_traffic_filtering=True,id=97c822af-71d3-4352-8cb4-544bc125e38f,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c822af-71') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.objects.instance [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lazy-loading 'pci_devices' on Instance uuid beab81a6-209a-4d8d-8980-365ff2dc3cff {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:35:30 user nova-compute[70243]:   <uuid>beab81a6-209a-4d8d-8980-365ff2dc3cff</uuid>
Jul 24 16:35:30 user nova-compute[70243]:   <name>instance-00000021</name>
Jul 24 16:35:30 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:35:30 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:35:30 user nova-compute[70243]:   <metadata>
Jul 24 16:35:30 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:35:30 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:35:30 user nova-compute[70243]:       <nova:name>tempest-AttachVolumeNegativeTest-server-239439492</nova:name>
Jul 24 16:35:30 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:35:30</nova:creationTime>
Jul 24 16:35:30 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:35:30 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:35:30 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:35:30 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:35:30 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:35:30 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:35:30 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:35:30 user nova-compute[70243]:       <nova:owner>
Jul 24 16:35:30 user nova-compute[70243]:         <nova:user uuid="8df18929107a458194a9c528d9bdfeac">tempest-AttachVolumeNegativeTest-1152214105-project-member</nova:user>
Jul 24 16:35:30 user nova-compute[70243]:         <nova:project uuid="e819e22e590947478d513e1b9ad39494">tempest-AttachVolumeNegativeTest-1152214105</nova:project>
Jul 24 16:35:30 user nova-compute[70243]:       </nova:owner>
Jul 24 16:35:30 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:35:30 user nova-compute[70243]:       <nova:ports>
Jul 24 16:35:30 user nova-compute[70243]:         <nova:port uuid="97c822af-71d3-4352-8cb4-544bc125e38f">
Jul 24 16:35:30 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 16:35:30 user nova-compute[70243]:         </nova:port>
Jul 24 16:35:30 user nova-compute[70243]:       </nova:ports>
Jul 24 16:35:30 user nova-compute[70243]:     </nova:instance>
Jul 24 16:35:30 user nova-compute[70243]:   </metadata>
Jul 24 16:35:30 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:35:30 user nova-compute[70243]:     <system>
Jul 24 16:35:30 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:35:30 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:35:30 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:35:30 user nova-compute[70243]:       <entry name="serial">beab81a6-209a-4d8d-8980-365ff2dc3cff</entry>
Jul 24 16:35:30 user nova-compute[70243]:       <entry name="uuid">beab81a6-209a-4d8d-8980-365ff2dc3cff</entry>
Jul 24 16:35:30 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:35:30 user nova-compute[70243]:     </system>
Jul 24 16:35:30 user nova-compute[70243]:   </sysinfo>
Jul 24 16:35:30 user nova-compute[70243]:   <os>
Jul 24 16:35:30 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:35:30 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:35:30 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:35:30 user nova-compute[70243]:   </os>
Jul 24 16:35:30 user nova-compute[70243]:   <features>
Jul 24 16:35:30 user nova-compute[70243]:     <acpi/>
Jul 24 16:35:30 user nova-compute[70243]:     <apic/>
Jul 24 16:35:30 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:35:30 user nova-compute[70243]:   </features>
Jul 24 16:35:30 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:35:30 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:35:30 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:35:30 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:35:30 user nova-compute[70243]:   </clock>
Jul 24 16:35:30 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:35:30 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:35:30 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:35:30 user nova-compute[70243]:   </cpu>
Jul 24 16:35:30 user nova-compute[70243]:   <devices>
Jul 24 16:35:30 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:35:30 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:35:30 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/disk"/>
Jul 24 16:35:30 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:35:30 user nova-compute[70243]:     </disk>
Jul 24 16:35:30 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:35:30 user nova-compute[70243]:       <mac address="fa:16:3e:86:60:5d"/>
Jul 24 16:35:30 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:35:30 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:35:30 user nova-compute[70243]:       <target dev="tap97c822af-71"/>
Jul 24 16:35:30 user nova-compute[70243]:     </interface>
Jul 24 16:35:30 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:35:30 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/console.log" append="off"/>
Jul 24 16:35:30 user nova-compute[70243]:     </serial>
Jul 24 16:35:30 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:35:30 user nova-compute[70243]:     <video>
Jul 24 16:35:30 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:35:30 user nova-compute[70243]:     </video>
Jul 24 16:35:30 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:35:30 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:35:30 user nova-compute[70243]:     </rng>
Jul 24 16:35:30 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:35:30 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:35:30 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:35:30 user nova-compute[70243]:     </memballoon>
Jul 24 16:35:30 user nova-compute[70243]:   </devices>
Jul 24 16:35:30 user nova-compute[70243]: </domain>
Jul 24 16:35:30 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:35:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-239439492',display_name='tempest-AttachVolumeNegativeTest-server-239439492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-239439492',id=33,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcfSPSXZEL8d7XgdpA8txqUaX0Pt0TZeH6YO5c4Soib5lK0PAU+SctMZxUJ8vxQhi+/seD0RMPskzDoDYbf22dR3UDbQkJk2lEoKjqBaZA79itxtkUD0HC+HzGNlsq4YQ==',key_name='tempest-keypair-451306606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e819e22e590947478d513e1b9ad39494',ramdisk_id='',reservation_id='r-vhmw8byx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1152214105',owner_user_name='tempest-AttachVolumeNegativeTest-1152214105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:35:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df18929107a458194a9c528d9bdfeac',uuid=beab81a6-209a-4d8d-8980-365ff2dc3cff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97c822af-71d3-4352-8cb4-544bc125e38f", "address": "fa:16:3e:86:60:5d", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c822af-71", "ovs_interfaceid": "97c822af-71d3-4352-8cb4-544bc125e38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converting VIF {"id": "97c822af-71d3-4352-8cb4-544bc125e38f", "address": "fa:16:3e:86:60:5d", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c822af-71", "ovs_interfaceid": "97c822af-71d3-4352-8cb4-544bc125e38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:60:5d,bridge_name='br-int',has_traffic_filtering=True,id=97c822af-71d3-4352-8cb4-544bc125e38f,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c822af-71') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG os_vif [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:60:5d,bridge_name='br-int',has_traffic_filtering=True,id=97c822af-71d3-4352-8cb4-544bc125e38f,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c822af-71') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97c822af-71, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap97c822af-71, col_values=(('external_ids', {'iface-id': '97c822af-71d3-4352-8cb4-544bc125e38f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:60:5d', 'vm-uuid': 'beab81a6-209a-4d8d-8980-365ff2dc3cff'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:30 user nova-compute[70243]: INFO os_vif [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:60:5d,bridge_name='br-int',has_traffic_filtering=True,id=97c822af-71d3-4352-8cb4-544bc125e38f,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c822af-71')
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] No VIF found with MAC fa:16:3e:86:60:5d, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216530.705926, 100c6ba5-de96-4c2a-ae0c-9d3a9199948c => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:35:30 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] VM Resumed (Lifecycle Event)
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.compute.manager [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:35:30 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Instance spawned successfully.
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:35:30 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216530.7105205, 100c6ba5-de96-4c2a-ae0c-9d3a9199948c => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:35:30 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] VM Started (Lifecycle Event)
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:35:30 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.network.neutron [req-1728b5c2-9cd4-482f-a953-0a5d4fa8b46c req-0ad2416c-0bbb-45b9-8c4b-e1db0799d8ec service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Updated VIF entry in instance network info cache for port 97c822af-71d3-4352-8cb4-544bc125e38f. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.network.neutron [req-1728b5c2-9cd4-482f-a953-0a5d4fa8b46c req-0ad2416c-0bbb-45b9-8c4b-e1db0799d8ec service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Updating instance_info_cache with network_info: [{"id": "97c822af-71d3-4352-8cb4-544bc125e38f", "address": "fa:16:3e:86:60:5d", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c822af-71", "ovs_interfaceid": "97c822af-71d3-4352-8cb4-544bc125e38f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1728b5c2-9cd4-482f-a953-0a5d4fa8b46c req-0ad2416c-0bbb-45b9-8c4b-e1db0799d8ec service nova] Releasing lock "refresh_cache-beab81a6-209a-4d8d-8980-365ff2dc3cff" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.compute.manager [req-152ce609-1af2-498b-8591-155d4ce79eb5 req-3d8d320a-ac5a-4a66-92a2-b6232fdfefd5 service nova] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Received event network-vif-plugged-82ce0c89-3921-42d9-bfd8-d6bcab182f73 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-152ce609-1af2-498b-8591-155d4ce79eb5 req-3d8d320a-ac5a-4a66-92a2-b6232fdfefd5 service nova] Acquiring lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-152ce609-1af2-498b-8591-155d4ce79eb5 req-3d8d320a-ac5a-4a66-92a2-b6232fdfefd5 service nova] Lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-152ce609-1af2-498b-8591-155d4ce79eb5 req-3d8d320a-ac5a-4a66-92a2-b6232fdfefd5 service nova] Lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.compute.manager [req-152ce609-1af2-498b-8591-155d4ce79eb5 req-3d8d320a-ac5a-4a66-92a2-b6232fdfefd5 service nova] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] No waiting events found dispatching network-vif-plugged-82ce0c89-3921-42d9-bfd8-d6bcab182f73 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:35:30 user nova-compute[70243]: WARNING nova.compute.manager [req-152ce609-1af2-498b-8591-155d4ce79eb5 req-3d8d320a-ac5a-4a66-92a2-b6232fdfefd5 service nova] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Received unexpected event network-vif-plugged-82ce0c89-3921-42d9-bfd8-d6bcab182f73 for instance with vm_state building and task_state spawning.
Jul 24 16:35:30 user nova-compute[70243]: INFO nova.compute.manager [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Took 5.89 seconds to spawn the instance on the hypervisor.
Jul 24 16:35:30 user nova-compute[70243]: DEBUG nova.compute.manager [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:35:30 user nova-compute[70243]: INFO nova.compute.manager [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Took 6.55 seconds to build instance.
Jul 24 16:35:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-537a5924-86ab-4944-b7b6-9f44893ab10e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.656s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:32 user nova-compute[70243]: DEBUG nova.compute.manager [req-38ed4882-3f1a-4589-937e-4835e0b7166e req-b8fa23e7-4017-4a62-bf5a-e2f4cc66dfd8 service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Received event network-vif-plugged-97c822af-71d3-4352-8cb4-544bc125e38f {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:35:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-38ed4882-3f1a-4589-937e-4835e0b7166e req-b8fa23e7-4017-4a62-bf5a-e2f4cc66dfd8 service nova] Acquiring lock "beab81a6-209a-4d8d-8980-365ff2dc3cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-38ed4882-3f1a-4589-937e-4835e0b7166e req-b8fa23e7-4017-4a62-bf5a-e2f4cc66dfd8 service nova] Lock "beab81a6-209a-4d8d-8980-365ff2dc3cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-38ed4882-3f1a-4589-937e-4835e0b7166e req-b8fa23e7-4017-4a62-bf5a-e2f4cc66dfd8 service nova] Lock "beab81a6-209a-4d8d-8980-365ff2dc3cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:32 user nova-compute[70243]: DEBUG nova.compute.manager [req-38ed4882-3f1a-4589-937e-4835e0b7166e req-b8fa23e7-4017-4a62-bf5a-e2f4cc66dfd8 service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] No waiting events found dispatching network-vif-plugged-97c822af-71d3-4352-8cb4-544bc125e38f {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:35:32 user nova-compute[70243]: WARNING nova.compute.manager [req-38ed4882-3f1a-4589-937e-4835e0b7166e req-b8fa23e7-4017-4a62-bf5a-e2f4cc66dfd8 service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Received unexpected event network-vif-plugged-97c822af-71d3-4352-8cb4-544bc125e38f for instance with vm_state building and task_state spawning.
Jul 24 16:35:32 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:32 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:32 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:34 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216534.0296795, beab81a6-209a-4d8d-8980-365ff2dc3cff => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:35:34 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] VM Resumed (Lifecycle Event)
Jul 24 16:35:34 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:35:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:35:34 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Instance spawned successfully.
Jul 24 16:35:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:35:34 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:35:34 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:35:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:35:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:35:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:35:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:35:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:35:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:35:34 user nova-compute[70243]: DEBUG nova.compute.manager [req-52ea090d-f98a-4e29-bb3b-b0a29eb9b8f2 req-df458f51-63bc-49ab-accd-b4f2f4f35d41 service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Received event network-vif-plugged-97c822af-71d3-4352-8cb4-544bc125e38f {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:35:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-52ea090d-f98a-4e29-bb3b-b0a29eb9b8f2 req-df458f51-63bc-49ab-accd-b4f2f4f35d41 service nova] Acquiring lock "beab81a6-209a-4d8d-8980-365ff2dc3cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-52ea090d-f98a-4e29-bb3b-b0a29eb9b8f2 req-df458f51-63bc-49ab-accd-b4f2f4f35d41 service nova] Lock "beab81a6-209a-4d8d-8980-365ff2dc3cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-52ea090d-f98a-4e29-bb3b-b0a29eb9b8f2 req-df458f51-63bc-49ab-accd-b4f2f4f35d41 service nova] Lock "beab81a6-209a-4d8d-8980-365ff2dc3cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:34 user nova-compute[70243]: DEBUG nova.compute.manager [req-52ea090d-f98a-4e29-bb3b-b0a29eb9b8f2 req-df458f51-63bc-49ab-accd-b4f2f4f35d41 service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] No waiting events found dispatching network-vif-plugged-97c822af-71d3-4352-8cb4-544bc125e38f {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:35:34 user nova-compute[70243]: WARNING nova.compute.manager [req-52ea090d-f98a-4e29-bb3b-b0a29eb9b8f2 req-df458f51-63bc-49ab-accd-b4f2f4f35d41 service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Received unexpected event network-vif-plugged-97c822af-71d3-4352-8cb4-544bc125e38f for instance with vm_state building and task_state spawning.
Jul 24 16:35:34 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:35:34 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216534.032209, beab81a6-209a-4d8d-8980-365ff2dc3cff => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:35:34 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] VM Started (Lifecycle Event)
Jul 24 16:35:34 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:35:34 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:35:34 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:35:34 user nova-compute[70243]: INFO nova.compute.manager [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Took 6.05 seconds to spawn the instance on the hypervisor.
Jul 24 16:35:34 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:35:34 user nova-compute[70243]: INFO nova.compute.manager [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Took 6.72 seconds to build instance.
Jul 24 16:35:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f896ffda-4745-4f9d-83f1-b03c622f732b tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "beab81a6-209a-4d8d-8980-365ff2dc3cff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.819s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:48 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:35:49 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:35:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:50 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:35:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Acquiring lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Acquiring lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:51 user nova-compute[70243]: INFO nova.compute.manager [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Terminating instance
Jul 24 16:35:51 user nova-compute[70243]: DEBUG nova.compute.manager [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:35:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:51 user nova-compute[70243]: DEBUG nova.compute.manager [req-a5174560-5049-4b8e-824a-68ef8c434cc4 req-160c9dd6-0abe-45d3-8ff9-cb52f65bb6af service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Received event network-vif-unplugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:35:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a5174560-5049-4b8e-824a-68ef8c434cc4 req-160c9dd6-0abe-45d3-8ff9-cb52f65bb6af service nova] Acquiring lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a5174560-5049-4b8e-824a-68ef8c434cc4 req-160c9dd6-0abe-45d3-8ff9-cb52f65bb6af service nova] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a5174560-5049-4b8e-824a-68ef8c434cc4 req-160c9dd6-0abe-45d3-8ff9-cb52f65bb6af service nova] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:51 user nova-compute[70243]: DEBUG nova.compute.manager [req-a5174560-5049-4b8e-824a-68ef8c434cc4 req-160c9dd6-0abe-45d3-8ff9-cb52f65bb6af service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] No waiting events found dispatching network-vif-unplugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:35:51 user nova-compute[70243]: DEBUG nova.compute.manager [req-a5174560-5049-4b8e-824a-68ef8c434cc4 req-160c9dd6-0abe-45d3-8ff9-cb52f65bb6af service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Received event network-vif-unplugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:35:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:52 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Instance destroyed successfully.
Jul 24 16:35:52 user nova-compute[70243]: DEBUG nova.objects.instance [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Lazy-loading 'resources' on Instance uuid 05bfd953-bb4b-4eaf-a304-ccb040d8f429 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:34:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1463520658',display_name='tempest-VolumesNegativeTest-instance-1463520658',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1463520658',id=29,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:34:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9902b100289b42d4b8202bc3f46cbb2a',ramdisk_id='',reservation_id='r-4877am03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2096213440',owner_user_name='tempest-VolumesNegativeTest-2096213440-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:34:08Z,user_data=None,user_id='cb51eee63719438daaf0a9575f518068',uuid=05bfd953-bb4b-4eaf-a304-ccb040d8f429,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0", "address": "fa:16:3e:8b:1f:a1", "network": {"id": "9cb7b437-8cb6-4435-9d32-6ade2468c7fd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ea761b45d5e428287fb9fa480f5d4c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f5dae4-4b", "ovs_interfaceid": "94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Converting VIF {"id": "94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0", "address": "fa:16:3e:8b:1f:a1", "network": {"id": "9cb7b437-8cb6-4435-9d32-6ade2468c7fd", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6ea761b45d5e428287fb9fa480f5d4c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f5dae4-4b", "ovs_interfaceid": "94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0,network=Network(9cb7b437-8cb6-4435-9d32-6ade2468c7fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f5dae4-4b') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG os_vif [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0,network=Network(9cb7b437-8cb6-4435-9d32-6ade2468c7fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f5dae4-4b') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94f5dae4-4b, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:52 user nova-compute[70243]: INFO os_vif [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:1f:a1,bridge_name='br-int',has_traffic_filtering=True,id=94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0,network=Network(9cb7b437-8cb6-4435-9d32-6ade2468c7fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f5dae4-4b')
Jul 24 16:35:52 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Deleting instance files /opt/stack/data/nova/instances/05bfd953-bb4b-4eaf-a304-ccb040d8f429_del
Jul 24 16:35:52 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Deletion of /opt/stack/data/nova/instances/05bfd953-bb4b-4eaf-a304-ccb040d8f429_del complete
Jul 24 16:35:52 user nova-compute[70243]: INFO nova.compute.manager [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Took 0.93 seconds to destroy the instance on the hypervisor.
Jul 24 16:35:52 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:35:53 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Took 0.64 seconds to deallocate network for instance.
Jul 24 16:35:53 user nova-compute[70243]: DEBUG nova.compute.manager [req-5dbfd110-cfc8-411a-b480-6b634cfff001 req-7a619f2d-6a08-4044-ae78-fea79dd81765 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Received event network-vif-deleted-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:35:53 user nova-compute[70243]: INFO nova.compute.manager [req-5dbfd110-cfc8-411a-b480-6b634cfff001 req-7a619f2d-6a08-4044-ae78-fea79dd81765 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Neutron deleted interface 94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0; detaching it from the instance and deleting it from the info cache
Jul 24 16:35:53 user nova-compute[70243]: DEBUG nova.network.neutron [req-5dbfd110-cfc8-411a-b480-6b634cfff001 req-7a619f2d-6a08-4044-ae78-fea79dd81765 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG nova.compute.manager [req-5dbfd110-cfc8-411a-b480-6b634cfff001 req-7a619f2d-6a08-4044-ae78-fea79dd81765 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Detach interface failed, port_id=94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0, reason: Instance 05bfd953-bb4b-4eaf-a304-ccb040d8f429 could not be found. {{(pid=70243) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:53 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Deleted allocations for instance 05bfd953-bb4b-4eaf-a304-ccb040d8f429
Jul 24 16:35:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-05e02b98-d7b1-49e7-a168-bd9a41c14847 tempest-VolumesNegativeTest-2096213440 tempest-VolumesNegativeTest-2096213440-project-member] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.054s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG nova.compute.manager [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Received event network-vif-plugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] Acquiring lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG nova.compute.manager [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] No waiting events found dispatching network-vif-plugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:35:53 user nova-compute[70243]: WARNING nova.compute.manager [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Received unexpected event network-vif-plugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 for instance with vm_state deleted and task_state None.
Jul 24 16:35:53 user nova-compute[70243]: DEBUG nova.compute.manager [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Received event network-vif-plugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] Acquiring lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG nova.compute.manager [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] No waiting events found dispatching network-vif-plugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:35:53 user nova-compute[70243]: WARNING nova.compute.manager [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Received unexpected event network-vif-plugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 for instance with vm_state deleted and task_state None.
Jul 24 16:35:53 user nova-compute[70243]: DEBUG nova.compute.manager [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Received event network-vif-plugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] Acquiring lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG nova.compute.manager [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] No waiting events found dispatching network-vif-plugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:35:53 user nova-compute[70243]: WARNING nova.compute.manager [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Received unexpected event network-vif-plugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 for instance with vm_state deleted and task_state None.
Jul 24 16:35:53 user nova-compute[70243]: DEBUG nova.compute.manager [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Received event network-vif-unplugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] Acquiring lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG nova.compute.manager [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] No waiting events found dispatching network-vif-unplugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:35:53 user nova-compute[70243]: WARNING nova.compute.manager [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Received unexpected event network-vif-unplugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 for instance with vm_state deleted and task_state None.
Jul 24 16:35:53 user nova-compute[70243]: DEBUG nova.compute.manager [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Received event network-vif-plugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] Acquiring lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] Lock "05bfd953-bb4b-4eaf-a304-ccb040d8f429-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:53 user nova-compute[70243]: DEBUG nova.compute.manager [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] No waiting events found dispatching network-vif-plugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:35:53 user nova-compute[70243]: WARNING nova.compute.manager [req-98a3ea96-725d-4e0c-b9e5-ec69b513ad27 req-568b778a-8266-4069-8ebf-5de0067a4b39 service nova] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Received unexpected event network-vif-plugged-94f5dae4-4bb6-4ba3-ae42-0fe6a713fcd0 for instance with vm_state deleted and task_state None.
Jul 24 16:35:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:55 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:35:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:35:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:35:57 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:35:57 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:35:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:35:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:35:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:35:57 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:35:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:35:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:35:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:00 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:36:00 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:36:00 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=7701MB free_disk=24.245391845703125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:36:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:36:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:36:00 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 50fecb3a-8f06-4822-8c84-76df51acfe50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:36:00 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6f2258de-6b31-48af-81df-37b64da4ca99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:36:00 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 0cceb071-c478-4914-8243-77c3efbdb5d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:36:00 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8eb4450c-bf08-4949-a126-d30dbb3ea744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:36:00 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 75b26864-1539-4106-b741-3b3f5c7e898a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:36:00 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 100c6ba5-de96-4c2a-ae0c-9d3a9199948c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:36:00 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance beab81a6-209a-4d8d-8980-365ff2dc3cff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:36:00 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:36:00 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:36:00 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:36:00 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:36:00 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:36:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.412s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:36:01 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:36:01 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:36:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:36:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-6f2258de-6b31-48af-81df-37b64da4ca99" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:36:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-6f2258de-6b31-48af-81df-37b64da4ca99" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:36:01 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:36:02 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Updating instance_info_cache with network_info: [{"id": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "address": "fa:16:3e:d4:bf:cd", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a2f7cb-1b", "ovs_interfaceid": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:36:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-6f2258de-6b31-48af-81df-37b64da4ca99" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:36:02 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:36:02 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:36:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-d3ead4ba-c7a6-469d-8db7-bdd30195310c req-0fb66149-90f6-4be0-9352-e3f179a71053 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received event network-changed-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:36:05 user nova-compute[70243]: DEBUG nova.compute.manager [req-d3ead4ba-c7a6-469d-8db7-bdd30195310c req-0fb66149-90f6-4be0-9352-e3f179a71053 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Refreshing instance network info cache due to event network-changed-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:36:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d3ead4ba-c7a6-469d-8db7-bdd30195310c req-0fb66149-90f6-4be0-9352-e3f179a71053 service nova] Acquiring lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:36:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d3ead4ba-c7a6-469d-8db7-bdd30195310c req-0fb66149-90f6-4be0-9352-e3f179a71053 service nova] Acquired lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:36:05 user nova-compute[70243]: DEBUG nova.network.neutron [req-d3ead4ba-c7a6-469d-8db7-bdd30195310c req-0fb66149-90f6-4be0-9352-e3f179a71053 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Refreshing network info cache for port 31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:36:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "0cceb071-c478-4914-8243-77c3efbdb5d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:36:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:36:05 user nova-compute[70243]: DEBUG nova.objects.instance [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'flavor' on Instance uuid 0cceb071-c478-4914-8243-77c3efbdb5d3 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:36:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "0cceb071-c478-4914-8243-77c3efbdb5d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:36:06 user nova-compute[70243]: INFO nova.compute.manager [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Attaching volume 79b94848-a2c7-4833-9913-04747fd4af17 to /dev/vdb
Jul 24 16:36:06 user nova-compute[70243]: DEBUG nova.network.neutron [req-d3ead4ba-c7a6-469d-8db7-bdd30195310c req-0fb66149-90f6-4be0-9352-e3f179a71053 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Updated VIF entry in instance network info cache for port 31e9e4c6-7d4c-4077-a725-02e3b9f6f61a. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG nova.network.neutron [req-d3ead4ba-c7a6-469d-8db7-bdd30195310c req-0fb66149-90f6-4be0-9352-e3f179a71053 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Updating instance_info_cache with network_info: [{"id": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "address": "fa:16:3e:46:16:b8", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e9e4c6-7d", "ovs_interfaceid": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG os_brick.utils [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d3ead4ba-c7a6-469d-8db7-bdd30195310c req-0fb66149-90f6-4be0-9352-e3f179a71053 service nova] Releasing lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9869fd6-8ed2-4ed2-bfbf-f4aa9cb27632]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fac2e24-af1a-4537-8299-e7a7e8969e39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.069s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa2aaec-5049-4a32-b937-3c1819d95275]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05f4308-9485-4138-b7ed-7434f0746e70]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:36:06 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:36:06 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1915f0f1-b616-4a95-b66b-b597e086da44]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG os_brick.utils [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:36:06 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Updating existing volume attachment record: 11154309-6dd9-4cdb-9a57-3d8fcf36a936 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:36:07 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216552.2186513, 05bfd953-bb4b-4eaf-a304-ccb040d8f429 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:36:07 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] VM Stopped (Lifecycle Event)
Jul 24 16:36:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-11c14191-b38d-49b7-aab5-101873413c31 None None] [instance: 05bfd953-bb4b-4eaf-a304-ccb040d8f429] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:36:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlvVbjgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:36:12 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:36:12 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:36:12 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecedfb7f-d102-4a25-8474-cd7394cfb3ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:36:12 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42c1f60-e3ee-40ef-9e63-6627272b02bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17] added
Jul 24 16:36:12 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b135d1b5-529b-400c-880d-bff5c09ba0ac]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa261b3c-2412-4564-97ee-154d154bfdf9]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XlvVbjgT {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XlvVbjgT" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7f411f-4912-4288-99ee-5006365ea5d6]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XlvVbjgT'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1801771-e168-4b3e-950f-56061aa85ac4]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda7a518-a68e-46e1-9937-bf54a3328f88]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 16:36:12 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 16:36:12 user nova-compute[70243]:  {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:36:12 user nova-compute[70243]: WARNING os_brick.initiator.connectors.iscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 16:36:12 user nova-compute[70243]: 
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[964b1d11-08e8-4c97-81da-c931d76684ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17, portal: 172.16.0.220,3260]
Jul 24 16:36:12 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17, portal: 172.16.0.220,3260] successful.
Jul 24 16:36:12 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f5d65e-d6c0-4d92-8ee5-866fde527a1a]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f192eda-1606-4f80-8ec6-90c19c3eb3e3]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:36:12 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:36:12 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1be918-b15a-4954-aec8-144de809d1d7]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:36:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlvVbjgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:36:13 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:36:13 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23234373266613333', 'path': '/dev/sdb'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:36:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234373266613333', 'path': '/dev/sdb'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:36:13 user nova-compute[70243]: DEBUG nova.objects.instance [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'flavor' on Instance uuid 0cceb071-c478-4914-8243-77c3efbdb5d3 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:36:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:36:13 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:36:13 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:36:13 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:36:13 user nova-compute[70243]:   <serial>79b94848-a2c7-4833-9913-04747fd4af17</serial>
Jul 24 16:36:13 user nova-compute[70243]: </disk>
Jul 24 16:36:13 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:36:14 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:36:14 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:36:14 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] No VIF found with MAC fa:16:3e:46:16:b8, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:36:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-53c30771-7afa-41d3-8f55-001ff844a14d tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.383s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:36:14 user nova-compute[70243]: INFO nova.compute.manager [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Rescuing
Jul 24 16:36:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:36:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquired lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:36:14 user nova-compute[70243]: DEBUG nova.network.neutron [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:36:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:15 user nova-compute[70243]: DEBUG nova.network.neutron [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Updating instance_info_cache with network_info: [{"id": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "address": "fa:16:3e:46:16:b8", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e9e4c6-7d", "ovs_interfaceid": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:36:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Releasing lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:36:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.compute.manager [req-84950e64-6c9b-4a8a-9ee1-539579cb6c0e req-67299b57-4fa4-434a-b28a-b8cde0eee3f2 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received event network-vif-unplugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-84950e64-6c9b-4a8a-9ee1-539579cb6c0e req-67299b57-4fa4-434a-b28a-b8cde0eee3f2 service nova] Acquiring lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-84950e64-6c9b-4a8a-9ee1-539579cb6c0e req-67299b57-4fa4-434a-b28a-b8cde0eee3f2 service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-84950e64-6c9b-4a8a-9ee1-539579cb6c0e req-67299b57-4fa4-434a-b28a-b8cde0eee3f2 service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.compute.manager [req-84950e64-6c9b-4a8a-9ee1-539579cb6c0e req-67299b57-4fa4-434a-b28a-b8cde0eee3f2 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] No waiting events found dispatching network-vif-unplugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:36:16 user nova-compute[70243]: WARNING nova.compute.manager [req-84950e64-6c9b-4a8a-9ee1-539579cb6c0e req-67299b57-4fa4-434a-b28a-b8cde0eee3f2 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received unexpected event network-vif-unplugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a for instance with vm_state active and task_state rescuing.
Jul 24 16:36:16 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:16 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Instance destroyed successfully.
Jul 24 16:36:16 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Attempting rescue
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70243) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Instance directory exists: not creating {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 16:36:16 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Creating image(s)
Jul 24 16:36:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "/opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "/opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "/opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.objects.instance [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0cceb071-c478-4914-8243-77c3efbdb5d3 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.149s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk.rescue {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk.rescue" returned: 0 in 0.190s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.345s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.objects.instance [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'migration_context' on Instance uuid 0cceb071-c478-4914-8243-77c3efbdb5d3 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Start _get_guest_xml network_info=[{"id": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "address": "fa:16:3e:46:16:b8", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "vif_mac": "fa:16:3e:46:16:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e9e4c6-7d", "ovs_interfaceid": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.objects.instance [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'resources' on Instance uuid 0cceb071-c478-4914-8243-77c3efbdb5d3 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.objects.instance [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'numa_topology' on Instance uuid 0cceb071-c478-4914-8243-77c3efbdb5d3 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:36:16 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:36:16 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:36:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "8eb4450c-bf08-4949-a126-d30dbb3ea744" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:36:16 user nova-compute[70243]: INFO nova.compute.manager [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Terminating instance
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:36:16 user nova-compute[70243]: DEBUG nova.objects.instance [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0cceb071-c478-4914-8243-77c3efbdb5d3 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:36:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:34:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-674586026',display_name='tempest-ServerRescueNegativeTestJSON-server-674586026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-674586026',id=30,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuU6JYcS7LI0dMV51kZaOp9oaBO7Yr+j/yzhEYlC/QFScz4HdKIfkBYKmCyDus2pxFhM6QsjAcT5q3iW8P89kzGFTNoGUkewoJ2IFeiomz5ox1neIK2P3bIiJHIeWHoXg==',key_name='tempest-keypair-2085747341',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:34:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c25474ae9fb49cb92c611e77f2dbc79',ramdisk_id='',reservation_id='r-3rqt6k04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1414931075',owner_user_name='tempest-ServerRescueNegativeTestJSON-1414931075-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:34:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcb7fb5c11bb4d65b9c39923840685c6',uuid=0cceb071-c478-4914-8243-77c3efbdb5d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "address": "fa:16:3e:46:16:b8", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "vif_mac": "fa:16:3e:46:16:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e9e4c6-7d", "ovs_interfaceid": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:36:17 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converting VIF {"id": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "address": "fa:16:3e:46:16:b8", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "vif_mac": "fa:16:3e:46:16:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e9e4c6-7d", "ovs_interfaceid": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:36:17 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:16:b8,bridge_name='br-int',has_traffic_filtering=True,id=31e9e4c6-7d4c-4077-a725-02e3b9f6f61a,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e9e4c6-7d') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:36:17 user nova-compute[70243]: DEBUG nova.objects.instance [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'pci_devices' on Instance uuid 0cceb071-c478-4914-8243-77c3efbdb5d3 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:36:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:36:17 user nova-compute[70243]:   <uuid>0cceb071-c478-4914-8243-77c3efbdb5d3</uuid>
Jul 24 16:36:17 user nova-compute[70243]:   <name>instance-0000001e</name>
Jul 24 16:36:17 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:36:17 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:36:17 user nova-compute[70243]:   <metadata>
Jul 24 16:36:17 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:36:17 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:36:17 user nova-compute[70243]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-674586026</nova:name>
Jul 24 16:36:17 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:36:16</nova:creationTime>
Jul 24 16:36:17 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:36:17 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:36:17 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:36:17 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:36:17 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:36:17 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:36:17 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:36:17 user nova-compute[70243]:       <nova:owner>
Jul 24 16:36:17 user nova-compute[70243]:         <nova:user uuid="fcb7fb5c11bb4d65b9c39923840685c6">tempest-ServerRescueNegativeTestJSON-1414931075-project-member</nova:user>
Jul 24 16:36:17 user nova-compute[70243]:         <nova:project uuid="9c25474ae9fb49cb92c611e77f2dbc79">tempest-ServerRescueNegativeTestJSON-1414931075</nova:project>
Jul 24 16:36:17 user nova-compute[70243]:       </nova:owner>
Jul 24 16:36:17 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:36:17 user nova-compute[70243]:       <nova:ports>
Jul 24 16:36:17 user nova-compute[70243]:         <nova:port uuid="31e9e4c6-7d4c-4077-a725-02e3b9f6f61a">
Jul 24 16:36:17 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 24 16:36:17 user nova-compute[70243]:         </nova:port>
Jul 24 16:36:17 user nova-compute[70243]:       </nova:ports>
Jul 24 16:36:17 user nova-compute[70243]:     </nova:instance>
Jul 24 16:36:17 user nova-compute[70243]:   </metadata>
Jul 24 16:36:17 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:36:17 user nova-compute[70243]:     <system>
Jul 24 16:36:17 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:36:17 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:36:17 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:36:17 user nova-compute[70243]:       <entry name="serial">0cceb071-c478-4914-8243-77c3efbdb5d3</entry>
Jul 24 16:36:17 user nova-compute[70243]:       <entry name="uuid">0cceb071-c478-4914-8243-77c3efbdb5d3</entry>
Jul 24 16:36:17 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:36:17 user nova-compute[70243]:     </system>
Jul 24 16:36:17 user nova-compute[70243]:   </sysinfo>
Jul 24 16:36:17 user nova-compute[70243]:   <os>
Jul 24 16:36:17 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:36:17 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:36:17 user nova-compute[70243]:   </os>
Jul 24 16:36:17 user nova-compute[70243]:   <features>
Jul 24 16:36:17 user nova-compute[70243]:     <acpi/>
Jul 24 16:36:17 user nova-compute[70243]:     <apic/>
Jul 24 16:36:17 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:36:17 user nova-compute[70243]:   </features>
Jul 24 16:36:17 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:36:17 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:36:17 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:36:17 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:36:17 user nova-compute[70243]:   </clock>
Jul 24 16:36:17 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:36:17 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:36:17 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:36:17 user nova-compute[70243]:   </cpu>
Jul 24 16:36:17 user nova-compute[70243]:   <devices>
Jul 24 16:36:17 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:36:17 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:36:17 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk.rescue"/>
Jul 24 16:36:17 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:36:17 user nova-compute[70243]:     </disk>
Jul 24 16:36:17 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:36:17 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:36:17 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk"/>
Jul 24 16:36:17 user nova-compute[70243]:       <target dev="vdb" bus="virtio"/>
Jul 24 16:36:17 user nova-compute[70243]:     </disk>
Jul 24 16:36:17 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:36:17 user nova-compute[70243]:       <mac address="fa:16:3e:46:16:b8"/>
Jul 24 16:36:17 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:36:17 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:36:17 user nova-compute[70243]:       <target dev="tap31e9e4c6-7d"/>
Jul 24 16:36:17 user nova-compute[70243]:     </interface>
Jul 24 16:36:17 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:36:17 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/console.log" append="off"/>
Jul 24 16:36:17 user nova-compute[70243]:     </serial>
Jul 24 16:36:17 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:36:17 user nova-compute[70243]:     <video>
Jul 24 16:36:17 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:36:17 user nova-compute[70243]:     </video>
Jul 24 16:36:17 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:36:17 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:36:17 user nova-compute[70243]:     </rng>
Jul 24 16:36:17 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:36:17 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:36:17 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:36:17 user nova-compute[70243]:     </memballoon>
Jul 24 16:36:17 user nova-compute[70243]:   </devices>
Jul 24 16:36:17 user nova-compute[70243]: </domain>
Jul 24 16:36:17 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:36:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:17 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Instance destroyed successfully.
Jul 24 16:36:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:36:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:36:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] No VIF found with MAC fa:16:3e:46:16:b8, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:36:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG nova.compute.manager [req-db230a7a-2ce3-4345-aaab-f70641d15a3a req-c28e007a-e1c6-43b4-9d3c-288997b6277c service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received event network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-db230a7a-2ce3-4345-aaab-f70641d15a3a req-c28e007a-e1c6-43b4-9d3c-288997b6277c service nova] Acquiring lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-db230a7a-2ce3-4345-aaab-f70641d15a3a req-c28e007a-e1c6-43b4-9d3c-288997b6277c service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-db230a7a-2ce3-4345-aaab-f70641d15a3a req-c28e007a-e1c6-43b4-9d3c-288997b6277c service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG nova.compute.manager [req-db230a7a-2ce3-4345-aaab-f70641d15a3a req-c28e007a-e1c6-43b4-9d3c-288997b6277c service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] No waiting events found dispatching network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:36:18 user nova-compute[70243]: WARNING nova.compute.manager [req-db230a7a-2ce3-4345-aaab-f70641d15a3a req-c28e007a-e1c6-43b4-9d3c-288997b6277c service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received unexpected event network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a for instance with vm_state active and task_state rescuing.
Jul 24 16:36:18 user nova-compute[70243]: DEBUG nova.compute.manager [req-db230a7a-2ce3-4345-aaab-f70641d15a3a req-c28e007a-e1c6-43b4-9d3c-288997b6277c service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Received event network-vif-unplugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-db230a7a-2ce3-4345-aaab-f70641d15a3a req-c28e007a-e1c6-43b4-9d3c-288997b6277c service nova] Acquiring lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-db230a7a-2ce3-4345-aaab-f70641d15a3a req-c28e007a-e1c6-43b4-9d3c-288997b6277c service nova] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-db230a7a-2ce3-4345-aaab-f70641d15a3a req-c28e007a-e1c6-43b4-9d3c-288997b6277c service nova] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG nova.compute.manager [req-db230a7a-2ce3-4345-aaab-f70641d15a3a req-c28e007a-e1c6-43b4-9d3c-288997b6277c service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] No waiting events found dispatching network-vif-unplugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG nova.compute.manager [req-db230a7a-2ce3-4345-aaab-f70641d15a3a req-c28e007a-e1c6-43b4-9d3c-288997b6277c service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Received event network-vif-unplugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG nova.compute.manager [req-db230a7a-2ce3-4345-aaab-f70641d15a3a req-c28e007a-e1c6-43b4-9d3c-288997b6277c service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Received event network-vif-plugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-db230a7a-2ce3-4345-aaab-f70641d15a3a req-c28e007a-e1c6-43b4-9d3c-288997b6277c service nova] Acquiring lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-db230a7a-2ce3-4345-aaab-f70641d15a3a req-c28e007a-e1c6-43b4-9d3c-288997b6277c service nova] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-db230a7a-2ce3-4345-aaab-f70641d15a3a req-c28e007a-e1c6-43b4-9d3c-288997b6277c service nova] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG nova.compute.manager [req-db230a7a-2ce3-4345-aaab-f70641d15a3a req-c28e007a-e1c6-43b4-9d3c-288997b6277c service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] No waiting events found dispatching network-vif-plugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:36:18 user nova-compute[70243]: WARNING nova.compute.manager [req-db230a7a-2ce3-4345-aaab-f70641d15a3a req-c28e007a-e1c6-43b4-9d3c-288997b6277c service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Received unexpected event network-vif-plugged-3053b7df-e393-4bc7-a17f-8983f22cdd96 for instance with vm_state active and task_state deleting.
Jul 24 16:36:18 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Instance destroyed successfully.
Jul 24 16:36:18 user nova-compute[70243]: DEBUG nova.objects.instance [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lazy-loading 'resources' on Instance uuid 8eb4450c-bf08-4949-a126-d30dbb3ea744 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T16:30:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-980705664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-980705664',id=26,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyki4BvM4FzSdqhAROYG3ucB3rK6iVcLMVb2n52uMdJxxSOHetAHehA+zLslPea930abAZjc/5HN/NJZ5DpCSRZj9LlXJOIRzDCsIj02zLX2xeAqDz0U2rfyStUNE+81g==',key_name='tempest-keypair-1565290298',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:34:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9fcf70d1092145a2bda67106833fe84d',ramdisk_id='',reservation_id='r-0b0cga8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-372850833',owner_user_name='tempest-AttachVolumeShelveTestJSON-372850833-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:34:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62f8a994029a48608bfdcb15f14b2067',uuid=8eb4450c-bf08-4949-a126-d30dbb3ea744,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "address": "fa:16:3e:ad:37:16", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3053b7df-e3", "ovs_interfaceid": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converting VIF {"id": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "address": "fa:16:3e:ad:37:16", "network": {"id": "0a63f94d-895b-4ebb-ad62-c528e820bf91", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1137752671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fcf70d1092145a2bda67106833fe84d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3053b7df-e3", "ovs_interfaceid": "3053b7df-e393-4bc7-a17f-8983f22cdd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:37:16,bridge_name='br-int',has_traffic_filtering=True,id=3053b7df-e393-4bc7-a17f-8983f22cdd96,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3053b7df-e3') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG os_vif [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:37:16,bridge_name='br-int',has_traffic_filtering=True,id=3053b7df-e393-4bc7-a17f-8983f22cdd96,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3053b7df-e3') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3053b7df-e3, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:18 user nova-compute[70243]: INFO os_vif [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:37:16,bridge_name='br-int',has_traffic_filtering=True,id=3053b7df-e393-4bc7-a17f-8983f22cdd96,network=Network(0a63f94d-895b-4ebb-ad62-c528e820bf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3053b7df-e3')
Jul 24 16:36:18 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Deleting instance files /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744_del
Jul 24 16:36:18 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Deletion of /opt/stack/data/nova/instances/8eb4450c-bf08-4949-a126-d30dbb3ea744_del complete
Jul 24 16:36:18 user nova-compute[70243]: INFO nova.compute.manager [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Took 1.22 seconds to destroy the instance on the hypervisor.
Jul 24 16:36:18 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:19 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:36:19 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Took 0.94 seconds to deallocate network for instance.
Jul 24 16:36:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-184d6e9e-614d-4d8f-b93c-2b9aa375d4e0 req-74a7f6be-2030-483a-bfce-d5208c4a5ee5 service nova] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Received event network-vif-deleted-3053b7df-e393-4bc7-a17f-8983f22cdd96 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:36:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:36:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:36:19 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:36:19 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:36:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:36:19 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Deleted allocations for instance 8eb4450c-bf08-4949-a126-d30dbb3ea744
Jul 24 16:36:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-22c8b9b2-a3fa-41ab-9b4a-0df9860064e0 tempest-AttachVolumeShelveTestJSON-372850833 tempest-AttachVolumeShelveTestJSON-372850833-project-member] Lock "8eb4450c-bf08-4949-a126-d30dbb3ea744" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.631s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:36:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-fd2837f2-9fe9-496b-aadb-5f40b04b043f req-228edbe7-0946-4a85-aa8d-fbfb9cf18ae9 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received event network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:36:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd2837f2-9fe9-496b-aadb-5f40b04b043f req-228edbe7-0946-4a85-aa8d-fbfb9cf18ae9 service nova] Acquiring lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:36:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd2837f2-9fe9-496b-aadb-5f40b04b043f req-228edbe7-0946-4a85-aa8d-fbfb9cf18ae9 service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:36:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd2837f2-9fe9-496b-aadb-5f40b04b043f req-228edbe7-0946-4a85-aa8d-fbfb9cf18ae9 service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:36:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-fd2837f2-9fe9-496b-aadb-5f40b04b043f req-228edbe7-0946-4a85-aa8d-fbfb9cf18ae9 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] No waiting events found dispatching network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:36:20 user nova-compute[70243]: WARNING nova.compute.manager [req-fd2837f2-9fe9-496b-aadb-5f40b04b043f req-228edbe7-0946-4a85-aa8d-fbfb9cf18ae9 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received unexpected event network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a for instance with vm_state active and task_state rescuing.
Jul 24 16:36:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-fd2837f2-9fe9-496b-aadb-5f40b04b043f req-228edbe7-0946-4a85-aa8d-fbfb9cf18ae9 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received event network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:36:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd2837f2-9fe9-496b-aadb-5f40b04b043f req-228edbe7-0946-4a85-aa8d-fbfb9cf18ae9 service nova] Acquiring lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:36:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd2837f2-9fe9-496b-aadb-5f40b04b043f req-228edbe7-0946-4a85-aa8d-fbfb9cf18ae9 service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:36:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd2837f2-9fe9-496b-aadb-5f40b04b043f req-228edbe7-0946-4a85-aa8d-fbfb9cf18ae9 service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:36:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-fd2837f2-9fe9-496b-aadb-5f40b04b043f req-228edbe7-0946-4a85-aa8d-fbfb9cf18ae9 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] No waiting events found dispatching network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:36:20 user nova-compute[70243]: WARNING nova.compute.manager [req-fd2837f2-9fe9-496b-aadb-5f40b04b043f req-228edbe7-0946-4a85-aa8d-fbfb9cf18ae9 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received unexpected event network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a for instance with vm_state active and task_state rescuing.
Jul 24 16:36:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Removed pending event for 0cceb071-c478-4914-8243-77c3efbdb5d3 due to event {{(pid=70243) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 16:36:20 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216580.9110005, 0cceb071-c478-4914-8243-77c3efbdb5d3 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:36:20 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] VM Resumed (Lifecycle Event)
Jul 24 16:36:20 user nova-compute[70243]: DEBUG nova.compute.manager [None req-4b1c66cb-d3d2-472c-9048-c50c01e4d78c tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:36:20 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:36:20 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:36:20 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 24 16:36:20 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216580.9120514, 0cceb071-c478-4914-8243-77c3efbdb5d3 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:36:20 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] VM Started (Lifecycle Event)
Jul 24 16:36:20 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:36:20 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:36:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:33 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216578.0850008, 8eb4450c-bf08-4949-a126-d30dbb3ea744 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:36:33 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] VM Stopped (Lifecycle Event)
Jul 24 16:36:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e7f7a059-5a94-4a24-aacd-f464fa020c5e None None] [instance: 8eb4450c-bf08-4949-a126-d30dbb3ea744] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:36:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:48 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:36:49 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:36:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:52 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:36:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:53 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:36:56 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:36:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:36:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:57 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:36:57 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:36:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:36:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:36:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:36:57 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:36:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:36:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-4dde9781-566b-4cbb-950b-bd77016cf880 req-fac0e227-bf31-47f1-9c25-af95fac20e34 service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Received event network-changed-885f4554-aa56-4402-a61c-dd97f720d0fe {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:36:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-4dde9781-566b-4cbb-950b-bd77016cf880 req-fac0e227-bf31-47f1-9c25-af95fac20e34 service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Refreshing instance network info cache due to event network-changed-885f4554-aa56-4402-a61c-dd97f720d0fe. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:36:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4dde9781-566b-4cbb-950b-bd77016cf880 req-fac0e227-bf31-47f1-9c25-af95fac20e34 service nova] Acquiring lock "refresh_cache-75b26864-1539-4106-b741-3b3f5c7e898a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:36:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4dde9781-566b-4cbb-950b-bd77016cf880 req-fac0e227-bf31-47f1-9c25-af95fac20e34 service nova] Acquired lock "refresh_cache-75b26864-1539-4106-b741-3b3f5c7e898a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:36:58 user nova-compute[70243]: DEBUG nova.network.neutron [req-4dde9781-566b-4cbb-950b-bd77016cf880 req-fac0e227-bf31-47f1-9c25-af95fac20e34 service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Refreshing network info cache for port 885f4554-aa56-4402-a61c-dd97f720d0fe {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:36:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:59 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:36:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:36:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:36:59 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:36:59 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:36:59 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=7984MB free_disk=24.254371643066406GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:36:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:36:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:37:00 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 50fecb3a-8f06-4822-8c84-76df51acfe50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:37:00 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6f2258de-6b31-48af-81df-37b64da4ca99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:37:00 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 0cceb071-c478-4914-8243-77c3efbdb5d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:37:00 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 75b26864-1539-4106-b741-3b3f5c7e898a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:37:00 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 100c6ba5-de96-4c2a-ae0c-9d3a9199948c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:37:00 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance beab81a6-209a-4d8d-8980-365ff2dc3cff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:37:00 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:37:00 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:37:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:00 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:37:00 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:37:00 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:37:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.384s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:37:00 user nova-compute[70243]: DEBUG nova.network.neutron [req-4dde9781-566b-4cbb-950b-bd77016cf880 req-fac0e227-bf31-47f1-9c25-af95fac20e34 service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Updated VIF entry in instance network info cache for port 885f4554-aa56-4402-a61c-dd97f720d0fe. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:37:00 user nova-compute[70243]: DEBUG nova.network.neutron [req-4dde9781-566b-4cbb-950b-bd77016cf880 req-fac0e227-bf31-47f1-9c25-af95fac20e34 service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Updating instance_info_cache with network_info: [{"id": "885f4554-aa56-4402-a61c-dd97f720d0fe", "address": "fa:16:3e:81:5b:1b", "network": {"id": "51126732-2727-4752-b653-16d223e1d827", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-797458544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6955ddcb9e244a1beb243d63596cada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885f4554-aa", "ovs_interfaceid": "885f4554-aa56-4402-a61c-dd97f720d0fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:37:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4dde9781-566b-4cbb-950b-bd77016cf880 req-fac0e227-bf31-47f1-9c25-af95fac20e34 service nova] Releasing lock "refresh_cache-75b26864-1539-4106-b741-3b3f5c7e898a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:37:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:01 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:37:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:37:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:37:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:37:01 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:37:01 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Updating instance_info_cache with network_info: [{"id": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "address": "fa:16:3e:46:16:b8", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e9e4c6-7d", "ovs_interfaceid": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:37:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:37:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:37:01 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:37:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "75b26864-1539-4106-b741-3b3f5c7e898a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:37:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:37:02 user nova-compute[70243]: DEBUG nova.objects.instance [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lazy-loading 'flavor' on Instance uuid 75b26864-1539-4106-b741-3b3f5c7e898a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:37:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.280s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "75b26864-1539-4106-b741-3b3f5c7e898a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:37:03 user nova-compute[70243]: INFO nova.compute.manager [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Attaching volume 2090aa9c-f30b-4b3a-89ff-8a9553df1377 to /dev/vdb
Jul 24 16:37:03 user nova-compute[70243]: DEBUG os_brick.utils [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c1c606-e396-4cad-ae85-52e60bc9c63c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2ba316-2ce5-4cab-bbb9-0499a67e9ef0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34151d3-485f-4411-8e65-d56b18c77bdd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ac5364-68fc-4d50-80a6-55dce78496e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:37:03 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:37:03 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40864f3-2194-4731-b2d2-254fc5edafca]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG os_brick.utils [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:37:03 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Updating existing volume attachment record: 7d0e7ec7-452b-4309-86cc-e565c8fba282 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:37:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZcELMrU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:37:09 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:37:09 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:37:09 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d54c53-59c1-4113-9370-b1a2d54909bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:37:09 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[39235597-0a27-49d5-95f3-56709209f4e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377] added
Jul 24 16:37:09 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40beb7d-8945-42a4-a78b-3bd71120fe10]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[637d1858-b26b-429d-abc5-3dfaba246f2e]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FZcELMrU {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FZcELMrU" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ea9b68-b3f8-43a5-965b-bdb86e9995e0]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FZcELMrU'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[69587c7a-cb6a-49e2-9ca5-d0d648a5f3f5]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0e308f-a914-401a-a1bb-4b72a989a2b7]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:37:09 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:37:09 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86b8c99-1362-4435-bf42-b7077b16d472]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377, portal: 172.16.0.220,3260]
Jul 24 16:37:09 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377, portal: 172.16.0.220,3260] successful.
Jul 24 16:37:09 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafccacf-3845-4605-b59b-609e8f923817]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19793d6-6e43-4583-90a3-b7c5a47fb2f6]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:37:09 user nova-compute[70243]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 (non-flash)
Jul 24 16:37:09 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:37:09 user nova-compute[70243]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 (non-flash)
Jul 24 16:37:09 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b14342e-3a23-4b91-9902-b01fb21d3a06]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:37:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZcELMrU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:37:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Acquiring lock "00fec25c-8982-4a40-80ae-11d0936e10a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:37:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:37:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:37:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:37:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:37:10 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:37:10 user nova-compute[70243]: INFO nova.compute.claims [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Claim successful on node user
Jul 24 16:37:10 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:37:10 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:37:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:37:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:37:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:37:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23461616462326633', 'path': '/dev/sdc'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:37:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461616462326633', 'path': '/dev/sdc'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:37:10 user nova-compute[70243]: DEBUG nova.objects.instance [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lazy-loading 'flavor' on Instance uuid 75b26864-1539-4106-b741-3b3f5c7e898a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:37:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:37:10 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:37:10 user nova-compute[70243]:   <source dev="/dev/sdc"/>
Jul 24 16:37:10 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:37:10 user nova-compute[70243]:   <serial>2090aa9c-f30b-4b3a-89ff-8a9553df1377</serial>
Jul 24 16:37:10 user nova-compute[70243]: </disk>
Jul 24 16:37:10 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG nova.compute.manager [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG nova.network.neutron [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:37:11 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:37:11 user nova-compute[70243]: DEBUG nova.compute.manager [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG nova.policy [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a435e78ca034356b3d09f09418c310c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d2e94319a14caa8ac0c27c6f242648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG nova.compute.manager [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:37:11 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Creating image(s)
Jul 24 16:37:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Acquiring lock "/opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "/opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "/opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk 1073741824" returned: 0 in 0.053s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] No VIF found with MAC fa:16:3e:81:5b:1b, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.142s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0dd05df7-c211-4506-a402-b81aa4ee24ad tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.757s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:37:12 user nova-compute[70243]: DEBUG nova.network.neutron [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Successfully created port: 1e316ee9-0ea5-491c-b36b-742446e40042 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:37:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk --force-share --output=json" returned: 0 in 0.414s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:12 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Cannot resize image /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:37:12 user nova-compute[70243]: DEBUG nova.objects.instance [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lazy-loading 'migration_context' on Instance uuid 00fec25c-8982-4a40-80ae-11d0936e10a0 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:37:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:37:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Ensure instance console log exists: /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:37:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:37:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:37:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.network.neutron [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Successfully updated port: 1e316ee9-0ea5-491c-b36b-742446e40042 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Acquiring lock "refresh_cache-00fec25c-8982-4a40-80ae-11d0936e10a0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Acquired lock "refresh_cache-00fec25c-8982-4a40-80ae-11d0936e10a0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.network.neutron [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.compute.manager [req-d8bd474d-e4a7-4d2d-a3fb-53c60e09a0f1 req-11ef5d92-0bfc-41fa-8791-3048e725bc9c service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Received event network-changed-1e316ee9-0ea5-491c-b36b-742446e40042 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.compute.manager [req-d8bd474d-e4a7-4d2d-a3fb-53c60e09a0f1 req-11ef5d92-0bfc-41fa-8791-3048e725bc9c service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Refreshing instance network info cache due to event network-changed-1e316ee9-0ea5-491c-b36b-742446e40042. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d8bd474d-e4a7-4d2d-a3fb-53c60e09a0f1 req-11ef5d92-0bfc-41fa-8791-3048e725bc9c service nova] Acquiring lock "refresh_cache-00fec25c-8982-4a40-80ae-11d0936e10a0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.network.neutron [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.network.neutron [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Updating instance_info_cache with network_info: [{"id": "1e316ee9-0ea5-491c-b36b-742446e40042", "address": "fa:16:3e:46:27:41", "network": {"id": "fc56dff4-5f20-428e-97eb-4284f448d179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-56253948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8d2e94319a14caa8ac0c27c6f242648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e316ee9-0e", "ovs_interfaceid": "1e316ee9-0ea5-491c-b36b-742446e40042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Releasing lock "refresh_cache-00fec25c-8982-4a40-80ae-11d0936e10a0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Instance network_info: |[{"id": "1e316ee9-0ea5-491c-b36b-742446e40042", "address": "fa:16:3e:46:27:41", "network": {"id": "fc56dff4-5f20-428e-97eb-4284f448d179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-56253948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8d2e94319a14caa8ac0c27c6f242648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e316ee9-0e", "ovs_interfaceid": "1e316ee9-0ea5-491c-b36b-742446e40042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d8bd474d-e4a7-4d2d-a3fb-53c60e09a0f1 req-11ef5d92-0bfc-41fa-8791-3048e725bc9c service nova] Acquired lock "refresh_cache-00fec25c-8982-4a40-80ae-11d0936e10a0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.network.neutron [req-d8bd474d-e4a7-4d2d-a3fb-53c60e09a0f1 req-11ef5d92-0bfc-41fa-8791-3048e725bc9c service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Refreshing network info cache for port 1e316ee9-0ea5-491c-b36b-742446e40042 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Start _get_guest_xml network_info=[{"id": "1e316ee9-0ea5-491c-b36b-742446e40042", "address": "fa:16:3e:46:27:41", "network": {"id": "fc56dff4-5f20-428e-97eb-4284f448d179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-56253948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8d2e94319a14caa8ac0c27c6f242648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e316ee9-0e", "ovs_interfaceid": "1e316ee9-0ea5-491c-b36b-742446e40042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:37:13 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:37:13 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:37:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2072320659',display_name='tempest-TestServerVolumeAttachmentScenario-server-2072320659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2072320659',id=34,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNkSZjnGtzTfjk8XT2qqhfrANpryN23F6ixA/QnFxRqDRsvmTRsAqfsKu59Hm6w90dpMlAfUXNtyliCRo/3qsoHKo3/uvN+PJYElwyaAvn6ZNM27VUZpt+/vytLPyGUCQ==',key_name='tempest-keypair-2137048624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8d2e94319a14caa8ac0c27c6f242648',ramdisk_id='',reservation_id='r-4uqphkk8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-640607970',owner_user_name='tempest-TestServerVolumeAttachmentScenario-640607970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:37:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a435e78ca034356b3d09f09418c310c',uuid=00fec25c-8982-4a40-80ae-11d0936e10a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e316ee9-0ea5-491c-b36b-742446e40042", "address": "fa:16:3e:46:27:41", "network": {"id": "fc56dff4-5f20-428e-97eb-4284f448d179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-56253948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8d2e94319a14caa8ac0c27c6f242648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e316ee9-0e", "ovs_interfaceid": "1e316ee9-0ea5-491c-b36b-742446e40042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Converting VIF {"id": "1e316ee9-0ea5-491c-b36b-742446e40042", "address": "fa:16:3e:46:27:41", "network": {"id": "fc56dff4-5f20-428e-97eb-4284f448d179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-56253948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8d2e94319a14caa8ac0c27c6f242648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e316ee9-0e", "ovs_interfaceid": "1e316ee9-0ea5-491c-b36b-742446e40042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:27:41,bridge_name='br-int',has_traffic_filtering=True,id=1e316ee9-0ea5-491c-b36b-742446e40042,network=Network(fc56dff4-5f20-428e-97eb-4284f448d179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e316ee9-0e') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.objects.instance [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lazy-loading 'pci_devices' on Instance uuid 00fec25c-8982-4a40-80ae-11d0936e10a0 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:37:13 user nova-compute[70243]:   <uuid>00fec25c-8982-4a40-80ae-11d0936e10a0</uuid>
Jul 24 16:37:13 user nova-compute[70243]:   <name>instance-00000022</name>
Jul 24 16:37:13 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:37:13 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:37:13 user nova-compute[70243]:   <metadata>
Jul 24 16:37:13 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:37:13 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:37:13 user nova-compute[70243]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2072320659</nova:name>
Jul 24 16:37:13 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:37:13</nova:creationTime>
Jul 24 16:37:13 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:37:13 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:37:13 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:37:13 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:37:13 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:37:13 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:37:13 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:37:13 user nova-compute[70243]:       <nova:owner>
Jul 24 16:37:13 user nova-compute[70243]:         <nova:user uuid="9a435e78ca034356b3d09f09418c310c">tempest-TestServerVolumeAttachmentScenario-640607970-project-member</nova:user>
Jul 24 16:37:13 user nova-compute[70243]:         <nova:project uuid="b8d2e94319a14caa8ac0c27c6f242648">tempest-TestServerVolumeAttachmentScenario-640607970</nova:project>
Jul 24 16:37:13 user nova-compute[70243]:       </nova:owner>
Jul 24 16:37:13 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:37:13 user nova-compute[70243]:       <nova:ports>
Jul 24 16:37:13 user nova-compute[70243]:         <nova:port uuid="1e316ee9-0ea5-491c-b36b-742446e40042">
Jul 24 16:37:13 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 24 16:37:13 user nova-compute[70243]:         </nova:port>
Jul 24 16:37:13 user nova-compute[70243]:       </nova:ports>
Jul 24 16:37:13 user nova-compute[70243]:     </nova:instance>
Jul 24 16:37:13 user nova-compute[70243]:   </metadata>
Jul 24 16:37:13 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:37:13 user nova-compute[70243]:     <system>
Jul 24 16:37:13 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:37:13 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:37:13 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:37:13 user nova-compute[70243]:       <entry name="serial">00fec25c-8982-4a40-80ae-11d0936e10a0</entry>
Jul 24 16:37:13 user nova-compute[70243]:       <entry name="uuid">00fec25c-8982-4a40-80ae-11d0936e10a0</entry>
Jul 24 16:37:13 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:37:13 user nova-compute[70243]:     </system>
Jul 24 16:37:13 user nova-compute[70243]:   </sysinfo>
Jul 24 16:37:13 user nova-compute[70243]:   <os>
Jul 24 16:37:13 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:37:13 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:37:13 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:37:13 user nova-compute[70243]:   </os>
Jul 24 16:37:13 user nova-compute[70243]:   <features>
Jul 24 16:37:13 user nova-compute[70243]:     <acpi/>
Jul 24 16:37:13 user nova-compute[70243]:     <apic/>
Jul 24 16:37:13 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:37:13 user nova-compute[70243]:   </features>
Jul 24 16:37:13 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:37:13 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:37:13 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:37:13 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:37:13 user nova-compute[70243]:   </clock>
Jul 24 16:37:13 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:37:13 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:37:13 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:37:13 user nova-compute[70243]:   </cpu>
Jul 24 16:37:13 user nova-compute[70243]:   <devices>
Jul 24 16:37:13 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:37:13 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:37:13 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk"/>
Jul 24 16:37:13 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:37:13 user nova-compute[70243]:     </disk>
Jul 24 16:37:13 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:37:13 user nova-compute[70243]:       <mac address="fa:16:3e:46:27:41"/>
Jul 24 16:37:13 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:37:13 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:37:13 user nova-compute[70243]:       <target dev="tap1e316ee9-0e"/>
Jul 24 16:37:13 user nova-compute[70243]:     </interface>
Jul 24 16:37:13 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:37:13 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/console.log" append="off"/>
Jul 24 16:37:13 user nova-compute[70243]:     </serial>
Jul 24 16:37:13 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:37:13 user nova-compute[70243]:     <video>
Jul 24 16:37:13 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:37:13 user nova-compute[70243]:     </video>
Jul 24 16:37:13 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:37:13 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:37:13 user nova-compute[70243]:     </rng>
Jul 24 16:37:13 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:37:13 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:37:13 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:37:13 user nova-compute[70243]:     </memballoon>
Jul 24 16:37:13 user nova-compute[70243]:   </devices>
Jul 24 16:37:13 user nova-compute[70243]: </domain>
Jul 24 16:37:13 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:37:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2072320659',display_name='tempest-TestServerVolumeAttachmentScenario-server-2072320659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2072320659',id=34,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNkSZjnGtzTfjk8XT2qqhfrANpryN23F6ixA/QnFxRqDRsvmTRsAqfsKu59Hm6w90dpMlAfUXNtyliCRo/3qsoHKo3/uvN+PJYElwyaAvn6ZNM27VUZpt+/vytLPyGUCQ==',key_name='tempest-keypair-2137048624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8d2e94319a14caa8ac0c27c6f242648',ramdisk_id='',reservation_id='r-4uqphkk8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-640607970',owner_user_name='tempest-TestServerVolumeAttachmentScenario-640607970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:37:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a435e78ca034356b3d09f09418c310c',uuid=00fec25c-8982-4a40-80ae-11d0936e10a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e316ee9-0ea5-491c-b36b-742446e40042", "address": "fa:16:3e:46:27:41", "network": {"id": "fc56dff4-5f20-428e-97eb-4284f448d179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-56253948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8d2e94319a14caa8ac0c27c6f242648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e316ee9-0e", "ovs_interfaceid": "1e316ee9-0ea5-491c-b36b-742446e40042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Converting VIF {"id": "1e316ee9-0ea5-491c-b36b-742446e40042", "address": "fa:16:3e:46:27:41", "network": {"id": "fc56dff4-5f20-428e-97eb-4284f448d179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-56253948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8d2e94319a14caa8ac0c27c6f242648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e316ee9-0e", "ovs_interfaceid": "1e316ee9-0ea5-491c-b36b-742446e40042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:27:41,bridge_name='br-int',has_traffic_filtering=True,id=1e316ee9-0ea5-491c-b36b-742446e40042,network=Network(fc56dff4-5f20-428e-97eb-4284f448d179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e316ee9-0e') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG os_vif [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:27:41,bridge_name='br-int',has_traffic_filtering=True,id=1e316ee9-0ea5-491c-b36b-742446e40042,network=Network(fc56dff4-5f20-428e-97eb-4284f448d179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e316ee9-0e') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e316ee9-0e, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e316ee9-0e, col_values=(('external_ids', {'iface-id': '1e316ee9-0ea5-491c-b36b-742446e40042', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:27:41', 'vm-uuid': '00fec25c-8982-4a40-80ae-11d0936e10a0'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:13 user nova-compute[70243]: INFO os_vif [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:27:41,bridge_name='br-int',has_traffic_filtering=True,id=1e316ee9-0ea5-491c-b36b-742446e40042,network=Network(fc56dff4-5f20-428e-97eb-4284f448d179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e316ee9-0e')
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:37:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] No VIF found with MAC fa:16:3e:46:27:41, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:37:14 user nova-compute[70243]: DEBUG nova.network.neutron [req-d8bd474d-e4a7-4d2d-a3fb-53c60e09a0f1 req-11ef5d92-0bfc-41fa-8791-3048e725bc9c service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Updated VIF entry in instance network info cache for port 1e316ee9-0ea5-491c-b36b-742446e40042. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:37:14 user nova-compute[70243]: DEBUG nova.network.neutron [req-d8bd474d-e4a7-4d2d-a3fb-53c60e09a0f1 req-11ef5d92-0bfc-41fa-8791-3048e725bc9c service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Updating instance_info_cache with network_info: [{"id": "1e316ee9-0ea5-491c-b36b-742446e40042", "address": "fa:16:3e:46:27:41", "network": {"id": "fc56dff4-5f20-428e-97eb-4284f448d179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-56253948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8d2e94319a14caa8ac0c27c6f242648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e316ee9-0e", "ovs_interfaceid": "1e316ee9-0ea5-491c-b36b-742446e40042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:37:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d8bd474d-e4a7-4d2d-a3fb-53c60e09a0f1 req-11ef5d92-0bfc-41fa-8791-3048e725bc9c service nova] Releasing lock "refresh_cache-00fec25c-8982-4a40-80ae-11d0936e10a0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:37:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:15 user nova-compute[70243]: DEBUG nova.compute.manager [req-64a059b6-bee6-42a5-8ab6-847fff4935db req-a43a4520-78f5-4bd1-9fa5-2311eebd22c5 service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Received event network-vif-plugged-1e316ee9-0ea5-491c-b36b-742446e40042 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:37:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-64a059b6-bee6-42a5-8ab6-847fff4935db req-a43a4520-78f5-4bd1-9fa5-2311eebd22c5 service nova] Acquiring lock "00fec25c-8982-4a40-80ae-11d0936e10a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:37:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-64a059b6-bee6-42a5-8ab6-847fff4935db req-a43a4520-78f5-4bd1-9fa5-2311eebd22c5 service nova] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:37:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-64a059b6-bee6-42a5-8ab6-847fff4935db req-a43a4520-78f5-4bd1-9fa5-2311eebd22c5 service nova] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:37:15 user nova-compute[70243]: DEBUG nova.compute.manager [req-64a059b6-bee6-42a5-8ab6-847fff4935db req-a43a4520-78f5-4bd1-9fa5-2311eebd22c5 service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] No waiting events found dispatching network-vif-plugged-1e316ee9-0ea5-491c-b36b-742446e40042 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:37:15 user nova-compute[70243]: WARNING nova.compute.manager [req-64a059b6-bee6-42a5-8ab6-847fff4935db req-a43a4520-78f5-4bd1-9fa5-2311eebd22c5 service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Received unexpected event network-vif-plugged-1e316ee9-0ea5-491c-b36b-742446e40042 for instance with vm_state building and task_state spawning.
Jul 24 16:37:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b2385a59-a12c-4574-9893-a3dd2a864650 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:37:15 user nova-compute[70243]: INFO nova.compute.manager [None req-b2385a59-a12c-4574-9893-a3dd2a864650 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] instance snapshotting
Jul 24 16:37:15 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-b2385a59-a12c-4574-9893-a3dd2a864650 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Beginning live snapshot process
Jul 24 16:37:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b2385a59-a12c-4574-9893-a3dd2a864650 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json -f qcow2 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b2385a59-a12c-4574-9893-a3dd2a864650 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b2385a59-a12c-4574-9893-a3dd2a864650 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json -f qcow2 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b2385a59-a12c-4574-9893-a3dd2a864650 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b2385a59-a12c-4574-9893-a3dd2a864650 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b2385a59-a12c-4574-9893-a3dd2a864650 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b2385a59-a12c-4574-9893-a3dd2a864650 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa94i2dws/58d5f4e4374b423c801a66d1a749c426.delta 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b2385a59-a12c-4574-9893-a3dd2a864650 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa94i2dws/58d5f4e4374b423c801a66d1a749c426.delta 1073741824" returned: 0 in 0.052s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:16 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-b2385a59-a12c-4574-9893-a3dd2a864650 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 24 16:37:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-b2385a59-a12c-4574-9893-a3dd2a864650 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:37:17 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216637.392076, 00fec25c-8982-4a40-80ae-11d0936e10a0 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:37:17 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] VM Resumed (Lifecycle Event)
Jul 24 16:37:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:37:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:37:17 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Instance spawned successfully.
Jul 24 16:37:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:37:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:37:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:37:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:37:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:37:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:37:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:37:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:37:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:37:17 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:37:17 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216637.3935835, 00fec25c-8982-4a40-80ae-11d0936e10a0 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:37:17 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] VM Started (Lifecycle Event)
Jul 24 16:37:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:37:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:37:17 user nova-compute[70243]: DEBUG nova.compute.manager [req-6f46abfa-c198-4c36-b22d-2e7152b694ab req-6800f59f-a849-406b-a147-806c2c1ce6d9 service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Received event network-vif-plugged-1e316ee9-0ea5-491c-b36b-742446e40042 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:37:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6f46abfa-c198-4c36-b22d-2e7152b694ab req-6800f59f-a849-406b-a147-806c2c1ce6d9 service nova] Acquiring lock "00fec25c-8982-4a40-80ae-11d0936e10a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:37:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6f46abfa-c198-4c36-b22d-2e7152b694ab req-6800f59f-a849-406b-a147-806c2c1ce6d9 service nova] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:37:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6f46abfa-c198-4c36-b22d-2e7152b694ab req-6800f59f-a849-406b-a147-806c2c1ce6d9 service nova] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:37:17 user nova-compute[70243]: DEBUG nova.compute.manager [req-6f46abfa-c198-4c36-b22d-2e7152b694ab req-6800f59f-a849-406b-a147-806c2c1ce6d9 service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] No waiting events found dispatching network-vif-plugged-1e316ee9-0ea5-491c-b36b-742446e40042 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:37:17 user nova-compute[70243]: WARNING nova.compute.manager [req-6f46abfa-c198-4c36-b22d-2e7152b694ab req-6800f59f-a849-406b-a147-806c2c1ce6d9 service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Received unexpected event network-vif-plugged-1e316ee9-0ea5-491c-b36b-742446e40042 for instance with vm_state building and task_state spawning.
Jul 24 16:37:17 user nova-compute[70243]: INFO nova.compute.manager [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Took 6.33 seconds to spawn the instance on the hypervisor.
Jul 24 16:37:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:37:17 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:37:17 user nova-compute[70243]: INFO nova.compute.manager [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Took 7.10 seconds to build instance.
Jul 24 16:37:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-323e4451-55b3-49fe-a125-a4d982ebfe58 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.197s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:37:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-b2385a59-a12c-4574-9893-a3dd2a864650 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:37:17 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-b2385a59-a12c-4574-9893-a3dd2a864650 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 24 16:37:17 user nova-compute[70243]: DEBUG nova.privsep.utils [None req-b2385a59-a12c-4574-9893-a3dd2a864650 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70243) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 16:37:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b2385a59-a12c-4574-9893-a3dd2a864650 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa94i2dws/58d5f4e4374b423c801a66d1a749c426.delta /opt/stack/data/nova/instances/snapshots/tmpa94i2dws/58d5f4e4374b423c801a66d1a749c426 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b2385a59-a12c-4574-9893-a3dd2a864650 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa94i2dws/58d5f4e4374b423c801a66d1a749c426.delta /opt/stack/data/nova/instances/snapshots/tmpa94i2dws/58d5f4e4374b423c801a66d1a749c426" returned: 0 in 0.541s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:18 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-b2385a59-a12c-4574-9893-a3dd2a864650 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Snapshot extracted, beginning image upload
Jul 24 16:37:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:18 user nova-compute[70243]: DEBUG nova.compute.manager [req-53208ce7-8721-4222-9440-e0e9ed1170fa req-98989924-0597-4c74-bacd-3d1c6ed16268 service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Received event network-changed-97c822af-71d3-4352-8cb4-544bc125e38f {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:37:18 user nova-compute[70243]: DEBUG nova.compute.manager [req-53208ce7-8721-4222-9440-e0e9ed1170fa req-98989924-0597-4c74-bacd-3d1c6ed16268 service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Refreshing instance network info cache due to event network-changed-97c822af-71d3-4352-8cb4-544bc125e38f. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:37:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-53208ce7-8721-4222-9440-e0e9ed1170fa req-98989924-0597-4c74-bacd-3d1c6ed16268 service nova] Acquiring lock "refresh_cache-beab81a6-209a-4d8d-8980-365ff2dc3cff" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:37:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-53208ce7-8721-4222-9440-e0e9ed1170fa req-98989924-0597-4c74-bacd-3d1c6ed16268 service nova] Acquired lock "refresh_cache-beab81a6-209a-4d8d-8980-365ff2dc3cff" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:37:18 user nova-compute[70243]: DEBUG nova.network.neutron [req-53208ce7-8721-4222-9440-e0e9ed1170fa req-98989924-0597-4c74-bacd-3d1c6ed16268 service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Refreshing network info cache for port 97c822af-71d3-4352-8cb4-544bc125e38f {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:37:19 user nova-compute[70243]: DEBUG nova.network.neutron [req-53208ce7-8721-4222-9440-e0e9ed1170fa req-98989924-0597-4c74-bacd-3d1c6ed16268 service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Updated VIF entry in instance network info cache for port 97c822af-71d3-4352-8cb4-544bc125e38f. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:37:19 user nova-compute[70243]: DEBUG nova.network.neutron [req-53208ce7-8721-4222-9440-e0e9ed1170fa req-98989924-0597-4c74-bacd-3d1c6ed16268 service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Updating instance_info_cache with network_info: [{"id": "97c822af-71d3-4352-8cb4-544bc125e38f", "address": "fa:16:3e:86:60:5d", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c822af-71", "ovs_interfaceid": "97c822af-71d3-4352-8cb4-544bc125e38f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:37:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-53208ce7-8721-4222-9440-e0e9ed1170fa req-98989924-0597-4c74-bacd-3d1c6ed16268 service nova] Releasing lock "refresh_cache-beab81a6-209a-4d8d-8980-365ff2dc3cff" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:37:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:21 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-b2385a59-a12c-4574-9893-a3dd2a864650 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Snapshot image upload complete
Jul 24 16:37:21 user nova-compute[70243]: INFO nova.compute.manager [None req-b2385a59-a12c-4574-9893-a3dd2a864650 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Took 5.77 seconds to snapshot the instance on the hypervisor.
Jul 24 16:37:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "beab81a6-209a-4d8d-8980-365ff2dc3cff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:37:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "beab81a6-209a-4d8d-8980-365ff2dc3cff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:37:22 user nova-compute[70243]: DEBUG nova.objects.instance [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lazy-loading 'flavor' on Instance uuid beab81a6-209a-4d8d-8980-365ff2dc3cff {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:37:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "beab81a6-209a-4d8d-8980-365ff2dc3cff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.120s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "beab81a6-209a-4d8d-8980-365ff2dc3cff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "beab81a6-209a-4d8d-8980-365ff2dc3cff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:37:23 user nova-compute[70243]: INFO nova.compute.manager [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Attaching volume 01edee48-c6a6-4fdd-8c95-e952f4a2b192 to /dev/vdb
Jul 24 16:37:23 user nova-compute[70243]: DEBUG os_brick.utils [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adfcfda-ad26-46a6-8943-24b5931e03e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16b8c98-5679-45e9-ad32-2555a1bd4e2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d781559-c592-49e4-8440-d2d613abac6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[955938bf-3404-4827-adbc-6f06d8385c59]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:37:23 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:37:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6274195e-0b19-4314-b5cd-838a9b003d6e]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG os_brick.utils [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Updating existing volume attachment record: c07247cf-c7a6-40f8-bece-679d51e3e2fc {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwNgcRrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:37:30 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:37:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:37:30 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:37:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:37:30 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[08faff03-9a8a-40f8-b851-3dae3ea75627]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:37:30 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[79db405f-04c1-4741-b273-62abe6cb81e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192] added
Jul 24 16:37:30 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b790ffbf-43fe-40ae-a6d8-c8bacb1f1cc3]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[480cf61d-eb53-4dad-9853-52f685ab3349]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nwNgcRrQ {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nwNgcRrQ" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0b3073-e27b-4c37-be78-a3d770ae84aa]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nwNgcRrQ'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "75b26864-1539-4106-b741-3b3f5c7e898a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8c8be1-6d22-4094-86b9-b807fc213b51]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:30 user nova-compute[70243]: INFO nova.compute.manager [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Detaching volume 2090aa9c-f30b-4b3a-89ff-8a9553df1377
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a131105-a202-4e95-ab6c-154c5573ae1b]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:37:30 user nova-compute[70243]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 (non-flash)
Jul 24 16:37:30 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:37:30 user nova-compute[70243]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 (non-flash)
Jul 24 16:37:30 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[645bf6ea-0fa5-43bb-a9dc-b220079a3b4e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192, portal: 172.16.0.220,3260]
Jul 24 16:37:30 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192, portal: 172.16.0.220,3260] successful.
Jul 24 16:37:30 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:30 user nova-compute[70243]: INFO nova.virt.block_device [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Attempting to driver detach volume 2090aa9c-f30b-4b3a-89ff-8a9553df1377 from mountpoint /dev/vdb
Jul 24 16:37:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Attempting to detach device vdb from instance 75b26864-1539-4106-b741-3b3f5c7e898a from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:37:30 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:37:30 user nova-compute[70243]:   <source dev="/dev/sdc"/>
Jul 24 16:37:30 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:37:30 user nova-compute[70243]:   <serial>2090aa9c-f30b-4b3a-89ff-8a9553df1377</serial>
Jul 24 16:37:30 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:37:30 user nova-compute[70243]: </disk>
Jul 24 16:37:30 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:30 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Successfully detached device vdb from instance 75b26864-1539-4106-b741-3b3f5c7e898a from the persistent domain config.
Jul 24 16:37:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 75b26864-1539-4106-b741-3b3f5c7e898a from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:37:30 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:37:30 user nova-compute[70243]:   <source dev="/dev/sdc"/>
Jul 24 16:37:30 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:37:30 user nova-compute[70243]:   <serial>2090aa9c-f30b-4b3a-89ff-8a9553df1377</serial>
Jul 24 16:37:30 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:37:30 user nova-compute[70243]: </disk>
Jul 24 16:37:30 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a358ea74-d6ad-465f-96e4-fa9418e4352c]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c4a995-5202-4aa7-ac24-16d210b79ce5]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:37:30 user nova-compute[70243]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 (non-flash)
Jul 24 16:37:30 user nova-compute[70243]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 (non-flash)
Jul 24 16:37:30 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:37:30 user nova-compute[70243]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 (non-flash)
Jul 24 16:37:30 user nova-compute[70243]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 (non-flash)
Jul 24 16:37:30 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfae1c9-7f86-4ea7-8dfb-104754b7d1cc]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:30 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: None {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690216651.223762, 75b26864-1539-4106-b741-3b3f5c7e898a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 75b26864-1539-4106-b741-3b3f5c7e898a {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:37:31 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Successfully detached device vdb from instance 75b26864-1539-4106-b741-3b3f5c7e898a from the live domain config.
Jul 24 16:37:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZcELMrU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:37:31 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:37:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwNgcRrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23834646462353339', 'path': '/dev/sdd'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834646462353339', 'path': '/dev/sdd'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.605s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG nova.objects.instance [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lazy-loading 'flavor' on Instance uuid beab81a6-209a-4d8d-8980-365ff2dc3cff {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fd3d9d-e494-435a-ab7b-3d1a7f864314]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:37:31 user nova-compute[70243]: No targets found.
Jul 24 16:37:31 user nova-compute[70243]: iSNS:
Jul 24 16:37:31 user nova-compute[70243]: No targets found.
Jul 24 16:37:31 user nova-compute[70243]: STATIC:
Jul 24 16:37:31 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17
Jul 24 16:37:31 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:37:31 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:37:31 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192
Jul 24 16:37:31 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:37:31 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:37:31 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377
Jul 24 16:37:31 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:37:31 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:37:31 user nova-compute[70243]: FIRMWARE:
Jul 24 16:37:31 user nova-compute[70243]: No targets found.
Jul 24 16:37:31 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:37:31 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:37:31 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:37:31 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:37:31 user nova-compute[70243]:   <source dev="/dev/sdd"/>
Jul 24 16:37:31 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:37:31 user nova-compute[70243]:   <serial>01edee48-c6a6-4fdd-8c95-e952f4a2b192</serial>
Jul 24 16:37:31 user nova-compute[70243]: </disk>
Jul 24 16:37:31 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a92f442-9101-4870-937e-e663173393af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b355bc-af0a-4a05-92f5-0caf1760a33f]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:37:31 user nova-compute[70243]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 (non-flash)
Jul 24 16:37:31 user nova-compute[70243]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 (non-flash)
Jul 24 16:37:31 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:37:31 user nova-compute[70243]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 (non-flash)
Jul 24 16:37:31 user nova-compute[70243]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 (non-flash)
Jul 24 16:37:31 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc4d7ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377'): ({'sdc'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Removing single pathed devices sdc {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d5255e-67d6-4ac0-b6ac-109f4bc43821]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0650e23-3a6e-4c6e-a0ee-0e9c765b44ba]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Flushing IO for device /dev/sdc {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:37:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a818f6-5012-4a33-aa05-95e40ca41173]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6382ed79-9543-4be9-a04a-2561d0d2925f]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] SCSI volumes sdc have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e25ec28-2681-4809-9b8c-bf615ee84592]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf4d1f0-a2e9-47ef-bf94-131d036787c8]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377, portal: 172.16.0.220,3260]
Jul 24 16:37:32 user nova-compute[70243]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377, portal: 172.16.0.220,3260] successful.
Jul 24 16:37:32 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2090aa9c-f30b-4b3a-89ff-8a9553df1377 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1b797b-b1e0-4db4-a424-b7f2d8a0970d]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] <== disconnect_volume: return (931ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] No VIF found with MAC fa:16:3e:86:60:5d, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9db89344-8f04-4d29-b217-f308ce535adc tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "beab81a6-209a-4d8d-8980-365ff2dc3cff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.326s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:37:32 user nova-compute[70243]: DEBUG nova.objects.instance [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lazy-loading 'flavor' on Instance uuid 75b26864-1539-4106-b741-3b3f5c7e898a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:37:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2f1281da-3bf4-429e-81bd-710d0a8656df tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.406s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:37:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "beab81a6-209a-4d8d-8980-365ff2dc3cff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:37:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "beab81a6-209a-4d8d-8980-365ff2dc3cff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:37:33 user nova-compute[70243]: INFO nova.compute.manager [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Detaching volume 01edee48-c6a6-4fdd-8c95-e952f4a2b192
Jul 24 16:37:33 user nova-compute[70243]: INFO nova.virt.block_device [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Attempting to driver detach volume 01edee48-c6a6-4fdd-8c95-e952f4a2b192 from mountpoint /dev/vdb
Jul 24 16:37:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Attempting to detach device vdb from instance beab81a6-209a-4d8d-8980-365ff2dc3cff from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:37:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:37:33 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:37:33 user nova-compute[70243]:   <source dev="/dev/sdd"/>
Jul 24 16:37:33 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:37:33 user nova-compute[70243]:   <serial>01edee48-c6a6-4fdd-8c95-e952f4a2b192</serial>
Jul 24 16:37:33 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:37:33 user nova-compute[70243]: </disk>
Jul 24 16:37:33 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:37:33 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Successfully detached device vdb from instance beab81a6-209a-4d8d-8980-365ff2dc3cff from the persistent domain config.
Jul 24 16:37:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance beab81a6-209a-4d8d-8980-365ff2dc3cff from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:37:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:37:33 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:37:33 user nova-compute[70243]:   <source dev="/dev/sdd"/>
Jul 24 16:37:33 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:37:33 user nova-compute[70243]:   <serial>01edee48-c6a6-4fdd-8c95-e952f4a2b192</serial>
Jul 24 16:37:33 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:37:33 user nova-compute[70243]: </disk>
Jul 24 16:37:33 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:37:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690216653.93594, beab81a6-209a-4d8d-8980-365ff2dc3cff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:37:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance beab81a6-209a-4d8d-8980-365ff2dc3cff {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:37:33 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Successfully detached device vdb from instance beab81a6-209a-4d8d-8980-365ff2dc3cff from the live domain config.
Jul 24 16:37:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:37:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwNgcRrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:37:33 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:37:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:37:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:37:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e614b85-df1b-4aad-b553-f3829d687a37]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:37:33 user nova-compute[70243]: No targets found.
Jul 24 16:37:33 user nova-compute[70243]: iSNS:
Jul 24 16:37:33 user nova-compute[70243]: No targets found.
Jul 24 16:37:33 user nova-compute[70243]: STATIC:
Jul 24 16:37:33 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17
Jul 24 16:37:33 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:37:33 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:37:33 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192
Jul 24 16:37:33 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:37:33 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:37:33 user nova-compute[70243]: FIRMWARE:
Jul 24 16:37:33 user nova-compute[70243]: No targets found.
Jul 24 16:37:33 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:37:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:37:33 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:37:33 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:37:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:37:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac345802-df01-4d9c-8fa6-d43cfa762441]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49b75a4-6f4a-4c2f-b02a-405f97a30cba]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:37:34 user nova-compute[70243]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 (non-flash)
Jul 24 16:37:34 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:37:34 user nova-compute[70243]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 (non-flash)
Jul 24 16:37:34 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91fe140af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192'): ({'sdd'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Removing single pathed devices sdd {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cea3113-db6a-4a9f-90c5-9e7bbe656fc3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[714a7717-be16-4aac-8142-bce043c2089b]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Flushing IO for device /dev/sdd {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6822c2b9-bc2f-4aec-886f-f7ff8e561685]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eafeeb9-35f8-4599-b8a3-a328457116d1]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] SCSI volumes sdd have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9253c5d0-8602-4993-87b8-1f802e9469c6]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1554bc4e-9935-463d-8199-c1b890f144c6]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192, portal: 172.16.0.220,3260]
Jul 24 16:37:34 user nova-compute[70243]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192, portal: 172.16.0.220,3260] successful.
Jul 24 16:37:34 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01edee48-c6a6-4fdd-8c95-e952f4a2b192 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e500ba-e970-4c9f-ab4f-dc8d63e0f071]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] <== disconnect_volume: return (302ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:37:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:37:35 user nova-compute[70243]: DEBUG nova.objects.instance [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lazy-loading 'flavor' on Instance uuid beab81a6-209a-4d8d-8980-365ff2dc3cff {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:37:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-00bc2fce-998b-4f16-9996-9581aa404c30 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "beab81a6-209a-4d8d-8980-365ff2dc3cff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.801s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:37:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:50 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:37:51 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:37:53 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:37:53 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:37:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:37:57 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:37:57 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:37:57 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:37:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:37:59 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:37:59 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:37:59 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 16:37:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-50fecb3a-8f06-4822-8c84-76df51acfe50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:37:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-50fecb3a-8f06-4822-8c84-76df51acfe50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:37:59 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:37:59 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lazy-loading 'info_cache' on Instance uuid 50fecb3a-8f06-4822-8c84-76df51acfe50 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:37:59 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Updating instance_info_cache with network_info: [{"id": "657cc261-2d12-42c2-a879-f8cc121bd811", "address": "fa:16:3e:93:0d:e3", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657cc261-2d", "ovs_interfaceid": "657cc261-2d12-42c2-a879-f8cc121bd811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:37:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-50fecb3a-8f06-4822-8c84-76df51acfe50" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:37:59 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:37:59 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:37:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:37:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:37:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:37:59 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:37:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:38:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:02 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:38:02 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:38:02 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=7935MB free_disk=24.164093017578125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:38:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:03 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 50fecb3a-8f06-4822-8c84-76df51acfe50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:38:03 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6f2258de-6b31-48af-81df-37b64da4ca99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:38:03 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 0cceb071-c478-4914-8243-77c3efbdb5d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:38:03 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 75b26864-1539-4106-b741-3b3f5c7e898a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:38:03 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 100c6ba5-de96-4c2a-ae0c-9d3a9199948c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:38:03 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance beab81a6-209a-4d8d-8980-365ff2dc3cff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:38:03 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 00fec25c-8982-4a40-80ae-11d0936e10a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:38:03 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:38:03 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:38:03 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:38:03 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:38:03 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:38:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.358s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:38:04 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:38:04 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:38:06 user nova-compute[70243]: INFO nova.compute.manager [None req-7e2db1f7-c068-471f-b717-5e0ad7cdcfdc tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Unrescuing
Jul 24 16:38:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7e2db1f7-c068-471f-b717-5e0ad7cdcfdc tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:38:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7e2db1f7-c068-471f-b717-5e0ad7cdcfdc tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquired lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:38:06 user nova-compute[70243]: DEBUG nova.network.neutron [None req-7e2db1f7-c068-471f-b717-5e0ad7cdcfdc tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:38:07 user nova-compute[70243]: DEBUG nova.network.neutron [None req-7e2db1f7-c068-471f-b717-5e0ad7cdcfdc tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Updating instance_info_cache with network_info: [{"id": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "address": "fa:16:3e:46:16:b8", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e9e4c6-7d", "ovs_interfaceid": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:38:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7e2db1f7-c068-471f-b717-5e0ad7cdcfdc tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Releasing lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:38:07 user nova-compute[70243]: DEBUG nova.objects.instance [None req-7e2db1f7-c068-471f-b717-5e0ad7cdcfdc tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'flavor' on Instance uuid 0cceb071-c478-4914-8243-77c3efbdb5d3 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:38:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:07 user nova-compute[70243]: DEBUG nova.compute.manager [req-c6aeed70-f25c-49e3-aa01-a9cecc781e5a req-5c4a0aed-7785-418b-931d-412bc84e7dc7 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received event network-vif-unplugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:38:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c6aeed70-f25c-49e3-aa01-a9cecc781e5a req-5c4a0aed-7785-418b-931d-412bc84e7dc7 service nova] Acquiring lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c6aeed70-f25c-49e3-aa01-a9cecc781e5a req-5c4a0aed-7785-418b-931d-412bc84e7dc7 service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c6aeed70-f25c-49e3-aa01-a9cecc781e5a req-5c4a0aed-7785-418b-931d-412bc84e7dc7 service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:07 user nova-compute[70243]: DEBUG nova.compute.manager [req-c6aeed70-f25c-49e3-aa01-a9cecc781e5a req-5c4a0aed-7785-418b-931d-412bc84e7dc7 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] No waiting events found dispatching network-vif-unplugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:38:07 user nova-compute[70243]: WARNING nova.compute.manager [req-c6aeed70-f25c-49e3-aa01-a9cecc781e5a req-5c4a0aed-7785-418b-931d-412bc84e7dc7 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received unexpected event network-vif-unplugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a for instance with vm_state rescued and task_state unrescuing.
Jul 24 16:38:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:07 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Instance destroyed successfully.
Jul 24 16:38:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-9920137d-2756-4bfc-a533-da47084d3569 req-8085ef99-15ed-4c3a-8d46-9b97baf57cf7 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received event network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:38:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9920137d-2756-4bfc-a533-da47084d3569 req-8085ef99-15ed-4c3a-8d46-9b97baf57cf7 service nova] Acquiring lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9920137d-2756-4bfc-a533-da47084d3569 req-8085ef99-15ed-4c3a-8d46-9b97baf57cf7 service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9920137d-2756-4bfc-a533-da47084d3569 req-8085ef99-15ed-4c3a-8d46-9b97baf57cf7 service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-9920137d-2756-4bfc-a533-da47084d3569 req-8085ef99-15ed-4c3a-8d46-9b97baf57cf7 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] No waiting events found dispatching network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:38:09 user nova-compute[70243]: WARNING nova.compute.manager [req-9920137d-2756-4bfc-a533-da47084d3569 req-8085ef99-15ed-4c3a-8d46-9b97baf57cf7 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received unexpected event network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a for instance with vm_state rescued and task_state unrescuing.
Jul 24 16:38:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-9920137d-2756-4bfc-a533-da47084d3569 req-8085ef99-15ed-4c3a-8d46-9b97baf57cf7 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received event network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:38:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9920137d-2756-4bfc-a533-da47084d3569 req-8085ef99-15ed-4c3a-8d46-9b97baf57cf7 service nova] Acquiring lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9920137d-2756-4bfc-a533-da47084d3569 req-8085ef99-15ed-4c3a-8d46-9b97baf57cf7 service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9920137d-2756-4bfc-a533-da47084d3569 req-8085ef99-15ed-4c3a-8d46-9b97baf57cf7 service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-9920137d-2756-4bfc-a533-da47084d3569 req-8085ef99-15ed-4c3a-8d46-9b97baf57cf7 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] No waiting events found dispatching network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:38:09 user nova-compute[70243]: WARNING nova.compute.manager [req-9920137d-2756-4bfc-a533-da47084d3569 req-8085ef99-15ed-4c3a-8d46-9b97baf57cf7 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received unexpected event network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a for instance with vm_state rescued and task_state unrescuing.
Jul 24 16:38:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-9920137d-2756-4bfc-a533-da47084d3569 req-8085ef99-15ed-4c3a-8d46-9b97baf57cf7 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received event network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:38:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9920137d-2756-4bfc-a533-da47084d3569 req-8085ef99-15ed-4c3a-8d46-9b97baf57cf7 service nova] Acquiring lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9920137d-2756-4bfc-a533-da47084d3569 req-8085ef99-15ed-4c3a-8d46-9b97baf57cf7 service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9920137d-2756-4bfc-a533-da47084d3569 req-8085ef99-15ed-4c3a-8d46-9b97baf57cf7 service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-9920137d-2756-4bfc-a533-da47084d3569 req-8085ef99-15ed-4c3a-8d46-9b97baf57cf7 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] No waiting events found dispatching network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:38:09 user nova-compute[70243]: WARNING nova.compute.manager [req-9920137d-2756-4bfc-a533-da47084d3569 req-8085ef99-15ed-4c3a-8d46-9b97baf57cf7 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received unexpected event network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a for instance with vm_state rescued and task_state unrescuing.
Jul 24 16:38:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Removed pending event for 0cceb071-c478-4914-8243-77c3efbdb5d3 due to event {{(pid=70243) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 16:38:11 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216691.384682, 0cceb071-c478-4914-8243-77c3efbdb5d3 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:38:11 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] VM Resumed (Lifecycle Event)
Jul 24 16:38:11 user nova-compute[70243]: DEBUG nova.compute.manager [None req-7e2db1f7-c068-471f-b717-5e0ad7cdcfdc tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:38:11 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:38:11 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:38:11 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 24 16:38:11 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216691.3877678, 0cceb071-c478-4914-8243-77c3efbdb5d3 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:38:11 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] VM Started (Lifecycle Event)
Jul 24 16:38:11 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:38:11 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:38:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "8c896761-df6a-4f4a-87dd-c5ea30641a89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:38:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "beab81a6-209a-4d8d-8980-365ff2dc3cff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "beab81a6-209a-4d8d-8980-365ff2dc3cff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "beab81a6-209a-4d8d-8980-365ff2dc3cff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "beab81a6-209a-4d8d-8980-365ff2dc3cff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "beab81a6-209a-4d8d-8980-365ff2dc3cff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:24 user nova-compute[70243]: INFO nova.compute.manager [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Terminating instance
Jul 24 16:38:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:38:24 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:38:24 user nova-compute[70243]: INFO nova.compute.claims [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Claim successful on node user
Jul 24 16:38:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:24 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:38:24 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:38:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.571s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:38:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:38:24 user nova-compute[70243]: DEBUG nova.network.neutron [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:38:24 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:38:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:38:25 user nova-compute[70243]: INFO nova.virt.block_device [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Booting with blank volume at /dev/vda
Jul 24 16:38:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG nova.compute.manager [req-b7b432bd-4d04-4e6b-9778-b0151235768d req-e02decbc-985a-4c93-ac01-3a1afa2c7330 service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Received event network-vif-unplugged-97c822af-71d3-4352-8cb4-544bc125e38f {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b7b432bd-4d04-4e6b-9778-b0151235768d req-e02decbc-985a-4c93-ac01-3a1afa2c7330 service nova] Acquiring lock "beab81a6-209a-4d8d-8980-365ff2dc3cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b7b432bd-4d04-4e6b-9778-b0151235768d req-e02decbc-985a-4c93-ac01-3a1afa2c7330 service nova] Lock "beab81a6-209a-4d8d-8980-365ff2dc3cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b7b432bd-4d04-4e6b-9778-b0151235768d req-e02decbc-985a-4c93-ac01-3a1afa2c7330 service nova] Lock "beab81a6-209a-4d8d-8980-365ff2dc3cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG nova.compute.manager [req-b7b432bd-4d04-4e6b-9778-b0151235768d req-e02decbc-985a-4c93-ac01-3a1afa2c7330 service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] No waiting events found dispatching network-vif-unplugged-97c822af-71d3-4352-8cb4-544bc125e38f {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG nova.compute.manager [req-b7b432bd-4d04-4e6b-9778-b0151235768d req-e02decbc-985a-4c93-ac01-3a1afa2c7330 service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Received event network-vif-unplugged-97c822af-71d3-4352-8cb4-544bc125e38f for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:25 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Instance destroyed successfully.
Jul 24 16:38:25 user nova-compute[70243]: DEBUG nova.objects.instance [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lazy-loading 'resources' on Instance uuid beab81a6-209a-4d8d-8980-365ff2dc3cff {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:35:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-239439492',display_name='tempest-AttachVolumeNegativeTest-server-239439492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-239439492',id=33,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcfSPSXZEL8d7XgdpA8txqUaX0Pt0TZeH6YO5c4Soib5lK0PAU+SctMZxUJ8vxQhi+/seD0RMPskzDoDYbf22dR3UDbQkJk2lEoKjqBaZA79itxtkUD0HC+HzGNlsq4YQ==',key_name='tempest-keypair-451306606',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:35:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e819e22e590947478d513e1b9ad39494',ramdisk_id='',reservation_id='r-vhmw8byx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1152214105',owner_user_name='tempest-AttachVolumeNegativeTest-1152214105-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:35:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df18929107a458194a9c528d9bdfeac',uuid=beab81a6-209a-4d8d-8980-365ff2dc3cff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97c822af-71d3-4352-8cb4-544bc125e38f", "address": "fa:16:3e:86:60:5d", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c822af-71", "ovs_interfaceid": "97c822af-71d3-4352-8cb4-544bc125e38f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converting VIF {"id": "97c822af-71d3-4352-8cb4-544bc125e38f", "address": "fa:16:3e:86:60:5d", "network": {"id": "83f86261-7c5b-42ca-b47a-93e352c7f517", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-810274896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e819e22e590947478d513e1b9ad39494", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97c822af-71", "ovs_interfaceid": "97c822af-71d3-4352-8cb4-544bc125e38f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:60:5d,bridge_name='br-int',has_traffic_filtering=True,id=97c822af-71d3-4352-8cb4-544bc125e38f,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c822af-71') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG os_vif [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:60:5d,bridge_name='br-int',has_traffic_filtering=True,id=97c822af-71d3-4352-8cb4-544bc125e38f,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c822af-71') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97c822af-71, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG nova.policy [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae306b319e8c4e61b0a73933dc5c330c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06cf84dc406343afa81260614acc8fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:38:25 user nova-compute[70243]: INFO os_vif [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:60:5d,bridge_name='br-int',has_traffic_filtering=True,id=97c822af-71d3-4352-8cb4-544bc125e38f,network=Network(83f86261-7c5b-42ca-b47a-93e352c7f517),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97c822af-71')
Jul 24 16:38:25 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Deleting instance files /opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff_del
Jul 24 16:38:25 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Deletion of /opt/stack/data/nova/instances/beab81a6-209a-4d8d-8980-365ff2dc3cff_del complete
Jul 24 16:38:25 user nova-compute[70243]: INFO nova.compute.manager [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Took 1.03 seconds to destroy the instance on the hypervisor.
Jul 24 16:38:25 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Acquiring lock "b77a2e65-7abb-42ee-ae10-f8df46b93078" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "b77a2e65-7abb-42ee-ae10-f8df46b93078" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG nova.compute.manager [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:38:25 user nova-compute[70243]: INFO nova.compute.claims [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Claim successful on node user
Jul 24 16:38:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "75b26864-1539-4106-b741-3b3f5c7e898a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG nova.objects.instance [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lazy-loading 'flavor' on Instance uuid 75b26864-1539-4106-b741-3b3f5c7e898a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:38:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "75b26864-1539-4106-b741-3b3f5c7e898a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:26 user nova-compute[70243]: INFO nova.compute.manager [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Attaching volume ec04f208-76e6-4bec-bd53-ce51816f32d7 to /dev/vdb
Jul 24 16:38:26 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG os_brick.utils [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8570344-eba2-4f83-8a49-c82cb9311940]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG nova.compute.manager [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[54576918-774b-4869-83e1-4286f8d3d32c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd39a48-da3e-4aed-ad26-0c709a698792]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd984307-bb1f-43c5-a5c0-64ca1afa23f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG nova.compute.manager [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG nova.network.neutron [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:38:26 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20d990f-7ffd-4c7c-828d-be58497a44b4]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG os_brick.utils [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Updating existing volume attachment record: 32d11a16-d274-4761-a195-0572d61bc413 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:38:26 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:38:26 user nova-compute[70243]: DEBUG nova.compute.manager [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG nova.policy [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '875f54352894419b90a0d2ad337ab1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba424603ae5749a9aa59cb0360dc9d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG nova.compute.manager [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:38:26 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Creating image(s)
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Acquiring lock "/opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "/opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "/opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.149s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.152s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/disk 1073741824" returned: 0 in 0.056s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG nova.network.neutron [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Successfully created port: daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.145s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:38:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG nova.compute.manager [req-69e7feff-922a-40c0-9be5-ef2f49a12695 req-5d29f90a-53e7-4579-b81b-69dd729a6643 service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Received event network-vif-plugged-97c822af-71d3-4352-8cb4-544bc125e38f {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-69e7feff-922a-40c0-9be5-ef2f49a12695 req-5d29f90a-53e7-4579-b81b-69dd729a6643 service nova] Acquiring lock "beab81a6-209a-4d8d-8980-365ff2dc3cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-69e7feff-922a-40c0-9be5-ef2f49a12695 req-5d29f90a-53e7-4579-b81b-69dd729a6643 service nova] Lock "beab81a6-209a-4d8d-8980-365ff2dc3cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-69e7feff-922a-40c0-9be5-ef2f49a12695 req-5d29f90a-53e7-4579-b81b-69dd729a6643 service nova] Lock "beab81a6-209a-4d8d-8980-365ff2dc3cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG nova.compute.manager [req-69e7feff-922a-40c0-9be5-ef2f49a12695 req-5d29f90a-53e7-4579-b81b-69dd729a6643 service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] No waiting events found dispatching network-vif-plugged-97c822af-71d3-4352-8cb4-544bc125e38f {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:38:27 user nova-compute[70243]: WARNING nova.compute.manager [req-69e7feff-922a-40c0-9be5-ef2f49a12695 req-5d29f90a-53e7-4579-b81b-69dd729a6643 service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Received unexpected event network-vif-plugged-97c822af-71d3-4352-8cb4-544bc125e38f for instance with vm_state active and task_state deleting.
Jul 24 16:38:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Cannot resize image /opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG nova.objects.instance [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lazy-loading 'migration_context' on Instance uuid b77a2e65-7abb-42ee-ae10-f8df46b93078 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Ensure instance console log exists: /opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG nova.network.neutron [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Successfully created port: c5651f32-74b1-4cb2-82bc-d8a5e9049502 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:38:27 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Took 1.98 seconds to deallocate network for instance.
Jul 24 16:38:27 user nova-compute[70243]: DEBUG nova.compute.manager [req-7bf8dfe7-1b73-43d9-ae0c-dc14c0420537 req-dc50dfb1-4d07-44f1-84e8-650de16c60d8 service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Received event network-vif-deleted-97c822af-71d3-4352-8cb4-544bc125e38f {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:38:27 user nova-compute[70243]: INFO nova.compute.manager [req-7bf8dfe7-1b73-43d9-ae0c-dc14c0420537 req-dc50dfb1-4d07-44f1-84e8-650de16c60d8 service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Neutron deleted interface 97c822af-71d3-4352-8cb4-544bc125e38f; detaching it from the instance and deleting it from the info cache
Jul 24 16:38:27 user nova-compute[70243]: DEBUG nova.network.neutron [req-7bf8dfe7-1b73-43d9-ae0c-dc14c0420537 req-dc50dfb1-4d07-44f1-84e8-650de16c60d8 service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG nova.compute.manager [req-7bf8dfe7-1b73-43d9-ae0c-dc14c0420537 req-dc50dfb1-4d07-44f1-84e8-650de16c60d8 service nova] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Detach interface failed, port_id=97c822af-71d3-4352-8cb4-544bc125e38f, reason: Instance beab81a6-209a-4d8d-8980-365ff2dc3cff could not be found. {{(pid=70243) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:27 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Deleted allocations for instance beab81a6-209a-4d8d-8980-365ff2dc3cff
Jul 24 16:38:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ae7ceb37-b848-414d-b230-c924fd728694 tempest-AttachVolumeNegativeTest-1152214105 tempest-AttachVolumeNegativeTest-1152214105-project-member] Lock "beab81a6-209a-4d8d-8980-365ff2dc3cff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.549s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG nova.network.neutron [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Successfully updated port: daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "refresh_cache-8c896761-df6a-4f4a-87dd-c5ea30641a89" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquired lock "refresh_cache-8c896761-df6a-4f4a-87dd-c5ea30641a89" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG nova.network.neutron [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:38:27 user nova-compute[70243]: DEBUG nova.network.neutron [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.network.neutron [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Successfully updated port: c5651f32-74b1-4cb2-82bc-d8a5e9049502 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Acquiring lock "refresh_cache-b77a2e65-7abb-42ee-ae10-f8df46b93078" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Acquired lock "refresh_cache-b77a2e65-7abb-42ee-ae10-f8df46b93078" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.network.neutron [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-f2408351-bbdf-44b3-b20a-0a59424df18e req-4472b54b-7a04-411a-b014-b701ecf937d2 service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Received event network-changed-c5651f32-74b1-4cb2-82bc-d8a5e9049502 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-f2408351-bbdf-44b3-b20a-0a59424df18e req-4472b54b-7a04-411a-b014-b701ecf937d2 service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Refreshing instance network info cache due to event network-changed-c5651f32-74b1-4cb2-82bc-d8a5e9049502. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f2408351-bbdf-44b3-b20a-0a59424df18e req-4472b54b-7a04-411a-b014-b701ecf937d2 service nova] Acquiring lock "refresh_cache-b77a2e65-7abb-42ee-ae10-f8df46b93078" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.network.neutron [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.network.neutron [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Updating instance_info_cache with network_info: [{"id": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "address": "fa:16:3e:a5:da:73", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa5a7d4-ef", "ovs_interfaceid": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Releasing lock "refresh_cache-8c896761-df6a-4f4a-87dd-c5ea30641a89" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Instance network_info: |[{"id": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "address": "fa:16:3e:a5:da:73", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa5a7d4-ef", "ovs_interfaceid": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.network.neutron [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Updating instance_info_cache with network_info: [{"id": "c5651f32-74b1-4cb2-82bc-d8a5e9049502", "address": "fa:16:3e:ba:5c:ac", "network": {"id": "69dc6b7b-bfde-4a33-b2ad-950c352fbaf6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-455133887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba424603ae5749a9aa59cb0360dc9d9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5651f32-74", "ovs_interfaceid": "c5651f32-74b1-4cb2-82bc-d8a5e9049502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Releasing lock "refresh_cache-b77a2e65-7abb-42ee-ae10-f8df46b93078" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.compute.manager [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Instance network_info: |[{"id": "c5651f32-74b1-4cb2-82bc-d8a5e9049502", "address": "fa:16:3e:ba:5c:ac", "network": {"id": "69dc6b7b-bfde-4a33-b2ad-950c352fbaf6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-455133887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba424603ae5749a9aa59cb0360dc9d9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5651f32-74", "ovs_interfaceid": "c5651f32-74b1-4cb2-82bc-d8a5e9049502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f2408351-bbdf-44b3-b20a-0a59424df18e req-4472b54b-7a04-411a-b014-b701ecf937d2 service nova] Acquired lock "refresh_cache-b77a2e65-7abb-42ee-ae10-f8df46b93078" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.network.neutron [req-f2408351-bbdf-44b3-b20a-0a59424df18e req-4472b54b-7a04-411a-b014-b701ecf937d2 service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Refreshing network info cache for port c5651f32-74b1-4cb2-82bc-d8a5e9049502 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Start _get_guest_xml network_info=[{"id": "c5651f32-74b1-4cb2-82bc-d8a5e9049502", "address": "fa:16:3e:ba:5c:ac", "network": {"id": "69dc6b7b-bfde-4a33-b2ad-950c352fbaf6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-455133887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba424603ae5749a9aa59cb0360dc9d9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5651f32-74", "ovs_interfaceid": "c5651f32-74b1-4cb2-82bc-d8a5e9049502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:38:28 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:38:28 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:38:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1161803364',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1161803364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1161803',id=36,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXOK59YsXzBNrFm9i748sRhrqud7Kwk5+TYK3kd0geCWTWumJEYFl0OfzfIU5BGO15EMabBuWFZLtfoF4SF2+gMsWHEMcZeH5IG90XkGC0Yo4vOzh0w/MZOwfKI8aARyQ==',key_name='tempest-keypair-930806319',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba424603ae5749a9aa59cb0360dc9d9c',ramdisk_id='',reservation_id='r-kj0vcokv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1695730546',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:38:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='875f54352894419b90a0d2ad337ab1e3',uuid=b77a2e65-7abb-42ee-ae10-f8df46b93078,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5651f32-74b1-4cb2-82bc-d8a5e9049502", "address": "fa:16:3e:ba:5c:ac", "network": {"id": "69dc6b7b-bfde-4a33-b2ad-950c352fbaf6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-455133887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba424603ae5749a9aa59cb0360dc9d9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5651f32-74", "ovs_interfaceid": "c5651f32-74b1-4cb2-82bc-d8a5e9049502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Converting VIF {"id": "c5651f32-74b1-4cb2-82bc-d8a5e9049502", "address": "fa:16:3e:ba:5c:ac", "network": {"id": "69dc6b7b-bfde-4a33-b2ad-950c352fbaf6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-455133887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba424603ae5749a9aa59cb0360dc9d9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5651f32-74", "ovs_interfaceid": "c5651f32-74b1-4cb2-82bc-d8a5e9049502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:ac,bridge_name='br-int',has_traffic_filtering=True,id=c5651f32-74b1-4cb2-82bc-d8a5e9049502,network=Network(69dc6b7b-bfde-4a33-b2ad-950c352fbaf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5651f32-74') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.objects.instance [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lazy-loading 'pci_devices' on Instance uuid b77a2e65-7abb-42ee-ae10-f8df46b93078 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:38:28 user nova-compute[70243]:   <uuid>b77a2e65-7abb-42ee-ae10-f8df46b93078</uuid>
Jul 24 16:38:28 user nova-compute[70243]:   <name>instance-00000024</name>
Jul 24 16:38:28 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:38:28 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:38:28 user nova-compute[70243]:   <metadata>
Jul 24 16:38:28 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:38:28 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:38:28 user nova-compute[70243]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1161803364</nova:name>
Jul 24 16:38:28 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:38:28</nova:creationTime>
Jul 24 16:38:28 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:38:28 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:38:28 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:38:28 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:38:28 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:38:28 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:38:28 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:38:28 user nova-compute[70243]:       <nova:owner>
Jul 24 16:38:28 user nova-compute[70243]:         <nova:user uuid="875f54352894419b90a0d2ad337ab1e3">tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member</nova:user>
Jul 24 16:38:28 user nova-compute[70243]:         <nova:project uuid="ba424603ae5749a9aa59cb0360dc9d9c">tempest-TestServerVolumeAttachScenarioOldVersion-1695730546</nova:project>
Jul 24 16:38:28 user nova-compute[70243]:       </nova:owner>
Jul 24 16:38:28 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:38:28 user nova-compute[70243]:       <nova:ports>
Jul 24 16:38:28 user nova-compute[70243]:         <nova:port uuid="c5651f32-74b1-4cb2-82bc-d8a5e9049502">
Jul 24 16:38:28 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 24 16:38:28 user nova-compute[70243]:         </nova:port>
Jul 24 16:38:28 user nova-compute[70243]:       </nova:ports>
Jul 24 16:38:28 user nova-compute[70243]:     </nova:instance>
Jul 24 16:38:28 user nova-compute[70243]:   </metadata>
Jul 24 16:38:28 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:38:28 user nova-compute[70243]:     <system>
Jul 24 16:38:28 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:38:28 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:38:28 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:38:28 user nova-compute[70243]:       <entry name="serial">b77a2e65-7abb-42ee-ae10-f8df46b93078</entry>
Jul 24 16:38:28 user nova-compute[70243]:       <entry name="uuid">b77a2e65-7abb-42ee-ae10-f8df46b93078</entry>
Jul 24 16:38:28 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:38:28 user nova-compute[70243]:     </system>
Jul 24 16:38:28 user nova-compute[70243]:   </sysinfo>
Jul 24 16:38:28 user nova-compute[70243]:   <os>
Jul 24 16:38:28 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:38:28 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:38:28 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:38:28 user nova-compute[70243]:   </os>
Jul 24 16:38:28 user nova-compute[70243]:   <features>
Jul 24 16:38:28 user nova-compute[70243]:     <acpi/>
Jul 24 16:38:28 user nova-compute[70243]:     <apic/>
Jul 24 16:38:28 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:38:28 user nova-compute[70243]:   </features>
Jul 24 16:38:28 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:38:28 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:38:28 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:38:28 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:38:28 user nova-compute[70243]:   </clock>
Jul 24 16:38:28 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:38:28 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:38:28 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:38:28 user nova-compute[70243]:   </cpu>
Jul 24 16:38:28 user nova-compute[70243]:   <devices>
Jul 24 16:38:28 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:38:28 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:38:28 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/disk"/>
Jul 24 16:38:28 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:38:28 user nova-compute[70243]:     </disk>
Jul 24 16:38:28 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:38:28 user nova-compute[70243]:       <mac address="fa:16:3e:ba:5c:ac"/>
Jul 24 16:38:28 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:38:28 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:38:28 user nova-compute[70243]:       <target dev="tapc5651f32-74"/>
Jul 24 16:38:28 user nova-compute[70243]:     </interface>
Jul 24 16:38:28 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:38:28 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/console.log" append="off"/>
Jul 24 16:38:28 user nova-compute[70243]:     </serial>
Jul 24 16:38:28 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:38:28 user nova-compute[70243]:     <video>
Jul 24 16:38:28 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:38:28 user nova-compute[70243]:     </video>
Jul 24 16:38:28 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:38:28 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:38:28 user nova-compute[70243]:     </rng>
Jul 24 16:38:28 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:38:28 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:38:28 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:38:28 user nova-compute[70243]:     </memballoon>
Jul 24 16:38:28 user nova-compute[70243]:   </devices>
Jul 24 16:38:28 user nova-compute[70243]: </domain>
Jul 24 16:38:28 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:38:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1161803364',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1161803364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1161803',id=36,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXOK59YsXzBNrFm9i748sRhrqud7Kwk5+TYK3kd0geCWTWumJEYFl0OfzfIU5BGO15EMabBuWFZLtfoF4SF2+gMsWHEMcZeH5IG90XkGC0Yo4vOzh0w/MZOwfKI8aARyQ==',key_name='tempest-keypair-930806319',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba424603ae5749a9aa59cb0360dc9d9c',ramdisk_id='',reservation_id='r-kj0vcokv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1695730546',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:38:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='875f54352894419b90a0d2ad337ab1e3',uuid=b77a2e65-7abb-42ee-ae10-f8df46b93078,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5651f32-74b1-4cb2-82bc-d8a5e9049502", "address": "fa:16:3e:ba:5c:ac", "network": {"id": "69dc6b7b-bfde-4a33-b2ad-950c352fbaf6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-455133887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba424603ae5749a9aa59cb0360dc9d9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5651f32-74", "ovs_interfaceid": "c5651f32-74b1-4cb2-82bc-d8a5e9049502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Converting VIF {"id": "c5651f32-74b1-4cb2-82bc-d8a5e9049502", "address": "fa:16:3e:ba:5c:ac", "network": {"id": "69dc6b7b-bfde-4a33-b2ad-950c352fbaf6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-455133887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba424603ae5749a9aa59cb0360dc9d9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5651f32-74", "ovs_interfaceid": "c5651f32-74b1-4cb2-82bc-d8a5e9049502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:ac,bridge_name='br-int',has_traffic_filtering=True,id=c5651f32-74b1-4cb2-82bc-d8a5e9049502,network=Network(69dc6b7b-bfde-4a33-b2ad-950c352fbaf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5651f32-74') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG os_vif [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:ac,bridge_name='br-int',has_traffic_filtering=True,id=c5651f32-74b1-4cb2-82bc-d8a5e9049502,network=Network(69dc6b7b-bfde-4a33-b2ad-950c352fbaf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5651f32-74') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5651f32-74, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5651f32-74, col_values=(('external_ids', {'iface-id': 'c5651f32-74b1-4cb2-82bc-d8a5e9049502', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:5c:ac', 'vm-uuid': 'b77a2e65-7abb-42ee-ae10-f8df46b93078'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:28 user nova-compute[70243]: INFO os_vif [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:5c:ac,bridge_name='br-int',has_traffic_filtering=True,id=c5651f32-74b1-4cb2-82bc-d8a5e9049502,network=Network(69dc6b7b-bfde-4a33-b2ad-950c352fbaf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5651f32-74')
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] No VIF found with MAC fa:16:3e:ba:5c:ac, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.network.neutron [req-f2408351-bbdf-44b3-b20a-0a59424df18e req-4472b54b-7a04-411a-b014-b701ecf937d2 service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Updated VIF entry in instance network info cache for port c5651f32-74b1-4cb2-82bc-d8a5e9049502. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG nova.network.neutron [req-f2408351-bbdf-44b3-b20a-0a59424df18e req-4472b54b-7a04-411a-b014-b701ecf937d2 service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Updating instance_info_cache with network_info: [{"id": "c5651f32-74b1-4cb2-82bc-d8a5e9049502", "address": "fa:16:3e:ba:5c:ac", "network": {"id": "69dc6b7b-bfde-4a33-b2ad-950c352fbaf6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-455133887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba424603ae5749a9aa59cb0360dc9d9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5651f32-74", "ovs_interfaceid": "c5651f32-74b1-4cb2-82bc-d8a5e9049502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:38:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f2408351-bbdf-44b3-b20a-0a59424df18e req-4472b54b-7a04-411a-b014-b701ecf937d2 service nova] Releasing lock "refresh_cache-b77a2e65-7abb-42ee-ae10-f8df46b93078" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:38:29 user nova-compute[70243]: DEBUG nova.compute.manager [req-6c0ad9cd-04c6-4762-b315-be0b1d191d1e req-253f399f-98bf-468d-b019-442dadee7e73 service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received event network-changed-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:38:29 user nova-compute[70243]: DEBUG nova.compute.manager [req-6c0ad9cd-04c6-4762-b315-be0b1d191d1e req-253f399f-98bf-468d-b019-442dadee7e73 service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Refreshing instance network info cache due to event network-changed-daa5a7d4-efaf-41c4-8cd2-1a26326f9257. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:38:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6c0ad9cd-04c6-4762-b315-be0b1d191d1e req-253f399f-98bf-468d-b019-442dadee7e73 service nova] Acquiring lock "refresh_cache-8c896761-df6a-4f4a-87dd-c5ea30641a89" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:38:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6c0ad9cd-04c6-4762-b315-be0b1d191d1e req-253f399f-98bf-468d-b019-442dadee7e73 service nova] Acquired lock "refresh_cache-8c896761-df6a-4f4a-87dd-c5ea30641a89" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:38:29 user nova-compute[70243]: DEBUG nova.network.neutron [req-6c0ad9cd-04c6-4762-b315-be0b1d191d1e req-253f399f-98bf-468d-b019-442dadee7e73 service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Refreshing network info cache for port daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:38:29 user nova-compute[70243]: DEBUG nova.network.neutron [req-6c0ad9cd-04c6-4762-b315-be0b1d191d1e req-253f399f-98bf-468d-b019-442dadee7e73 service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Updated VIF entry in instance network info cache for port daa5a7d4-efaf-41c4-8cd2-1a26326f9257. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:38:29 user nova-compute[70243]: DEBUG nova.network.neutron [req-6c0ad9cd-04c6-4762-b315-be0b1d191d1e req-253f399f-98bf-468d-b019-442dadee7e73 service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Updating instance_info_cache with network_info: [{"id": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "address": "fa:16:3e:a5:da:73", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa5a7d4-ef", "ovs_interfaceid": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:38:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6c0ad9cd-04c6-4762-b315-be0b1d191d1e req-253f399f-98bf-468d-b019-442dadee7e73 service nova] Releasing lock "refresh_cache-8c896761-df6a-4f4a-87dd-c5ea30641a89" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:38:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG nova.compute.manager [req-9fe7be67-7138-493a-acd0-b0adb2d11f12 req-a0a6a1d1-7d76-426e-96d2-ece9d096deea service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Received event network-vif-plugged-c5651f32-74b1-4cb2-82bc-d8a5e9049502 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9fe7be67-7138-493a-acd0-b0adb2d11f12 req-a0a6a1d1-7d76-426e-96d2-ece9d096deea service nova] Acquiring lock "b77a2e65-7abb-42ee-ae10-f8df46b93078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9fe7be67-7138-493a-acd0-b0adb2d11f12 req-a0a6a1d1-7d76-426e-96d2-ece9d096deea service nova] Lock "b77a2e65-7abb-42ee-ae10-f8df46b93078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9fe7be67-7138-493a-acd0-b0adb2d11f12 req-a0a6a1d1-7d76-426e-96d2-ece9d096deea service nova] Lock "b77a2e65-7abb-42ee-ae10-f8df46b93078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG nova.compute.manager [req-9fe7be67-7138-493a-acd0-b0adb2d11f12 req-a0a6a1d1-7d76-426e-96d2-ece9d096deea service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] No waiting events found dispatching network-vif-plugged-c5651f32-74b1-4cb2-82bc-d8a5e9049502 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:38:30 user nova-compute[70243]: WARNING nova.compute.manager [req-9fe7be67-7138-493a-acd0-b0adb2d11f12 req-a0a6a1d1-7d76-426e-96d2-ece9d096deea service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Received unexpected event network-vif-plugged-c5651f32-74b1-4cb2-82bc-d8a5e9049502 for instance with vm_state building and task_state spawning.
Jul 24 16:38:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG os_brick.utils [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[916245cc-b37d-4828-943a-56671c230cd6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe9ec91-4caf-424b-a404-572b346611a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e6f0ac-16bf-414c-adec-fcaa0a364aaa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de6f399-6a76-46b2-a62b-9e074a46f84a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:38:30 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:38:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc033ca4-92f6-42e4-93ea-b2ac58393b3d]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG os_brick.utils [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:38:30 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Updating existing volume attachment record: 311fc649-3c2c-4f49-894c-2a945ec9629f {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:38:31 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216711.920801, b77a2e65-7abb-42ee-ae10-f8df46b93078 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:38:31 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] VM Resumed (Lifecycle Event)
Jul 24 16:38:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:38:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:38:31 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Instance spawned successfully.
Jul 24 16:38:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:38:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:38:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:38:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:38:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:38:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:38:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:38:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:38:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:38:31 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:38:31 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216711.9227295, b77a2e65-7abb-42ee-ae10-f8df46b93078 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:38:31 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] VM Started (Lifecycle Event)
Jul 24 16:38:32 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:38:32 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:38:32 user nova-compute[70243]: INFO nova.compute.manager [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Took 5.61 seconds to spawn the instance on the hypervisor.
Jul 24 16:38:32 user nova-compute[70243]: DEBUG nova.compute.manager [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:38:32 user nova-compute[70243]: INFO nova.compute.manager [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Took 6.42 seconds to build instance.
Jul 24 16:38:32 user nova-compute[70243]: DEBUG nova.compute.manager [req-7037b1fe-7104-4875-9cbb-3e8ddd413681 req-a7840179-7f76-43d5-860c-e55e63f1c13b service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Received event network-vif-plugged-c5651f32-74b1-4cb2-82bc-d8a5e9049502 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7037b1fe-7104-4875-9cbb-3e8ddd413681 req-a7840179-7f76-43d5-860c-e55e63f1c13b service nova] Acquiring lock "b77a2e65-7abb-42ee-ae10-f8df46b93078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7037b1fe-7104-4875-9cbb-3e8ddd413681 req-a7840179-7f76-43d5-860c-e55e63f1c13b service nova] Lock "b77a2e65-7abb-42ee-ae10-f8df46b93078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7037b1fe-7104-4875-9cbb-3e8ddd413681 req-a7840179-7f76-43d5-860c-e55e63f1c13b service nova] Lock "b77a2e65-7abb-42ee-ae10-f8df46b93078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG nova.compute.manager [req-7037b1fe-7104-4875-9cbb-3e8ddd413681 req-a7840179-7f76-43d5-860c-e55e63f1c13b service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] No waiting events found dispatching network-vif-plugged-c5651f32-74b1-4cb2-82bc-d8a5e9049502 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:38:32 user nova-compute[70243]: WARNING nova.compute.manager [req-7037b1fe-7104-4875-9cbb-3e8ddd413681 req-a7840179-7f76-43d5-860c-e55e63f1c13b service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Received unexpected event network-vif-plugged-c5651f32-74b1-4cb2-82bc-d8a5e9049502 for instance with vm_state active and task_state None.
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-566b68a8-e6be-4c66-b201-b626c9dffe1c tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "b77a2e65-7abb-42ee-ae10-f8df46b93078" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.545s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrLtKEiW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:38:32 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:38:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:38:32 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:38:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:38:32 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db3e9e0-2b05-498d-9f81-bfdee6624e52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:38:32 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5d4ab8-89c1-445e-b2a1-b8cb1ddcf60b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7] added
Jul 24 16:38:32 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1a023f-5ecd-4a04-8bdc-f8f58aca8e82]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57f758b-ce3d-4a9d-8915-358321c84b5c]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nrLtKEiW {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nrLtKEiW" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[059d6989-05a4-4b8a-936a-52b927bb8302]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nrLtKEiW'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0accc303-2ba5-48aa-bd54-eb591a71e5d0]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed90e67b-064e-410e-9826-52e98430a93b]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:38:32 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:38:32 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:38:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27b56cd-59fe-4606-be49-5b6ddd256bed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7, portal: 172.16.0.220,3260]
Jul 24 16:38:33 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7, portal: 172.16.0.220,3260] successful.
Jul 24 16:38:33 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:38:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cdd1d8-a2be-4c7f-be13-2b8d43b43e49]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:38:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb647e12-2dbe-454a-ad3d-f4967a411476]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:38:33 user nova-compute[70243]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 (non-flash)
Jul 24 16:38:33 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:38:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:38:33 user nova-compute[70243]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 (non-flash)
Jul 24 16:38:33 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:38:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:38:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:38:33 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:38:33 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:38:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebce35b-4d4c-477d-a0d9-ef619be83d37]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:33 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:38:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrLtKEiW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:38:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:38:34 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23439333434313437', 'path': '/dev/sdc'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:38:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439333434313437', 'path': '/dev/sdc'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:38:34 user nova-compute[70243]: DEBUG nova.objects.instance [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lazy-loading 'flavor' on Instance uuid 75b26864-1539-4106-b741-3b3f5c7e898a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:38:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:38:34 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:38:34 user nova-compute[70243]:   <source dev="/dev/sdc"/>
Jul 24 16:38:34 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:38:34 user nova-compute[70243]:   <serial>ec04f208-76e6-4bec-bd53-ce51816f32d7</serial>
Jul 24 16:38:34 user nova-compute[70243]: </disk>
Jul 24 16:38:34 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:38:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:38:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:38:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] No VIF found with MAC fa:16:3e:81:5b:1b, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:38:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28052493-ca6c-465a-8f0f-adf5cefa2098 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.953s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "75b26864-1539-4106-b741-3b3f5c7e898a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:37 user nova-compute[70243]: INFO nova.compute.manager [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Detaching volume ec04f208-76e6-4bec-bd53-ce51816f32d7
Jul 24 16:38:37 user nova-compute[70243]: INFO nova.virt.block_device [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Attempting to driver detach volume ec04f208-76e6-4bec-bd53-ce51816f32d7 from mountpoint /dev/vdb
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Attempting to detach device vdb from instance 75b26864-1539-4106-b741-3b3f5c7e898a from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:38:37 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:38:37 user nova-compute[70243]:   <source dev="/dev/sdc"/>
Jul 24 16:38:37 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:38:37 user nova-compute[70243]:   <serial>ec04f208-76e6-4bec-bd53-ce51816f32d7</serial>
Jul 24 16:38:37 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:38:37 user nova-compute[70243]: </disk>
Jul 24 16:38:37 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:38:37 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Successfully detached device vdb from instance 75b26864-1539-4106-b741-3b3f5c7e898a from the persistent domain config.
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 75b26864-1539-4106-b741-3b3f5c7e898a from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:38:37 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:38:37 user nova-compute[70243]:   <source dev="/dev/sdc"/>
Jul 24 16:38:37 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:38:37 user nova-compute[70243]:   <serial>ec04f208-76e6-4bec-bd53-ce51816f32d7</serial>
Jul 24 16:38:37 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:38:37 user nova-compute[70243]: </disk>
Jul 24 16:38:37 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:38:37 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Creating image(s)
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Did not create local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Ensure instance console log exists: /opt/stack/data/nova/instances/8c896761-df6a-4f4a-87dd-c5ea30641a89/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Start _get_guest_xml network_info=[{"id": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "address": "fa:16:3e:a5:da:73", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa5a7d4-ef", "ovs_interfaceid": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaQUdlyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8c896761-df6a-4f4a-87dd-c5ea30641a89', 'attached_at': '', 'detached_at': '', 'volume_id': '80abe3a6-777b-4600-ab3a-b4ce4e58edc3', 'serial': '80abe3a6-777b-4600-ab3a-b4ce4e58edc3'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '311fc649-3c2c-4f49-894c-2a945ec9629f', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:38:37 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:38:37 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaQUdlyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:38:37 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:38:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:38:37 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:38:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:38:37 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b491b2-50c1-40c2-b5c2-04f8755555d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:38:37 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3673ab-07a1-4a0e-a846-c0b6c4e312a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3] added
Jul 24 16:38:37 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bb2601-4415-4fa8-8de3-217bd5149d37]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1700e5de-7cb4-4d96-9ab1-67eb0e6ac25a]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xaQUdlyu {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xaQUdlyu" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0585528-490b-44d9-b8e7-003682f4c7ea]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xaQUdlyu'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b822450-b544-4afa-a413-37f7299d897d]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:38:37 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a600f0e-8d1e-4e40-8821-211241fc3f8d]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:38:38 user nova-compute[70243]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 (non-flash)
Jul 24 16:38:38 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:38:38 user nova-compute[70243]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 (non-flash)
Jul 24 16:38:38 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1623d229-3031-4cbc-8bd0-95e04965fc1d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3, portal: 172.16.0.220,3260]
Jul 24 16:38:38 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3, portal: 172.16.0.220,3260] successful.
Jul 24 16:38:38 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2647fc-9b0a-46e9-8581-f23f7f637b01]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[950677b1-b3f0-4ecc-9fd8-a3dd63a64d98]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:38:38 user nova-compute[70243]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 (non-flash)
Jul 24 16:38:38 user nova-compute[70243]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:38:38 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:38:38 user nova-compute[70243]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 (non-flash)
Jul 24 16:38:38 user nova-compute[70243]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:38:38 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690216718.1305623, 75b26864-1539-4106-b741-3b3f5c7e898a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 75b26864-1539-4106-b741-3b3f5c7e898a {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:38:38 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Successfully detached device vdb from instance 75b26864-1539-4106-b741-3b3f5c7e898a from the live domain config.
Jul 24 16:38:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[591d0308-4c79-4177-bea0-9bf3572efade]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: None {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrLtKEiW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:38:38 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:38:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:38:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaQUdlyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26536626664643463', 'path': '/dev/sdd'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536626664643463', 'path': '/dev/sdd'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc035a8-2cbf-4134-b094-44753c3b948b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:38:39 user nova-compute[70243]: No targets found.
Jul 24 16:38:39 user nova-compute[70243]: iSNS:
Jul 24 16:38:39 user nova-compute[70243]: No targets found.
Jul 24 16:38:39 user nova-compute[70243]: STATIC:
Jul 24 16:38:39 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7
Jul 24 16:38:39 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:38:39 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:38:39 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3
Jul 24 16:38:39 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:38:39 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:38:39 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17
Jul 24 16:38:39 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:38:39 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:38:39 user nova-compute[70243]: FIRMWARE:
Jul 24 16:38:39 user nova-compute[70243]: No targets found.
Jul 24 16:38:39 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:38:39 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:38:39 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:38:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-166447096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-166447096',id=35,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06cf84dc406343afa81260614acc8fdd',ramdisk_id='',reservation_id='r-8wvymxtp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:38:25Z,user_data=None,user_id='ae306b319e8c4e61b0a73933dc5c330c',uuid=8c896761-df6a-4f4a-87dd-c5ea30641a89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "address": "fa:16:3e:a5:da:73", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa5a7d4-ef", "ovs_interfaceid": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converting VIF {"id": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "address": "fa:16:3e:a5:da:73", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa5a7d4-ef", "ovs_interfaceid": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:da:73,bridge_name='br-int',has_traffic_filtering=True,id=daa5a7d4-efaf-41c4-8cd2-1a26326f9257,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa5a7d4-ef') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG nova.objects.instance [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c896761-df6a-4f4a-87dd-c5ea30641a89 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:38:39 user nova-compute[70243]:   <uuid>8c896761-df6a-4f4a-87dd-c5ea30641a89</uuid>
Jul 24 16:38:39 user nova-compute[70243]:   <name>instance-00000023</name>
Jul 24 16:38:39 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:38:39 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:38:39 user nova-compute[70243]:   <metadata>
Jul 24 16:38:39 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:38:39 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:38:39 user nova-compute[70243]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-166447096</nova:name>
Jul 24 16:38:39 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:38:37</nova:creationTime>
Jul 24 16:38:39 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:38:39 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:38:39 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:38:39 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:38:39 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:38:39 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:38:39 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:38:39 user nova-compute[70243]:       <nova:owner>
Jul 24 16:38:39 user nova-compute[70243]:         <nova:user uuid="ae306b319e8c4e61b0a73933dc5c330c">tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member</nova:user>
Jul 24 16:38:39 user nova-compute[70243]:         <nova:project uuid="06cf84dc406343afa81260614acc8fdd">tempest-ServerBootFromVolumeStableRescueTest-1579673828</nova:project>
Jul 24 16:38:39 user nova-compute[70243]:       </nova:owner>
Jul 24 16:38:39 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:38:39 user nova-compute[70243]:       <nova:ports>
Jul 24 16:38:39 user nova-compute[70243]:         <nova:port uuid="daa5a7d4-efaf-41c4-8cd2-1a26326f9257">
Jul 24 16:38:39 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 24 16:38:39 user nova-compute[70243]:         </nova:port>
Jul 24 16:38:39 user nova-compute[70243]:       </nova:ports>
Jul 24 16:38:39 user nova-compute[70243]:     </nova:instance>
Jul 24 16:38:39 user nova-compute[70243]:   </metadata>
Jul 24 16:38:39 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:38:39 user nova-compute[70243]:     <system>
Jul 24 16:38:39 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:38:39 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:38:39 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:38:39 user nova-compute[70243]:       <entry name="serial">8c896761-df6a-4f4a-87dd-c5ea30641a89</entry>
Jul 24 16:38:39 user nova-compute[70243]:       <entry name="uuid">8c896761-df6a-4f4a-87dd-c5ea30641a89</entry>
Jul 24 16:38:39 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:38:39 user nova-compute[70243]:     </system>
Jul 24 16:38:39 user nova-compute[70243]:   </sysinfo>
Jul 24 16:38:39 user nova-compute[70243]:   <os>
Jul 24 16:38:39 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:38:39 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:38:39 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:38:39 user nova-compute[70243]:   </os>
Jul 24 16:38:39 user nova-compute[70243]:   <features>
Jul 24 16:38:39 user nova-compute[70243]:     <acpi/>
Jul 24 16:38:39 user nova-compute[70243]:     <apic/>
Jul 24 16:38:39 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:38:39 user nova-compute[70243]:   </features>
Jul 24 16:38:39 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:38:39 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:38:39 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:38:39 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:38:39 user nova-compute[70243]:   </clock>
Jul 24 16:38:39 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:38:39 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:38:39 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:38:39 user nova-compute[70243]:   </cpu>
Jul 24 16:38:39 user nova-compute[70243]:   <devices>
Jul 24 16:38:39 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:38:39 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:38:39 user nova-compute[70243]:       <source dev="/dev/sdd"/>
Jul 24 16:38:39 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:38:39 user nova-compute[70243]:       <serial>80abe3a6-777b-4600-ab3a-b4ce4e58edc3</serial>
Jul 24 16:38:39 user nova-compute[70243]:     </disk>
Jul 24 16:38:39 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:38:39 user nova-compute[70243]:       <mac address="fa:16:3e:a5:da:73"/>
Jul 24 16:38:39 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:38:39 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:38:39 user nova-compute[70243]:       <target dev="tapdaa5a7d4-ef"/>
Jul 24 16:38:39 user nova-compute[70243]:     </interface>
Jul 24 16:38:39 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:38:39 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/8c896761-df6a-4f4a-87dd-c5ea30641a89/console.log" append="off"/>
Jul 24 16:38:39 user nova-compute[70243]:     </serial>
Jul 24 16:38:39 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:38:39 user nova-compute[70243]:     <video>
Jul 24 16:38:39 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:38:39 user nova-compute[70243]:     </video>
Jul 24 16:38:39 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:38:39 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:38:39 user nova-compute[70243]:     </rng>
Jul 24 16:38:39 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:38:39 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:38:39 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:38:39 user nova-compute[70243]:     </memballoon>
Jul 24 16:38:39 user nova-compute[70243]:   </devices>
Jul 24 16:38:39 user nova-compute[70243]: </domain>
Jul 24 16:38:39 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:38:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-166447096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-166447096',id=35,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06cf84dc406343afa81260614acc8fdd',ramdisk_id='',reservation_id='r-8wvymxtp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:38:25Z,user_data=None,user_id='ae306b319e8c4e61b0a73933dc5c330c',uuid=8c896761-df6a-4f4a-87dd-c5ea30641a89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "address": "fa:16:3e:a5:da:73", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa5a7d4-ef", "ovs_interfaceid": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converting VIF {"id": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "address": "fa:16:3e:a5:da:73", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa5a7d4-ef", "ovs_interfaceid": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:da:73,bridge_name='br-int',has_traffic_filtering=True,id=daa5a7d4-efaf-41c4-8cd2-1a26326f9257,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa5a7d4-ef') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_vif [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:da:73,bridge_name='br-int',has_traffic_filtering=True,id=daa5a7d4-efaf-41c4-8cd2-1a26326f9257,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa5a7d4-ef') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[640ccada-e8b7-4b5b-8a36-a105ae342def]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdaa5a7d4-ef, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdaa5a7d4-ef, col_values=(('external_ids', {'iface-id': 'daa5a7d4-efaf-41c4-8cd2-1a26326f9257', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:da:73', 'vm-uuid': '8c896761-df6a-4f4a-87dd-c5ea30641a89'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:39 user nova-compute[70243]: INFO os_vif [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:da:73,bridge_name='br-int',has_traffic_filtering=True,id=daa5a7d4-efaf-41c4-8cd2-1a26326f9257,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa5a7d4-ef')
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[de19dadd-5e26-48ec-b4fa-9488a4f4e78b]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:38:39 user nova-compute[70243]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 (non-flash)
Jul 24 16:38:39 user nova-compute[70243]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:38:39 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:38:39 user nova-compute[70243]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 (non-flash)
Jul 24 16:38:39 user nova-compute[70243]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:38:39 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc4e39a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7'): ({'sdc'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Removing single pathed devices sdc {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73b4f58-9171-487d-83b9-889f83c0f20c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] No VIF found with MAC fa:16:3e:a5:da:73, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.031s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61f4c20-e680-42ea-8584-17b5ffac0231]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Flushing IO for device /dev/sdc {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7dadf0a-dbd1-4666-bf31-1f5117928118]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[619f52e4-0d8c-4a22-9666-d1eb4a10f929]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] SCSI volumes sdc have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5473410e-e7ad-4ad1-8e93-6f729041a8fb]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbb4ef5-1acc-4798-a296-34142f4ed25d]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7, portal: 172.16.0.220,3260]
Jul 24 16:38:39 user nova-compute[70243]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7, portal: 172.16.0.220,3260] successful.
Jul 24 16:38:39 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec04f208-76e6-4bec-bd53-ce51816f32d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e902cf7e-f0ad-4f9a-bc68-0d9066af92b4]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] <== disconnect_volume: return (1342ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:38:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:38:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:40 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216705.1251817, beab81a6-209a-4d8d-8980-365ff2dc3cff => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:38:40 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] VM Stopped (Lifecycle Event)
Jul 24 16:38:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-5d480895-ed2c-4eaf-9413-605014cca544 None None] [instance: beab81a6-209a-4d8d-8980-365ff2dc3cff] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:38:40 user nova-compute[70243]: DEBUG nova.objects.instance [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lazy-loading 'flavor' on Instance uuid 75b26864-1539-4106-b741-3b3f5c7e898a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:38:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-5862931d-fb47-421c-9784-b41490362698 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.810s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:40 user nova-compute[70243]: DEBUG nova.compute.manager [req-c8675246-416b-4e85-a6b5-46279722ad8a req-8c27cf37-7519-40f7-a731-005cac11493a service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received event network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:38:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c8675246-416b-4e85-a6b5-46279722ad8a req-8c27cf37-7519-40f7-a731-005cac11493a service nova] Acquiring lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c8675246-416b-4e85-a6b5-46279722ad8a req-8c27cf37-7519-40f7-a731-005cac11493a service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c8675246-416b-4e85-a6b5-46279722ad8a req-8c27cf37-7519-40f7-a731-005cac11493a service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:40 user nova-compute[70243]: DEBUG nova.compute.manager [req-c8675246-416b-4e85-a6b5-46279722ad8a req-8c27cf37-7519-40f7-a731-005cac11493a service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] No waiting events found dispatching network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:38:40 user nova-compute[70243]: WARNING nova.compute.manager [req-c8675246-416b-4e85-a6b5-46279722ad8a req-8c27cf37-7519-40f7-a731-005cac11493a service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received unexpected event network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 for instance with vm_state building and task_state spawning.
Jul 24 16:38:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:42 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216722.6111953, 8c896761-df6a-4f4a-87dd-c5ea30641a89 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:38:42 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] VM Resumed (Lifecycle Event)
Jul 24 16:38:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:38:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:38:42 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Instance spawned successfully.
Jul 24 16:38:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:38:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:38:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:38:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:38:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:38:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:38:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:38:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:38:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:38:42 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:38:42 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216722.6125584, 8c896761-df6a-4f4a-87dd-c5ea30641a89 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:38:42 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] VM Started (Lifecycle Event)
Jul 24 16:38:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:38:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:38:42 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:38:42 user nova-compute[70243]: INFO nova.compute.manager [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Took 4.95 seconds to spawn the instance on the hypervisor.
Jul 24 16:38:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:38:42 user nova-compute[70243]: INFO nova.compute.manager [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Took 18.58 seconds to build instance.
Jul 24 16:38:42 user nova-compute[70243]: DEBUG nova.compute.manager [req-2ddc08b1-f6c5-48f8-874f-6df43ececb66 req-d10b460d-e19c-4550-9d6d-970b6c5402ce service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received event network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:38:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2ddc08b1-f6c5-48f8-874f-6df43ececb66 req-d10b460d-e19c-4550-9d6d-970b6c5402ce service nova] Acquiring lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:38:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2ddc08b1-f6c5-48f8-874f-6df43ececb66 req-d10b460d-e19c-4550-9d6d-970b6c5402ce service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:38:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2ddc08b1-f6c5-48f8-874f-6df43ececb66 req-d10b460d-e19c-4550-9d6d-970b6c5402ce service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:42 user nova-compute[70243]: DEBUG nova.compute.manager [req-2ddc08b1-f6c5-48f8-874f-6df43ececb66 req-d10b460d-e19c-4550-9d6d-970b6c5402ce service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] No waiting events found dispatching network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:38:42 user nova-compute[70243]: WARNING nova.compute.manager [req-2ddc08b1-f6c5-48f8-874f-6df43ececb66 req-d10b460d-e19c-4550-9d6d-970b6c5402ce service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received unexpected event network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 for instance with vm_state active and task_state None.
Jul 24 16:38:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-9ae4a73b-69b6-469a-b7c7-3b013dc41a17 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.699s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:38:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:52 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:38:53 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:38:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:54 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:38:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:55 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:38:55 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:38:57 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:38:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:38:59 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:38:59 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:39:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:39:00 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:39:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:39:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-6f2258de-6b31-48af-81df-37b64da4ca99" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:39:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-6f2258de-6b31-48af-81df-37b64da4ca99" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:39:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:39:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Updating instance_info_cache with network_info: [{"id": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "address": "fa:16:3e:d4:bf:cd", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a2f7cb-1b", "ovs_interfaceid": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:39:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-6f2258de-6b31-48af-81df-37b64da4ca99" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:39:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:39:00 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:39:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:39:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:39:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:39:00 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:39:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:01 user nova-compute[70243]: DEBUG nova.compute.manager [req-4f594aad-facd-4409-add8-d13c5d77ba57 req-c5909a79-6f13-4deb-8779-7c8b0a114b5d service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Received event network-changed-1e316ee9-0ea5-491c-b36b-742446e40042 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:39:01 user nova-compute[70243]: DEBUG nova.compute.manager [req-4f594aad-facd-4409-add8-d13c5d77ba57 req-c5909a79-6f13-4deb-8779-7c8b0a114b5d service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Refreshing instance network info cache due to event network-changed-1e316ee9-0ea5-491c-b36b-742446e40042. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:39:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4f594aad-facd-4409-add8-d13c5d77ba57 req-c5909a79-6f13-4deb-8779-7c8b0a114b5d service nova] Acquiring lock "refresh_cache-00fec25c-8982-4a40-80ae-11d0936e10a0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:39:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4f594aad-facd-4409-add8-d13c5d77ba57 req-c5909a79-6f13-4deb-8779-7c8b0a114b5d service nova] Acquired lock "refresh_cache-00fec25c-8982-4a40-80ae-11d0936e10a0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:39:01 user nova-compute[70243]: DEBUG nova.network.neutron [req-4f594aad-facd-4409-add8-d13c5d77ba57 req-c5909a79-6f13-4deb-8779-7c8b0a114b5d service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Refreshing network info cache for port 1e316ee9-0ea5-491c-b36b-742446e40042 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:39:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:02 user nova-compute[70243]: DEBUG nova.network.neutron [req-4f594aad-facd-4409-add8-d13c5d77ba57 req-c5909a79-6f13-4deb-8779-7c8b0a114b5d service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Updated VIF entry in instance network info cache for port 1e316ee9-0ea5-491c-b36b-742446e40042. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:39:02 user nova-compute[70243]: DEBUG nova.network.neutron [req-4f594aad-facd-4409-add8-d13c5d77ba57 req-c5909a79-6f13-4deb-8779-7c8b0a114b5d service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Updating instance_info_cache with network_info: [{"id": "1e316ee9-0ea5-491c-b36b-742446e40042", "address": "fa:16:3e:46:27:41", "network": {"id": "fc56dff4-5f20-428e-97eb-4284f448d179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-56253948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8d2e94319a14caa8ac0c27c6f242648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e316ee9-0e", "ovs_interfaceid": "1e316ee9-0ea5-491c-b36b-742446e40042", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:39:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4f594aad-facd-4409-add8-d13c5d77ba57 req-c5909a79-6f13-4deb-8779-7c8b0a114b5d service nova] Releasing lock "refresh_cache-00fec25c-8982-4a40-80ae-11d0936e10a0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:39:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:39:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:39:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:03 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:39:03 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:39:03 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=7873MB free_disk=24.15090560913086GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:39:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:39:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:39:03 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 50fecb3a-8f06-4822-8c84-76df51acfe50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:39:03 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6f2258de-6b31-48af-81df-37b64da4ca99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:39:03 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 0cceb071-c478-4914-8243-77c3efbdb5d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:39:03 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 75b26864-1539-4106-b741-3b3f5c7e898a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:39:03 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 100c6ba5-de96-4c2a-ae0c-9d3a9199948c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:39:03 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 00fec25c-8982-4a40-80ae-11d0936e10a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:39:03 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8c896761-df6a-4f4a-87dd-c5ea30641a89 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:39:03 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance b77a2e65-7abb-42ee-ae10-f8df46b93078 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:39:03 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:39:03 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:39:04 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:39:04 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:39:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:39:04 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:39:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:39:04 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:39:04 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:39:04 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70243) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 16:39:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Acquiring lock "00fec25c-8982-4a40-80ae-11d0936e10a0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:39:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:39:04 user nova-compute[70243]: DEBUG nova.objects.instance [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lazy-loading 'flavor' on Instance uuid 00fec25c-8982-4a40-80ae-11d0936e10a0 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:39:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:39:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Acquiring lock "00fec25c-8982-4a40-80ae-11d0936e10a0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:39:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:39:04 user nova-compute[70243]: INFO nova.compute.manager [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Attaching volume b019a205-f8a1-4eff-b51e-923ef2838817 to /dev/vdb
Jul 24 16:39:04 user nova-compute[70243]: DEBUG os_brick.utils [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:39:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:04 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e240184c-3bce-4716-aba6-c1df00b7574e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:05 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3545d3f1-ed6f-4680-8f34-9ef70981290f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:05 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05e2f87-a93d-4a18-80f9-9e7d450b0a25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:05 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73f07c7-19ef-4fba-a5c6-c8bb31139f21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:39:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:39:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:39:05 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:39:05 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4533a7b-a9d5-4b4a-a995-f3a265d72d20]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:39:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:39:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:39:05 user nova-compute[70243]: DEBUG os_brick.utils [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:39:05 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Updating existing volume attachment record: 82d30dd8-8a03-46d7-878b-13be1e0ca9f7 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:39:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:39:05 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:39:05 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Cleaning up deleted instances {{(pid=70243) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 16:39:05 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] There are 0 instances to clean {{(pid=70243) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 16:39:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:39:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SjBkLJON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:39:11 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:39:11 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:39:11 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b66c6e-d415-4581-acba-d0702fc136fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:39:11 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[45759c2b-2339-4f73-b8a4-b388a4801dbb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817] added
Jul 24 16:39:11 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2211da66-fa76-4bee-8571-f19e3317bf92]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.155s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b182a61-8b7c-4efa-8a43-1793bae5f803]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SjBkLJON {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SjBkLJON" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2595823-0830-4f99-bfc5-4a96a43e59cc]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SjBkLJON'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e77b550-5787-4779-9d83-c130a7e84115]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae62a7c0-e739-4268-a014-8e3b48d31a62]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:39:11 user nova-compute[70243]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:39:11 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:39:11 user nova-compute[70243]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:39:11 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[89687675-420e-4d41-837d-8be2684b15e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817, portal: 172.16.0.220,3260]
Jul 24 16:39:11 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817, portal: 172.16.0.220,3260] successful.
Jul 24 16:39:11 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b972ec7-76b2-4fd4-bbf4-0c28de232e46]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbae235c-ac94-4f23-9ea0-72d55a40f01a]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:39:11 user nova-compute[70243]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:39:11 user nova-compute[70243]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)
Jul 24 16:39:11 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:39:11 user nova-compute[70243]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:39:11 user nova-compute[70243]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)
Jul 24 16:39:11 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cb86f9-4b4a-4105-853c-0dd8724c5653]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:39:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SjBkLJON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:39:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:39:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '26237666433336661', 'path': '/dev/sdc'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:39:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237666433336661', 'path': '/dev/sdc'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:39:12 user nova-compute[70243]: DEBUG nova.objects.instance [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lazy-loading 'flavor' on Instance uuid 00fec25c-8982-4a40-80ae-11d0936e10a0 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:39:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:39:12 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:39:12 user nova-compute[70243]:   <source dev="/dev/sdc"/>
Jul 24 16:39:12 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:39:12 user nova-compute[70243]:   <serial>b019a205-f8a1-4eff-b51e-923ef2838817</serial>
Jul 24 16:39:12 user nova-compute[70243]: </disk>
Jul 24 16:39:12 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:39:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:39:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:39:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] No VIF found with MAC fa:16:3e:46:27:41, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:39:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e4450b4e-660a-4357-9c2d-0b63623c3d13 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.375s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:39:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Acquiring lock "00fec25c-8982-4a40-80ae-11d0936e10a0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG nova.objects.instance [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lazy-loading 'flavor' on Instance uuid 00fec25c-8982-4a40-80ae-11d0936e10a0 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Acquiring lock "00fec25c-8982-4a40-80ae-11d0936e10a0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:39:19 user nova-compute[70243]: INFO nova.compute.manager [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Attaching volume a0615c6f-7da3-457d-8db9-b906c17d221e to /dev/vdc
Jul 24 16:39:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG os_brick.utils [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e63496-1611-4f25-994f-8087a14f7a21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b3ae92-3950-4199-83cf-ccd70d696e97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab10c239-c201-41ef-aa88-1de55c7db418]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b914f49-a97b-4019-a142-c6c2144ca159]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:39:19 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:39:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8b7134-9d66-4fc9-95c0-d087e02d5c5c]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG os_brick.utils [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:39:19 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Updating existing volume attachment record: fd7b1778-e5ef-43b1-9ac6-e7280d4bc8aa {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:39:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:39:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:39:25 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:39:25 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GEBujsLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:39:25 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:39:25 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:39:25 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:39:25 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:39:25 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:39:25 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:39:25 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:39:25 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:25 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:25 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6fa102-e3c5-4a33-85c2-6cf551dd37ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:25 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:39:25 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:25 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:25 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:25 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb993fbc-3e8e-4c1c-9be8-7d095249311a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:25 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e] added
Jul 24 16:39:25 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:25 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a13e4c-fe14-4f68-ba67-c24e304cf1da]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c734379f-e318-4e2f-867f-639307d7d0eb]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GEBujsLi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GEBujsLi" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bd3e14-4a66-48eb-9e06-ed40af3ac3b4]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GEBujsLi'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a872a60-5df2-4514-ac12-36e38f9d3384]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac731324-4622-42db-85a7-426ebc3599f4]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:39:26 user nova-compute[70243]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:39:26 user nova-compute[70243]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)
Jul 24 16:39:26 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:39:26 user nova-compute[70243]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:39:26 user nova-compute[70243]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)
Jul 24 16:39:26 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aeadebe-798b-4586-b41e-85f39e99a398]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e, portal: 172.16.0.220,3260]
Jul 24 16:39:26 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e, portal: 172.16.0.220,3260] successful.
Jul 24 16:39:26 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ccc80f-6001-4bab-aff9-b10eb87ffc10]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[39577153-4300-43ed-8dbf-f4542ccfe45d]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:39:26 user nova-compute[70243]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:39:26 user nova-compute[70243]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)
Jul 24 16:39:26 user nova-compute[70243]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e (non-flash)
Jul 24 16:39:26 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:39:26 user nova-compute[70243]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:39:26 user nova-compute[70243]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)
Jul 24 16:39:26 user nova-compute[70243]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e (non-flash)
Jul 24 16:39:26 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b47a12c-650e-4569-b239-8223a9b62854]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:26 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: None {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:39:27 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:39:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GEBujsLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:39:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:39:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26464386233333035', 'path': '/dev/sde'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:39:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464386233333035', 'path': '/dev/sde'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:39:27 user nova-compute[70243]: DEBUG nova.objects.instance [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lazy-loading 'flavor' on Instance uuid 00fec25c-8982-4a40-80ae-11d0936e10a0 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:39:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:39:27 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:39:27 user nova-compute[70243]:   <source dev="/dev/sde"/>
Jul 24 16:39:27 user nova-compute[70243]:   <target dev="vdc" bus="virtio"/>
Jul 24 16:39:27 user nova-compute[70243]:   <serial>a0615c6f-7da3-457d-8db9-b906c17d221e</serial>
Jul 24 16:39:27 user nova-compute[70243]: </disk>
Jul 24 16:39:27 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:39:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:39:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:39:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] No BDM found with device name vdc, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:39:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] No VIF found with MAC fa:16:3e:46:27:41, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:39:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fe0fc393-3d4a-4abd-976f-bf7c27d844a2 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.675s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Acquiring lock "00fec25c-8982-4a40-80ae-11d0936e10a0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:39:29 user nova-compute[70243]: INFO nova.compute.manager [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Detaching volume a0615c6f-7da3-457d-8db9-b906c17d221e
Jul 24 16:39:29 user nova-compute[70243]: INFO nova.virt.block_device [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Attempting to driver detach volume a0615c6f-7da3-457d-8db9-b906c17d221e from mountpoint /dev/vdc
Jul 24 16:39:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Attempting to detach device vdc from instance 00fec25c-8982-4a40-80ae-11d0936e10a0 from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:39:29 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:39:29 user nova-compute[70243]:   <source dev="/dev/sde"/>
Jul 24 16:39:29 user nova-compute[70243]:   <target dev="vdc" bus="virtio"/>
Jul 24 16:39:29 user nova-compute[70243]:   <serial>a0615c6f-7da3-457d-8db9-b906c17d221e</serial>
Jul 24 16:39:29 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 24 16:39:29 user nova-compute[70243]: </disk>
Jul 24 16:39:29 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:39:29 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Successfully detached device vdc from instance 00fec25c-8982-4a40-80ae-11d0936e10a0 from the persistent domain config.
Jul 24 16:39:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 00fec25c-8982-4a40-80ae-11d0936e10a0 from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:39:29 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:39:29 user nova-compute[70243]:   <source dev="/dev/sde"/>
Jul 24 16:39:29 user nova-compute[70243]:   <target dev="vdc" bus="virtio"/>
Jul 24 16:39:29 user nova-compute[70243]:   <serial>a0615c6f-7da3-457d-8db9-b906c17d221e</serial>
Jul 24 16:39:29 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 24 16:39:29 user nova-compute[70243]: </disk>
Jul 24 16:39:29 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690216769.8455021, 00fec25c-8982-4a40-80ae-11d0936e10a0 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 00fec25c-8982-4a40-80ae-11d0936e10a0 {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:39:29 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Successfully detached device vdc from instance 00fec25c-8982-4a40-80ae-11d0936e10a0 from the live domain config.
Jul 24 16:39:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GEBujsLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:39:29 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:39:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45d1912-cddf-40ab-9ad3-e0478882d9df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:39:29 user nova-compute[70243]: No targets found.
Jul 24 16:39:29 user nova-compute[70243]: iSNS:
Jul 24 16:39:29 user nova-compute[70243]: No targets found.
Jul 24 16:39:29 user nova-compute[70243]: STATIC:
Jul 24 16:39:29 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817
Jul 24 16:39:29 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:39:29 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:39:29 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3
Jul 24 16:39:29 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:39:29 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:39:29 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e
Jul 24 16:39:29 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:39:29 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:39:29 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17
Jul 24 16:39:29 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:39:29 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:39:29 user nova-compute[70243]: FIRMWARE:
Jul 24 16:39:29 user nova-compute[70243]: No targets found.
Jul 24 16:39:29 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:39:29 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:39:29 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a08541-4fe9-4cd0-8976-f2e01960b204]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[edae9409-1ad1-4edd-b50d-997af0c21f61]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:39:29 user nova-compute[70243]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:39:29 user nova-compute[70243]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)
Jul 24 16:39:29 user nova-compute[70243]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e (non-flash)
Jul 24 16:39:29 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:39:29 user nova-compute[70243]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:39:29 user nova-compute[70243]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)
Jul 24 16:39:29 user nova-compute[70243]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e (non-flash)
Jul 24 16:39:29 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc4e1ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e'): ({'sde'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Removing single pathed devices sde {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcea7f4-945f-4c76-bd6d-d2b401cc1c14]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63173c1-ae94-4b53-8682-06ddec5bc370]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Flushing IO for device /dev/sde {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:39:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdbc063-1970-4f9a-aa6e-1fe2b0f38323]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e24f202-788f-4efb-ab93-eefcc4ea809c]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] SCSI volumes sde have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc4e3df-524c-42e4-a9db-3d15bc8c8e40]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[894d10c5-f8fb-4c02-9e5c-5f2bd5ecb894]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e, portal: 172.16.0.220,3260]
Jul 24 16:39:30 user nova-compute[70243]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e, portal: 172.16.0.220,3260] successful.
Jul 24 16:39:30 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0615c6f-7da3-457d-8db9-b906c17d221e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4899b1e1-77e6-481c-81f6-0413248bd7e4]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] <== disconnect_volume: return (337ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG nova.objects.instance [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lazy-loading 'flavor' on Instance uuid 00fec25c-8982-4a40-80ae-11d0936e10a0 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:39:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-31580dae-aebd-4a8c-bf32-cce155c0f2ef tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.668s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:39:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:39:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "75b26864-1539-4106-b741-3b3f5c7e898a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:39:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:39:32 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lazy-loading 'flavor' on Instance uuid 75b26864-1539-4106-b741-3b3f5c7e898a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:39:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:39:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "75b26864-1539-4106-b741-3b3f5c7e898a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:39:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:39:32 user nova-compute[70243]: INFO nova.compute.manager [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Attaching volume b89e9166-af88-42f5-9ee8-d501f4027cbf to /dev/vdb
Jul 24 16:39:32 user nova-compute[70243]: DEBUG os_brick.utils [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:39:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:32 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e955a6-dfef-49c3-b89a-3fced7270270]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1caffb1-a2b3-4a11-b153-b4809e2f6f9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8d198b-a617-45e9-b3f4-bbde4409dced]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bf2a7b-6eb6-46fa-aa0e-63adc474371d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:39:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:39:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:33 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:39:33 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:39:33 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[30944168-27e5-4962-87eb-ebc3fd8660a4]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:39:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:39:33 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:39:33 user nova-compute[70243]: DEBUG os_brick.utils [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:39:33 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Updating existing volume attachment record: 0d273ae2-ab87-49d0-9efb-143d41c97fa0 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:39:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:39:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:39:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUDdAKXp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:39:39 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:39:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:39:39 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:39:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:39:39 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdf7d79-c74e-416c-8469-5cf2adde383d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:39:39 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d1b874-8706-4bd7-8c4d-4864d4174117]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf] added
Jul 24 16:39:39 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7bf4fc-beae-4f26-86e3-945719c91b86]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[42794ed7-f0ea-431d-8df0-8358990c7621]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUDdAKXp {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUDdAKXp" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d8f6c0-f737-4bd7-89d7-b6b989661781]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cUDdAKXp'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1454297-d664-44b7-8196-cf4fb9736e3f]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18214bf-91da-415b-b4ce-23199b28b5c0]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:39:39 user nova-compute[70243]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:39:39 user nova-compute[70243]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)
Jul 24 16:39:39 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:39:39 user nova-compute[70243]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:39:39 user nova-compute[70243]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)
Jul 24 16:39:39 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[454f39a6-3192-4dd3-b8ea-d510ffad5f39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf, portal: 172.16.0.220,3260]
Jul 24 16:39:39 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf, portal: 172.16.0.220,3260] successful.
Jul 24 16:39:39 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[48173df6-a29e-452d-ae32-563471c59f6c]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb86dd80-4040-4a3e-bb12-ea3d203674a7]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:39:39 user nova-compute[70243]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:39:39 user nova-compute[70243]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)
Jul 24 16:39:39 user nova-compute[70243]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf (non-flash)
Jul 24 16:39:39 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:39:39 user nova-compute[70243]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:39:39 user nova-compute[70243]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)
Jul 24 16:39:39 user nova-compute[70243]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf (non-flash)
Jul 24 16:39:39 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0686e011-ae54-4959-8be5-dba9207c4486]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:39 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: None {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:39:40 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:39:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUDdAKXp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:39:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:39:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23638623735383132', 'path': '/dev/sde'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:39:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638623735383132', 'path': '/dev/sde'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:39:40 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lazy-loading 'flavor' on Instance uuid 75b26864-1539-4106-b741-3b3f5c7e898a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:39:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:39:40 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:39:40 user nova-compute[70243]:   <source dev="/dev/sde"/>
Jul 24 16:39:40 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:39:40 user nova-compute[70243]:   <serial>b89e9166-af88-42f5-9ee8-d501f4027cbf</serial>
Jul 24 16:39:40 user nova-compute[70243]: </disk>
Jul 24 16:39:40 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:39:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:39:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:39:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] No VIF found with MAC fa:16:3e:81:5b:1b, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:39:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c8a3ba6c-a1b6-4348-b328-9a72a229d9b0 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.575s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "75b26864-1539-4106-b741-3b3f5c7e898a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:39:44 user nova-compute[70243]: INFO nova.compute.manager [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Detaching volume b89e9166-af88-42f5-9ee8-d501f4027cbf
Jul 24 16:39:44 user nova-compute[70243]: INFO nova.virt.block_device [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Attempting to driver detach volume b89e9166-af88-42f5-9ee8-d501f4027cbf from mountpoint /dev/vdb
Jul 24 16:39:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Attempting to detach device vdb from instance 75b26864-1539-4106-b741-3b3f5c7e898a from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:39:44 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:39:44 user nova-compute[70243]:   <source dev="/dev/sde"/>
Jul 24 16:39:44 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:39:44 user nova-compute[70243]:   <serial>b89e9166-af88-42f5-9ee8-d501f4027cbf</serial>
Jul 24 16:39:44 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:39:44 user nova-compute[70243]: </disk>
Jul 24 16:39:44 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:39:44 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Successfully detached device vdb from instance 75b26864-1539-4106-b741-3b3f5c7e898a from the persistent domain config.
Jul 24 16:39:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 75b26864-1539-4106-b741-3b3f5c7e898a from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:39:44 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:39:44 user nova-compute[70243]:   <source dev="/dev/sde"/>
Jul 24 16:39:44 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:39:44 user nova-compute[70243]:   <serial>b89e9166-af88-42f5-9ee8-d501f4027cbf</serial>
Jul 24 16:39:44 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:39:44 user nova-compute[70243]: </disk>
Jul 24 16:39:44 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690216784.5243561, 75b26864-1539-4106-b741-3b3f5c7e898a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 75b26864-1539-4106-b741-3b3f5c7e898a {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:39:44 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Successfully detached device vdb from instance 75b26864-1539-4106-b741-3b3f5c7e898a from the live domain config.
Jul 24 16:39:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUDdAKXp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:39:44 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:39:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[739eaa18-5c3b-4ed1-affc-07b0c8777237]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:39:44 user nova-compute[70243]: No targets found.
Jul 24 16:39:44 user nova-compute[70243]: iSNS:
Jul 24 16:39:44 user nova-compute[70243]: No targets found.
Jul 24 16:39:44 user nova-compute[70243]: STATIC:
Jul 24 16:39:44 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817
Jul 24 16:39:44 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:39:44 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:39:44 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3
Jul 24 16:39:44 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:39:44 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:39:44 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17
Jul 24 16:39:44 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:39:44 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:39:44 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf
Jul 24 16:39:44 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:39:44 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:39:44 user nova-compute[70243]: FIRMWARE:
Jul 24 16:39:44 user nova-compute[70243]: No targets found.
Jul 24 16:39:44 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:39:44 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:39:44 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dac2482-0573-489b-82c7-82061d971e9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7983945c-a39f-49fc-9551-d2c821ef7cd7]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:39:44 user nova-compute[70243]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:39:44 user nova-compute[70243]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)
Jul 24 16:39:44 user nova-compute[70243]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf (non-flash)
Jul 24 16:39:44 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:39:44 user nova-compute[70243]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:39:44 user nova-compute[70243]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)
Jul 24 16:39:44 user nova-compute[70243]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf (non-flash)
Jul 24 16:39:44 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc4e3640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf'): ({'sde'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Removing single pathed devices sde {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d985390-c5f1-47ca-af3b-93dd216b5683]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c1d0df-a986-49e7-affb-79c37f9821b0]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Flushing IO for device /dev/sde {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf391cb0-ae60-4236-860b-8fff962e0928]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3286bbc7-c39a-4c2a-9ba5-1deee53df10a]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] SCSI volumes sde have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c16624a-8262-4ad8-853f-88ab24aeb0f6]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38296b5-346a-4bd2-af2b-3125db90ab8f]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf, portal: 172.16.0.220,3260]
Jul 24 16:39:44 user nova-compute[70243]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf, portal: 172.16.0.220,3260] successful.
Jul 24 16:39:44 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b89e9166-af88-42f5-9ee8-d501f4027cbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f360331-ae85-47a6-8b61-dd90f4cb3432]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] <== disconnect_volume: return (345ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:39:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:39:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:39:45 user nova-compute[70243]: DEBUG nova.objects.instance [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lazy-loading 'flavor' on Instance uuid 75b26864-1539-4106-b741-3b3f5c7e898a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:39:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3bc59e06-a962-49c3-a2c4-6dc6f7def989 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.665s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:39:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:39:52 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:39:53 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:39:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:39:56 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:39:57 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:39:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-86c26bfd-1c9e-49d0-aa11-7c7f4868072b req-aaf90db9-09d0-4d07-88a9-810536cefa2e service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received event network-changed-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:39:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-86c26bfd-1c9e-49d0-aa11-7c7f4868072b req-aaf90db9-09d0-4d07-88a9-810536cefa2e service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Refreshing instance network info cache due to event network-changed-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:39:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-86c26bfd-1c9e-49d0-aa11-7c7f4868072b req-aaf90db9-09d0-4d07-88a9-810536cefa2e service nova] Acquiring lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:39:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-86c26bfd-1c9e-49d0-aa11-7c7f4868072b req-aaf90db9-09d0-4d07-88a9-810536cefa2e service nova] Acquired lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:39:58 user nova-compute[70243]: DEBUG nova.network.neutron [req-86c26bfd-1c9e-49d0-aa11-7c7f4868072b req-aaf90db9-09d0-4d07-88a9-810536cefa2e service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Refreshing network info cache for port 31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "0cceb071-c478-4914-8243-77c3efbdb5d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:39:59 user nova-compute[70243]: INFO nova.compute.manager [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Detaching volume 79b94848-a2c7-4833-9913-04747fd4af17
Jul 24 16:39:59 user nova-compute[70243]: INFO nova.virt.block_device [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Attempting to driver detach volume 79b94848-a2c7-4833-9913-04747fd4af17 from mountpoint /dev/vdb
Jul 24 16:39:59 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Attempting to detach device vdb from instance 0cceb071-c478-4914-8243-77c3efbdb5d3 from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:39:59 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:39:59 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:39:59 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:39:59 user nova-compute[70243]:   <serial>79b94848-a2c7-4833-9913-04747fd4af17</serial>
Jul 24 16:39:59 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:39:59 user nova-compute[70243]: </disk>
Jul 24 16:39:59 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:39:59 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Successfully detached device vdb from instance 0cceb071-c478-4914-8243-77c3efbdb5d3 from the persistent domain config.
Jul 24 16:39:59 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0cceb071-c478-4914-8243-77c3efbdb5d3 from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:39:59 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:39:59 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:39:59 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:39:59 user nova-compute[70243]:   <serial>79b94848-a2c7-4833-9913-04747fd4af17</serial>
Jul 24 16:39:59 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:39:59 user nova-compute[70243]: </disk>
Jul 24 16:39:59 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG nova.network.neutron [req-86c26bfd-1c9e-49d0-aa11-7c7f4868072b req-aaf90db9-09d0-4d07-88a9-810536cefa2e service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Updated VIF entry in instance network info cache for port 31e9e4c6-7d4c-4077-a725-02e3b9f6f61a. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG nova.network.neutron [req-86c26bfd-1c9e-49d0-aa11-7c7f4868072b req-aaf90db9-09d0-4d07-88a9-810536cefa2e service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Updating instance_info_cache with network_info: [{"id": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "address": "fa:16:3e:46:16:b8", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e9e4c6-7d", "ovs_interfaceid": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-86c26bfd-1c9e-49d0-aa11-7c7f4868072b req-aaf90db9-09d0-4d07-88a9-810536cefa2e service nova] Releasing lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690216799.8644722, 0cceb071-c478-4914-8243-77c3efbdb5d3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0cceb071-c478-4914-8243-77c3efbdb5d3 {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:39:59 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Successfully detached device vdb from instance 0cceb071-c478-4914-8243-77c3efbdb5d3 from the live domain config.
Jul 24 16:39:59 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XlvVbjgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:39:59 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:39:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5e859a-1e6c-4ae2-a2fe-fb9e3e30e563]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:39:59 user nova-compute[70243]: No targets found.
Jul 24 16:39:59 user nova-compute[70243]: iSNS:
Jul 24 16:39:59 user nova-compute[70243]: No targets found.
Jul 24 16:39:59 user nova-compute[70243]: STATIC:
Jul 24 16:39:59 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817
Jul 24 16:39:59 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:39:59 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:39:59 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3
Jul 24 16:39:59 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:39:59 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:39:59 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17
Jul 24 16:39:59 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:39:59 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:39:59 user nova-compute[70243]: FIRMWARE:
Jul 24 16:39:59 user nova-compute[70243]: No targets found.
Jul 24 16:39:59 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:39:59 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:39:59 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4d5381-c2df-4b40-8f9c-056ca8c1610a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35c342a-aa4f-4bf8-8bf7-c054b0607c0b]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:39:59 user nova-compute[70243]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:39:59 user nova-compute[70243]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)
Jul 24 16:39:59 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 (non-flash)
Jul 24 16:39:59 user nova-compute[70243]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:39:59 user nova-compute[70243]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)
Jul 24 16:39:59 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91f8917370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17'): ({'sdb'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Removing single pathed devices sdb {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d07264-c6f4-4082-b2a8-ecc0d3d054ba]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:39:59 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e656f83e-0157-489e-a1d6-dcc65ce02893]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Flushing IO for device /dev/sdb {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[03468e32-84d0-4093-a47f-2307975de050]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdbcbc3-8d15-43e2-808e-da54ab925c7a]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1165c6-5576-463f-9c59-558007d002d8]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[92edd671-3269-40d9-a0ff-6c86edecbdd4]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17, portal: 172.16.0.220,3260]
Jul 24 16:40:00 user nova-compute[70243]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17, portal: 172.16.0.220,3260] successful.
Jul 24 16:40:00 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b94848-a2c7-4833-9913-04747fd4af17 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e9dde6-dbaa-4933-9eb3-035d61da0f59]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] <== disconnect_volume: return (319ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Updating instance_info_cache with network_info: [{"id": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "address": "fa:16:3e:46:16:b8", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e9e4c6-7d", "ovs_interfaceid": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:40:00 user nova-compute[70243]: DEBUG nova.objects.instance [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'flavor' on Instance uuid 0cceb071-c478-4914-8243-77c3efbdb5d3 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:40:01 user nova-compute[70243]: DEBUG nova.compute.manager [req-42e15aef-8662-4649-9417-893ff6cfc275 req-8bebf496-b8ef-4d39-853e-a98f7ba3cf91 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received event network-changed-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:40:01 user nova-compute[70243]: DEBUG nova.compute.manager [req-42e15aef-8662-4649-9417-893ff6cfc275 req-8bebf496-b8ef-4d39-853e-a98f7ba3cf91 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Refreshing instance network info cache due to event network-changed-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:40:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-42e15aef-8662-4649-9417-893ff6cfc275 req-8bebf496-b8ef-4d39-853e-a98f7ba3cf91 service nova] Acquiring lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:40:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-42e15aef-8662-4649-9417-893ff6cfc275 req-8bebf496-b8ef-4d39-853e-a98f7ba3cf91 service nova] Acquired lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:40:01 user nova-compute[70243]: DEBUG nova.network.neutron [req-42e15aef-8662-4649-9417-893ff6cfc275 req-8bebf496-b8ef-4d39-853e-a98f7ba3cf91 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Refreshing network info cache for port 31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:40:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-40e5c1a7-ca02-4334-907f-bbcd6dd5a264 tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.673s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:40:01 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:40:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:40:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:40:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:40:01 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:40:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:01 user nova-compute[70243]: DEBUG nova.network.neutron [req-42e15aef-8662-4649-9417-893ff6cfc275 req-8bebf496-b8ef-4d39-853e-a98f7ba3cf91 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Updated VIF entry in instance network info cache for port 31e9e4c6-7d4c-4077-a725-02e3b9f6f61a. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:40:01 user nova-compute[70243]: DEBUG nova.network.neutron [req-42e15aef-8662-4649-9417-893ff6cfc275 req-8bebf496-b8ef-4d39-853e-a98f7ba3cf91 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Updating instance_info_cache with network_info: [{"id": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "address": "fa:16:3e:46:16:b8", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e9e4c6-7d", "ovs_interfaceid": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:40:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-42e15aef-8662-4649-9417-893ff6cfc275 req-8bebf496-b8ef-4d39-853e-a98f7ba3cf91 service nova] Releasing lock "refresh_cache-0cceb071-c478-4914-8243-77c3efbdb5d3" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:40:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:40:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:02 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:40:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:04 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:40:04 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:40:04 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=7921MB free_disk=24.139263153076172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:40:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:40:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:40:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:04 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 50fecb3a-8f06-4822-8c84-76df51acfe50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:40:04 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6f2258de-6b31-48af-81df-37b64da4ca99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:40:04 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 0cceb071-c478-4914-8243-77c3efbdb5d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:40:04 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 75b26864-1539-4106-b741-3b3f5c7e898a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:40:04 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 100c6ba5-de96-4c2a-ae0c-9d3a9199948c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:40:04 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 00fec25c-8982-4a40-80ae-11d0936e10a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:40:04 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8c896761-df6a-4f4a-87dd-c5ea30641a89 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:40:04 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance b77a2e65-7abb-42ee-ae10-f8df46b93078 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:40:04 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:40:04 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:40:04 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing inventories for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 16:40:04 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Updating ProviderTree inventory for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 16:40:04 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Updating inventory in ProviderTree for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 16:40:04 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing aggregate associations for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0, aggregates: None {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 16:40:04 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing trait associations for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0, traits: HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 16:40:04 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:40:05 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:40:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:40:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.752s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:40:06 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:40:06 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:40:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:40:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:40:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:40:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:40:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:40:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:15 user nova-compute[70243]: INFO nova.compute.manager [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Rescuing
Jul 24 16:40:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "refresh_cache-8c896761-df6a-4f4a-87dd-c5ea30641a89" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:40:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquired lock "refresh_cache-8c896761-df6a-4f4a-87dd-c5ea30641a89" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:40:15 user nova-compute[70243]: DEBUG nova.network.neutron [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:40:15 user nova-compute[70243]: DEBUG nova.network.neutron [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Updating instance_info_cache with network_info: [{"id": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "address": "fa:16:3e:a5:da:73", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa5a7d4-ef", "ovs_interfaceid": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:40:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Releasing lock "refresh_cache-8c896761-df6a-4f4a-87dd-c5ea30641a89" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:40:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:16 user nova-compute[70243]: DEBUG nova.compute.manager [req-b3858b32-1f23-4025-825f-794e344466e3 req-8d85edbc-28ad-4d84-a26f-9b58e38a4b82 service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received event network-vif-unplugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:40:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b3858b32-1f23-4025-825f-794e344466e3 req-8d85edbc-28ad-4d84-a26f-9b58e38a4b82 service nova] Acquiring lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:40:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b3858b32-1f23-4025-825f-794e344466e3 req-8d85edbc-28ad-4d84-a26f-9b58e38a4b82 service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:40:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b3858b32-1f23-4025-825f-794e344466e3 req-8d85edbc-28ad-4d84-a26f-9b58e38a4b82 service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:40:16 user nova-compute[70243]: DEBUG nova.compute.manager [req-b3858b32-1f23-4025-825f-794e344466e3 req-8d85edbc-28ad-4d84-a26f-9b58e38a4b82 service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] No waiting events found dispatching network-vif-unplugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:40:16 user nova-compute[70243]: WARNING nova.compute.manager [req-b3858b32-1f23-4025-825f-794e344466e3 req-8d85edbc-28ad-4d84-a26f-9b58e38a4b82 service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received unexpected event network-vif-unplugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 for instance with vm_state active and task_state rescuing.
Jul 24 16:40:16 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:16 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:16 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Instance destroyed successfully.
Jul 24 16:40:16 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Attempting a stable device rescue
Jul 24 16:40:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70243) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 24 16:40:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Instance directory exists: not creating {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 16:40:16 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Creating image(s)
Jul 24 16:40:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c896761-df6a-4f4a-87dd-c5ea30641a89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:40:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "/opt/stack/data/nova/instances/8c896761-df6a-4f4a-87dd-c5ea30641a89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:40:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "/opt/stack/data/nova/instances/8c896761-df6a-4f4a-87dd-c5ea30641a89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:40:16 user nova-compute[70243]: DEBUG nova.objects.instance [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8c896761-df6a-4f4a-87dd-c5ea30641a89 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:40:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "d1a1af388b3c9ef1d2fedea83e8b585b05e7d90a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:40:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "d1a1af388b3c9ef1d2fedea83e8b585b05e7d90a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:40:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a1af388b3c9ef1d2fedea83e8b585b05e7d90a.part --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:17 user nova-compute[70243]: DEBUG nova.compute.manager [req-b3951be1-cea4-4d27-8760-f7a8ba602236 req-ff6a628a-3c89-4c40-9fa0-5e82c4bb3a4d service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Received event network-changed-c5651f32-74b1-4cb2-82bc-d8a5e9049502 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:40:17 user nova-compute[70243]: DEBUG nova.compute.manager [req-b3951be1-cea4-4d27-8760-f7a8ba602236 req-ff6a628a-3c89-4c40-9fa0-5e82c4bb3a4d service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Refreshing instance network info cache due to event network-changed-c5651f32-74b1-4cb2-82bc-d8a5e9049502. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:40:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b3951be1-cea4-4d27-8760-f7a8ba602236 req-ff6a628a-3c89-4c40-9fa0-5e82c4bb3a4d service nova] Acquiring lock "refresh_cache-b77a2e65-7abb-42ee-ae10-f8df46b93078" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:40:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b3951be1-cea4-4d27-8760-f7a8ba602236 req-ff6a628a-3c89-4c40-9fa0-5e82c4bb3a4d service nova] Acquired lock "refresh_cache-b77a2e65-7abb-42ee-ae10-f8df46b93078" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:40:17 user nova-compute[70243]: DEBUG nova.network.neutron [req-b3951be1-cea4-4d27-8760-f7a8ba602236 req-ff6a628a-3c89-4c40-9fa0-5e82c4bb3a4d service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Refreshing network info cache for port c5651f32-74b1-4cb2-82bc-d8a5e9049502 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:40:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a1af388b3c9ef1d2fedea83e8b585b05e7d90a.part --force-share --output=json" returned: 0 in 0.161s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:17 user nova-compute[70243]: DEBUG nova.virt.images [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] 9d1da9e6-9b28-47b6-a038-7f19ee64be21 was qcow2, converting to raw {{(pid=70243) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 16:40:17 user nova-compute[70243]: DEBUG nova.privsep.utils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70243) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 16:40:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d1a1af388b3c9ef1d2fedea83e8b585b05e7d90a.part /opt/stack/data/nova/instances/_base/d1a1af388b3c9ef1d2fedea83e8b585b05e7d90a.converted {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.compute.manager [req-f8da7296-2064-4088-aa34-d6d665c57bc4 req-479bc2ad-06f9-42b8-b5e7-2cebb6c36609 service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received event network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f8da7296-2064-4088-aa34-d6d665c57bc4 req-479bc2ad-06f9-42b8-b5e7-2cebb6c36609 service nova] Acquiring lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f8da7296-2064-4088-aa34-d6d665c57bc4 req-479bc2ad-06f9-42b8-b5e7-2cebb6c36609 service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f8da7296-2064-4088-aa34-d6d665c57bc4 req-479bc2ad-06f9-42b8-b5e7-2cebb6c36609 service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.compute.manager [req-f8da7296-2064-4088-aa34-d6d665c57bc4 req-479bc2ad-06f9-42b8-b5e7-2cebb6c36609 service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] No waiting events found dispatching network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:40:18 user nova-compute[70243]: WARNING nova.compute.manager [req-f8da7296-2064-4088-aa34-d6d665c57bc4 req-479bc2ad-06f9-42b8-b5e7-2cebb6c36609 service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received unexpected event network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 for instance with vm_state active and task_state rescuing.
Jul 24 16:40:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d1a1af388b3c9ef1d2fedea83e8b585b05e7d90a.part /opt/stack/data/nova/instances/_base/d1a1af388b3c9ef1d2fedea83e8b585b05e7d90a.converted" returned: 0 in 0.505s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a1af388b3c9ef1d2fedea83e8b585b05e7d90a.converted --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.network.neutron [req-b3951be1-cea4-4d27-8760-f7a8ba602236 req-ff6a628a-3c89-4c40-9fa0-5e82c4bb3a4d service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Updated VIF entry in instance network info cache for port c5651f32-74b1-4cb2-82bc-d8a5e9049502. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.network.neutron [req-b3951be1-cea4-4d27-8760-f7a8ba602236 req-ff6a628a-3c89-4c40-9fa0-5e82c4bb3a4d service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Updating instance_info_cache with network_info: [{"id": "c5651f32-74b1-4cb2-82bc-d8a5e9049502", "address": "fa:16:3e:ba:5c:ac", "network": {"id": "69dc6b7b-bfde-4a33-b2ad-950c352fbaf6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-455133887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba424603ae5749a9aa59cb0360dc9d9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5651f32-74", "ovs_interfaceid": "c5651f32-74b1-4cb2-82bc-d8a5e9049502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a1af388b3c9ef1d2fedea83e8b585b05e7d90a.converted --force-share --output=json" returned: 0 in 0.277s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "d1a1af388b3c9ef1d2fedea83e8b585b05e7d90a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.070s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "d1a1af388b3c9ef1d2fedea83e8b585b05e7d90a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "d1a1af388b3c9ef1d2fedea83e8b585b05e7d90a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a1af388b3c9ef1d2fedea83e8b585b05e7d90a --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1a1af388b3c9ef1d2fedea83e8b585b05e7d90a --force-share --output=json" returned: 0 in 0.150s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1a1af388b3c9ef1d2fedea83e8b585b05e7d90a,backing_fmt=raw /opt/stack/data/nova/instances/8c896761-df6a-4f4a-87dd-c5ea30641a89/disk.rescue {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b3951be1-cea4-4d27-8760-f7a8ba602236 req-ff6a628a-3c89-4c40-9fa0-5e82c4bb3a4d service nova] Releasing lock "refresh_cache-b77a2e65-7abb-42ee-ae10-f8df46b93078" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1a1af388b3c9ef1d2fedea83e8b585b05e7d90a,backing_fmt=raw /opt/stack/data/nova/instances/8c896761-df6a-4f4a-87dd-c5ea30641a89/disk.rescue" returned: 0 in 0.084s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "d1a1af388b3c9ef1d2fedea83e8b585b05e7d90a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.objects.instance [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'migration_context' on Instance uuid 8c896761-df6a-4f4a-87dd-c5ea30641a89 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Start _get_guest_xml network_info=[{"id": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "address": "fa:16:3e:a5:da:73", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "vif_mac": "fa:16:3e:a5:da:73"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa5a7d4-ef", "ovs_interfaceid": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9d1da9e6-9b28-47b6-a038-7f19ee64be21', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaQUdlyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '8c896761-df6a-4f4a-87dd-c5ea30641a89', 'attached_at': '', 'detached_at': '', 'volume_id': '80abe3a6-777b-4600-ab3a-b4ce4e58edc3', 'serial': '80abe3a6-777b-4600-ab3a-b4ce4e58edc3'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '311fc649-3c2c-4f49-894c-2a945ec9629f', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.objects.instance [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'resources' on Instance uuid 8c896761-df6a-4f4a-87dd-c5ea30641a89 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.objects.instance [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'numa_topology' on Instance uuid 8c896761-df6a-4f4a-87dd-c5ea30641a89 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:40:18 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:40:18 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.objects.instance [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8c896761-df6a-4f4a-87dd-c5ea30641a89 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaQUdlyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:40:18 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:40:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:40:18 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:40:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:40:18 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:40:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b5d790-51ce-4634-a33c-40222b9c4124]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = xaQUdlyu\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 24 16:40:18 user nova-compute[70243]: node.name = iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3
Jul 24 16:40:18 user nova-compute[70243]: node.tpgt = -1
Jul 24 16:40:18 user nova-compute[70243]: node.startup = automatic
Jul 24 16:40:18 user nova-compute[70243]: node.leading_login = No
Jul 24 16:40:18 user nova-compute[70243]: iface.iscsi_ifacename = default
Jul 24 16:40:18 user nova-compute[70243]: iface.net_ifacename = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.ipaddress = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.prefix_len = 0
Jul 24 16:40:18 user nova-compute[70243]: iface.hwaddress = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.transport_name = tcp
Jul 24 16:40:18 user nova-compute[70243]: iface.initiatorname = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.state = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.vlan_id = 0
Jul 24 16:40:18 user nova-compute[70243]: iface.vlan_priority = 0
Jul 24 16:40:18 user nova-compute[70243]: iface.vlan_state = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.iface_num = 0
Jul 24 16:40:18 user nova-compute[70243]: iface.mtu = 0
Jul 24 16:40:18 user nova-compute[70243]: iface.port = 0
Jul 24 16:40:18 user nova-compute[70243]: iface.bootproto = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.subnet_mask = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.gateway = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.dhcp_alt_client_id_state = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.dhcp_alt_client_id = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.dhcp_dns = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.dhcp_learn_iqn = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.dhcp_req_vendor_id_state = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.dhcp_vendor_id_state = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.dhcp_vendor_id = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.dhcp_slp_da = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.fragmentation = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.gratuitous_arp = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.incoming_forwarding = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.tos_state = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.tos = 0
Jul 24 16:40:18 user nova-compute[70243]: iface.ttl = 0
Jul 24 16:40:18 user nova-compute[70243]: iface.delayed_ack = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.tcp_nagle = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.tcp_wsf_state = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.tcp_wsf = 0
Jul 24 16:40:18 user nova-compute[70243]: iface.tcp_timer_scale = 0
Jul 24 16:40:18 user nova-compute[70243]: iface.tcp_timestamp = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.redirect = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.def_task_mgmt_timeout = 0
Jul 24 16:40:18 user nova-compute[70243]: iface.header_digest = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.data_digest = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.immediate_data = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.initial_r2t = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.data_seq_inorder = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.data_pdu_inorder = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.erl = 0
Jul 24 16:40:18 user nova-compute[70243]: iface.max_receive_data_len = 0
Jul 24 16:40:18 user nova-compute[70243]: iface.first_burst_len = 0
Jul 24 16:40:18 user nova-compute[70243]: iface.max_outstanding_r2t = 0
Jul 24 16:40:18 user nova-compute[70243]: iface.max_burst_len = 0
Jul 24 16:40:18 user nova-compute[70243]: iface.chap_auth = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.bidi_chap = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.strict_login_compliance = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.discovery_auth = <empty>
Jul 24 16:40:18 user nova-compute[70243]: iface.discovery_logout = <empty>
Jul 24 16:40:18 user nova-compute[70243]: node.discovery_address = <empty>
Jul 24 16:40:18 user nova-compute[70243]: node.discovery_port = 0
Jul 24 16:40:18 user nova-compute[70243]: node.discovery_type = static
Jul 24 16:40:18 user nova-compute[70243]: node.session.initial_cmdsn = 0
Jul 24 16:40:18 user nova-compute[70243]: node.session.initial_login_retry_max = 8
Jul 24 16:40:18 user nova-compute[70243]: node.session.xmit_thread_priority = -20
Jul 24 16:40:18 user nova-compute[70243]: node.session.cmds_max = 128
Jul 24 16:40:18 user nova-compute[70243]: node.session.queue_depth = 32
Jul 24 16:40:18 user nova-compute[70243]: node.session.nr_sessions = 1
Jul 24 16:40:18 user nova-compute[70243]: node.session.auth.authmethod = CHAP
Jul 24 16:40:18 user nova-compute[70243]: node.session.auth.username = xaQUdlyu
Jul 24 16:40:18 user nova-compute[70243]: node.session.auth.password = ***
Jul 24 16:40:18 user nova-compute[70243]: node.session.auth.username_in = <empty>
Jul 24 16:40:18 user nova-compute[70243]: node.session.auth.password_in = <empty>
Jul 24 16:40:18 user nova-compute[70243]: node.session.auth.chap_algs = MD5
Jul 24 16:40:18 user nova-compute[70243]: node.session.timeo.replacement_timeout = 120
Jul 24 16:40:18 user nova-compute[70243]: node.session.err_timeo.abort_timeout = 15
Jul 24 16:40:18 user nova-compute[70243]: node.session.err_timeo.lu_reset_timeout = 30
Jul 24 16:40:18 user nova-compute[70243]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 24 16:40:18 user nova-compute[70243]: node.session.err_timeo.host_reset_timeout = 60
Jul 24 16:40:18 user nova-compute[70243]: node.session.iscsi.FastAbort = Yes
Jul 24 16:40:18 user nova-compute[70243]: node.session.iscsi.InitialR2T = No
Jul 24 16:40:18 user nova-compute[70243]: node.session.iscsi.ImmediateData = Yes
Jul 24 16:40:18 user nova-compute[70243]: node.session.iscsi.FirstBurstLength = 262144
Jul 24 16:40:18 user nova-compute[70243]: node.session.iscsi.MaxBurstLength = 16776192
Jul 24 16:40:18 user nova-compute[70243]: node.session.iscsi.DefaultTime2Retain = 0
Jul 24 16:40:18 user nova-compute[70243]: node.session.iscsi.DefaultTime2Wait = 2
Jul 24 16:40:18 user nova-compute[70243]: node.session.iscsi.MaxConnections = 1
Jul 24 16:40:18 user nova-compute[70243]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 24 16:40:18 user nova-compute[70243]: node.session.iscsi.ERL = 0
Jul 24 16:40:18 user nova-compute[70243]: node.session.scan = manual
Jul 24 16:40:18 user nova-compute[70243]: node.session.reopen_max = 0
Jul 24 16:40:18 user nova-compute[70243]: node.conn[0].address = 172.16.0.220
Jul 24 16:40:18 user nova-compute[70243]: node.conn[0].port = 3260
Jul 24 16:40:18 user nova-compute[70243]: node.conn[0].startup = manual
Jul 24 16:40:18 user nova-compute[70243]: node.conn[0].tcp.window_size = 524288
Jul 24 16:40:18 user nova-compute[70243]: node.conn[0].tcp.type_of_service = 0
Jul 24 16:40:18 user nova-compute[70243]: node.conn[0].timeo.logout_timeout = 15
Jul 24 16:40:18 user nova-compute[70243]: node.conn[0].timeo.login_timeout = 15
Jul 24 16:40:18 user nova-compute[70243]: node.conn[0].timeo.auth_timeout = 45
Jul 24 16:40:18 user nova-compute[70243]: node.conn[0].timeo.noop_out_interval = 5
Jul 24 16:40:18 user nova-compute[70243]: node.conn[0].timeo.noop_out_timeout = 5
Jul 24 16:40:18 user nova-compute[70243]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 24 16:40:18 user nova-compute[70243]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 24 16:40:18 user nova-compute[70243]: node.conn[0].iscsi.HeaderDigest = None
Jul 24 16:40:18 user nova-compute[70243]: node.conn[0].iscsi.DataDigest = None
Jul 24 16:40:18 user nova-compute[70243]: node.conn[0].iscsi.IFMarker = No
Jul 24 16:40:18 user nova-compute[70243]: node.conn[0].iscsi.OFMarker = No
Jul 24 16:40:18 user nova-compute[70243]: # END RECORD
Jul 24 16:40:18 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c941548c-c9c6-494c-968e-13c5ea97e673]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdfe1ef-2af0-4219-95dd-ef9aac9fcf94]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xaQUdlyu {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xaQUdlyu" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86b6d61-6d39-4788-acbb-b63f7107595d]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xaQUdlyu'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ce73af-4071-4b44-8597-0c38a1ffad6a]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d2904f-3454-4228-9117-fbe5638680af]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:40:19 user nova-compute[70243]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)
Jul 24 16:40:19 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:40:19 user nova-compute[70243]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)
Jul 24 16:40:19 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.166s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] HCTL ('35', '0', '0', 0) found on session 42 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[65841122-ba71-4f69-a4e1-c37951fd4372]: (4, ('0 0 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Searching for a device in session 42 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaQUdlyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.193s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] <== connect_volume: return (195ms) {'type': 'block', 'scsi_wwn': '26536626664643463', 'path': '/dev/sdd'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536626664643463', 'path': '/dev/sdd'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:38:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-166447096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-166447096',id=35,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:38:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06cf84dc406343afa81260614acc8fdd',ramdisk_id='',reservation_id='r-8wvymxtp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:38:43Z,user_data=None,user_id='ae306b319e8c4e61b0a73933dc5c330c',uuid=8c896761-df6a-4f4a-87dd-c5ea30641a89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "address": "fa:16:3e:a5:da:73", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "vif_mac": "fa:16:3e:a5:da:73"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa5a7d4-ef", "ovs_interfaceid": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converting VIF {"id": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "address": "fa:16:3e:a5:da:73", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "vif_mac": "fa:16:3e:a5:da:73"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa5a7d4-ef", "ovs_interfaceid": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:da:73,bridge_name='br-int',has_traffic_filtering=True,id=daa5a7d4-efaf-41c4-8cd2-1a26326f9257,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa5a7d4-ef') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG nova.objects.instance [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c896761-df6a-4f4a-87dd-c5ea30641a89 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:40:19 user nova-compute[70243]:   <uuid>8c896761-df6a-4f4a-87dd-c5ea30641a89</uuid>
Jul 24 16:40:19 user nova-compute[70243]:   <name>instance-00000023</name>
Jul 24 16:40:19 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:40:19 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:40:19 user nova-compute[70243]:   <metadata>
Jul 24 16:40:19 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:40:19 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:40:19 user nova-compute[70243]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-166447096</nova:name>
Jul 24 16:40:19 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:40:18</nova:creationTime>
Jul 24 16:40:19 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:40:19 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:40:19 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:40:19 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:40:19 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:40:19 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:40:19 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:40:19 user nova-compute[70243]:       <nova:owner>
Jul 24 16:40:19 user nova-compute[70243]:         <nova:user uuid="ae306b319e8c4e61b0a73933dc5c330c">tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member</nova:user>
Jul 24 16:40:19 user nova-compute[70243]:         <nova:project uuid="06cf84dc406343afa81260614acc8fdd">tempest-ServerBootFromVolumeStableRescueTest-1579673828</nova:project>
Jul 24 16:40:19 user nova-compute[70243]:       </nova:owner>
Jul 24 16:40:19 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:40:19 user nova-compute[70243]:       <nova:ports>
Jul 24 16:40:19 user nova-compute[70243]:         <nova:port uuid="daa5a7d4-efaf-41c4-8cd2-1a26326f9257">
Jul 24 16:40:19 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 24 16:40:19 user nova-compute[70243]:         </nova:port>
Jul 24 16:40:19 user nova-compute[70243]:       </nova:ports>
Jul 24 16:40:19 user nova-compute[70243]:     </nova:instance>
Jul 24 16:40:19 user nova-compute[70243]:   </metadata>
Jul 24 16:40:19 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:40:19 user nova-compute[70243]:     <system>
Jul 24 16:40:19 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:40:19 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:40:19 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:40:19 user nova-compute[70243]:       <entry name="serial">8c896761-df6a-4f4a-87dd-c5ea30641a89</entry>
Jul 24 16:40:19 user nova-compute[70243]:       <entry name="uuid">8c896761-df6a-4f4a-87dd-c5ea30641a89</entry>
Jul 24 16:40:19 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:40:19 user nova-compute[70243]:     </system>
Jul 24 16:40:19 user nova-compute[70243]:   </sysinfo>
Jul 24 16:40:19 user nova-compute[70243]:   <os>
Jul 24 16:40:19 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:40:19 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:40:19 user nova-compute[70243]:   </os>
Jul 24 16:40:19 user nova-compute[70243]:   <features>
Jul 24 16:40:19 user nova-compute[70243]:     <acpi/>
Jul 24 16:40:19 user nova-compute[70243]:     <apic/>
Jul 24 16:40:19 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:40:19 user nova-compute[70243]:   </features>
Jul 24 16:40:19 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:40:19 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:40:19 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:40:19 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:40:19 user nova-compute[70243]:   </clock>
Jul 24 16:40:19 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:40:19 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:40:19 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:40:19 user nova-compute[70243]:   </cpu>
Jul 24 16:40:19 user nova-compute[70243]:   <devices>
Jul 24 16:40:19 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:40:19 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:40:19 user nova-compute[70243]:       <source dev="/dev/sdd"/>
Jul 24 16:40:19 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:40:19 user nova-compute[70243]:       <serial>80abe3a6-777b-4600-ab3a-b4ce4e58edc3</serial>
Jul 24 16:40:19 user nova-compute[70243]:     </disk>
Jul 24 16:40:19 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:40:19 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:40:19 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/8c896761-df6a-4f4a-87dd-c5ea30641a89/disk.rescue"/>
Jul 24 16:40:19 user nova-compute[70243]:       <target dev="vdb" bus="virtio"/>
Jul 24 16:40:19 user nova-compute[70243]:       <boot order="1"/>
Jul 24 16:40:19 user nova-compute[70243]:     </disk>
Jul 24 16:40:19 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:40:19 user nova-compute[70243]:       <mac address="fa:16:3e:a5:da:73"/>
Jul 24 16:40:19 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:40:19 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:40:19 user nova-compute[70243]:       <target dev="tapdaa5a7d4-ef"/>
Jul 24 16:40:19 user nova-compute[70243]:     </interface>
Jul 24 16:40:19 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:40:19 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/8c896761-df6a-4f4a-87dd-c5ea30641a89/console.log" append="off"/>
Jul 24 16:40:19 user nova-compute[70243]:     </serial>
Jul 24 16:40:19 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:40:19 user nova-compute[70243]:     <video>
Jul 24 16:40:19 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:40:19 user nova-compute[70243]:     </video>
Jul 24 16:40:19 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:40:19 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:40:19 user nova-compute[70243]:     </rng>
Jul 24 16:40:19 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:40:19 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:40:19 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:40:19 user nova-compute[70243]:     </memballoon>
Jul 24 16:40:19 user nova-compute[70243]:   </devices>
Jul 24 16:40:19 user nova-compute[70243]: </domain>
Jul 24 16:40:19 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:40:19 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Instance destroyed successfully.
Jul 24 16:40:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] No VIF found with MAC fa:16:3e:a5:da:73, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:40:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Acquiring lock "b77a2e65-7abb-42ee-ae10-f8df46b93078" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "b77a2e65-7abb-42ee-ae10-f8df46b93078" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG nova.objects.instance [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lazy-loading 'flavor' on Instance uuid b77a2e65-7abb-42ee-ae10-f8df46b93078 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "b77a2e65-7abb-42ee-ae10-f8df46b93078" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Acquiring lock "b77a2e65-7abb-42ee-ae10-f8df46b93078" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "b77a2e65-7abb-42ee-ae10-f8df46b93078" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:40:20 user nova-compute[70243]: INFO nova.compute.manager [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Attaching volume 695dc1da-54d9-4d35-bc3f-11065f5d9c9a to /dev/vdb
Jul 24 16:40:20 user nova-compute[70243]: DEBUG os_brick.utils [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee36d53-ee80-4797-b82a-ed9d7aea6e5d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[588bf108-26da-4dd0-9be6-71aa6170f5be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff79c95-ca6a-478f-8417-447ee7fb1c10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0090829-9e93-47dd-be5a-456acc6a2704]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:40:20 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[464c3d99-a9a6-43bd-a645-3234cda37c4a]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG os_brick.utils [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Updating existing volume attachment record: edf78190-6c59-483d-887e-bf6bc439d3c4 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-5cc69cf5-1b86-4e50-8db7-b896e7f1587d req-05b30c2e-bb9d-4e02-aa50-c0bb274271b1 service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received event network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5cc69cf5-1b86-4e50-8db7-b896e7f1587d req-05b30c2e-bb9d-4e02-aa50-c0bb274271b1 service nova] Acquiring lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5cc69cf5-1b86-4e50-8db7-b896e7f1587d req-05b30c2e-bb9d-4e02-aa50-c0bb274271b1 service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5cc69cf5-1b86-4e50-8db7-b896e7f1587d req-05b30c2e-bb9d-4e02-aa50-c0bb274271b1 service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:40:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-5cc69cf5-1b86-4e50-8db7-b896e7f1587d req-05b30c2e-bb9d-4e02-aa50-c0bb274271b1 service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] No waiting events found dispatching network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:40:20 user nova-compute[70243]: WARNING nova.compute.manager [req-5cc69cf5-1b86-4e50-8db7-b896e7f1587d req-05b30c2e-bb9d-4e02-aa50-c0bb274271b1 service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received unexpected event network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 for instance with vm_state active and task_state rescuing.
Jul 24 16:40:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:23 user nova-compute[70243]: DEBUG nova.compute.manager [req-9bbc4586-420b-42a0-b0b4-f31023902b04 req-d03999ed-fcd9-481e-a272-30c415cd25be service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received event network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:40:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9bbc4586-420b-42a0-b0b4-f31023902b04 req-d03999ed-fcd9-481e-a272-30c415cd25be service nova] Acquiring lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:40:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9bbc4586-420b-42a0-b0b4-f31023902b04 req-d03999ed-fcd9-481e-a272-30c415cd25be service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:40:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9bbc4586-420b-42a0-b0b4-f31023902b04 req-d03999ed-fcd9-481e-a272-30c415cd25be service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:40:23 user nova-compute[70243]: DEBUG nova.compute.manager [req-9bbc4586-420b-42a0-b0b4-f31023902b04 req-d03999ed-fcd9-481e-a272-30c415cd25be service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] No waiting events found dispatching network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:40:23 user nova-compute[70243]: WARNING nova.compute.manager [req-9bbc4586-420b-42a0-b0b4-f31023902b04 req-d03999ed-fcd9-481e-a272-30c415cd25be service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received unexpected event network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 for instance with vm_state active and task_state rescuing.
Jul 24 16:40:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Removed pending event for 8c896761-df6a-4f4a-87dd-c5ea30641a89 due to event {{(pid=70243) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 16:40:23 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216823.281312, 8c896761-df6a-4f4a-87dd-c5ea30641a89 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:40:23 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] VM Resumed (Lifecycle Event)
Jul 24 16:40:23 user nova-compute[70243]: DEBUG nova.compute.manager [None req-198c892d-9434-4826-9f52-ed3a50677117 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:40:23 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:40:23 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:40:23 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 24 16:40:23 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216823.2851667, 8c896761-df6a-4f4a-87dd-c5ea30641a89 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:40:23 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] VM Started (Lifecycle Event)
Jul 24 16:40:23 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:40:23 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:40:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Acquiring lock "00fec25c-8982-4a40-80ae-11d0936e10a0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:40:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:40:25 user nova-compute[70243]: INFO nova.compute.manager [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Detaching volume b019a205-f8a1-4eff-b51e-923ef2838817
Jul 24 16:40:25 user nova-compute[70243]: INFO nova.virt.block_device [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Attempting to driver detach volume b019a205-f8a1-4eff-b51e-923ef2838817 from mountpoint /dev/vdb
Jul 24 16:40:25 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Attempting to detach device vdb from instance 00fec25c-8982-4a40-80ae-11d0936e10a0 from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:40:25 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:40:25 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:40:25 user nova-compute[70243]:   <source dev="/dev/sdc"/>
Jul 24 16:40:25 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:40:25 user nova-compute[70243]:   <serial>b019a205-f8a1-4eff-b51e-923ef2838817</serial>
Jul 24 16:40:25 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:40:25 user nova-compute[70243]: </disk>
Jul 24 16:40:25 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:40:25 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Successfully detached device vdb from instance 00fec25c-8982-4a40-80ae-11d0936e10a0 from the persistent domain config.
Jul 24 16:40:25 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 00fec25c-8982-4a40-80ae-11d0936e10a0 from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:40:25 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:40:25 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:40:25 user nova-compute[70243]:   <source dev="/dev/sdc"/>
Jul 24 16:40:25 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:40:25 user nova-compute[70243]:   <serial>b019a205-f8a1-4eff-b51e-923ef2838817</serial>
Jul 24 16:40:25 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:40:25 user nova-compute[70243]: </disk>
Jul 24 16:40:25 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690216826.157991, 00fec25c-8982-4a40-80ae-11d0936e10a0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 00fec25c-8982-4a40-80ae-11d0936e10a0 {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:40:26 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Successfully detached device vdb from instance 00fec25c-8982-4a40-80ae-11d0936e10a0 from the live domain config.
Jul 24 16:40:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SjBkLJON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:40:26 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:40:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a47e1b-f67e-428b-887a-e2387bcd8196]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:40:26 user nova-compute[70243]: No targets found.
Jul 24 16:40:26 user nova-compute[70243]: iSNS:
Jul 24 16:40:26 user nova-compute[70243]: No targets found.
Jul 24 16:40:26 user nova-compute[70243]: STATIC:
Jul 24 16:40:26 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817
Jul 24 16:40:26 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:40:26 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:40:26 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3
Jul 24 16:40:26 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:40:26 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:40:26 user nova-compute[70243]: FIRMWARE:
Jul 24 16:40:26 user nova-compute[70243]: No targets found.
Jul 24 16:40:26 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:40:26 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:40:26 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a7e54d-c558-47d5-8dcf-a27aaa31f47a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7a5c8a-213c-44b6-b6c4-b91e93b77304]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:40:26 user nova-compute[70243]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)
Jul 24 16:40:26 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:40:26 user nova-compute[70243]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 (non-flash)
Jul 24 16:40:26 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91ac747d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817'): ({'sdc'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Removing single pathed devices sdc {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e341d717-618a-4100-a126-3d7826966155]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e88329-0810-4153-8323-48cf05ac1d4c]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Flushing IO for device /dev/sdc {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be1eecf-88c5-4fba-a992-278e328e83b6]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa7fae7-59a1-477b-bbc2-7590c788955d]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] SCSI volumes sdc have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[376bbf8d-6fe7-4a31-8620-a5abc8eb6a1a]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[147af5c2-4a40-4862-b6d7-164f9a2645a6]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817, portal: 172.16.0.220,3260]
Jul 24 16:40:26 user nova-compute[70243]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817, portal: 172.16.0.220,3260] successful.
Jul 24 16:40:26 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b019a205-f8a1-4eff-b51e-923ef2838817 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[215aa0b9-1794-4615-9ca2-8b39faf3f4b4]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] <== disconnect_volume: return (319ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:40:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG nova.objects.instance [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lazy-loading 'flavor' on Instance uuid 00fec25c-8982-4a40-80ae-11d0936e10a0 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ff17287c-46ab-4e5e-a38e-1f8733827533 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.806s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIGmkCoz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:40:27 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:40:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:40:27 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:40:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:40:27 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5214fbc-7f69-46b3-a9c1-56a7f3764dab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:40:27 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5dc81e-d5c4-46da-8fbc-ed637ce3b9a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a] added
Jul 24 16:40:27 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[647d8c40-9c1d-41bc-9c48-6d29ef58b328]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[488bb0cd-6ca4-41de-8248-4573a2e91cb2]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QIGmkCoz {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QIGmkCoz" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[094cf35e-1a56-429e-9fa8-1bcf7bcf06dd]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QIGmkCoz'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[38afa20e-9730-4884-a567-939bad4d2088]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df67a15-e19e-4d4c-b087-38e31cef8217]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:40:27 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:40:27 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8fc7fe-b73e-46c7-95f3-7e4c2f653770]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a, portal: 172.16.0.220,3260]
Jul 24 16:40:27 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a, portal: 172.16.0.220,3260] successful.
Jul 24 16:40:27 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[015bc74e-d5d5-49d4-99ca-b8807d28d97b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b445653d-1287-477d-a3bd-ff208621d3bd]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:40:28 user nova-compute[70243]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a (non-flash)
Jul 24 16:40:28 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:40:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:40:28 user nova-compute[70243]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a (non-flash)
Jul 24 16:40:28 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:40:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:40:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:40:28 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:40:28 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:40:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:28 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[15381a72-fe6b-4fc8-a7bf-3812a01a0f17]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:28 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:40:29 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:40:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIGmkCoz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:40:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:40:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23130653233373763', 'path': '/dev/sdb'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:40:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130653233373763', 'path': '/dev/sdb'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:40:29 user nova-compute[70243]: DEBUG nova.objects.instance [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lazy-loading 'flavor' on Instance uuid b77a2e65-7abb-42ee-ae10-f8df46b93078 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:40:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:40:29 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:40:29 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:40:29 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:40:29 user nova-compute[70243]:   <serial>695dc1da-54d9-4d35-bc3f-11065f5d9c9a</serial>
Jul 24 16:40:29 user nova-compute[70243]: </disk>
Jul 24 16:40:29 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:40:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:40:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:40:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] No VIF found with MAC fa:16:3e:ba:5c:ac, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:40:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3c2cf3cc-6dfd-47c8-9ffe-bf97d2feb05a tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "b77a2e65-7abb-42ee-ae10-f8df46b93078" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.313s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:40:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Acquiring lock "b77a2e65-7abb-42ee-ae10-f8df46b93078" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:40:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "b77a2e65-7abb-42ee-ae10-f8df46b93078" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:40:30 user nova-compute[70243]: INFO nova.compute.manager [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Detaching volume 695dc1da-54d9-4d35-bc3f-11065f5d9c9a
Jul 24 16:40:30 user nova-compute[70243]: INFO nova.virt.block_device [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Attempting to driver detach volume 695dc1da-54d9-4d35-bc3f-11065f5d9c9a from mountpoint /dev/vdb
Jul 24 16:40:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Attempting to detach device vdb from instance b77a2e65-7abb-42ee-ae10-f8df46b93078 from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:40:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:40:30 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:40:30 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:40:30 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:40:30 user nova-compute[70243]:   <serial>695dc1da-54d9-4d35-bc3f-11065f5d9c9a</serial>
Jul 24 16:40:30 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:40:30 user nova-compute[70243]: </disk>
Jul 24 16:40:30 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:40:30 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Successfully detached device vdb from instance b77a2e65-7abb-42ee-ae10-f8df46b93078 from the persistent domain config.
Jul 24 16:40:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b77a2e65-7abb-42ee-ae10-f8df46b93078 from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:40:30 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:40:30 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:40:30 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:40:30 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:40:30 user nova-compute[70243]:   <serial>695dc1da-54d9-4d35-bc3f-11065f5d9c9a</serial>
Jul 24 16:40:30 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:40:30 user nova-compute[70243]: </disk>
Jul 24 16:40:30 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690216831.3640902, b77a2e65-7abb-42ee-ae10-f8df46b93078 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b77a2e65-7abb-42ee-ae10-f8df46b93078 {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:40:31 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Successfully detached device vdb from instance b77a2e65-7abb-42ee-ae10-f8df46b93078 from the live domain config.
Jul 24 16:40:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIGmkCoz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:40:31 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:40:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d887e94-0f06-48c1-8fcd-30d34a61667d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:40:31 user nova-compute[70243]: No targets found.
Jul 24 16:40:31 user nova-compute[70243]: iSNS:
Jul 24 16:40:31 user nova-compute[70243]: No targets found.
Jul 24 16:40:31 user nova-compute[70243]: STATIC:
Jul 24 16:40:31 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3
Jul 24 16:40:31 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:40:31 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:40:31 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a
Jul 24 16:40:31 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:40:31 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:40:31 user nova-compute[70243]: FIRMWARE:
Jul 24 16:40:31 user nova-compute[70243]: No targets found.
Jul 24 16:40:31 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:40:31 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:40:31 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[faea04fe-660c-474e-95e5-2b73aedfcf51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1d4ac6-f471-46d3-9502-2c21c8b520c6]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:40:31 user nova-compute[70243]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a (non-flash)
Jul 24 16:40:31 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:40:31 user nova-compute[70243]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a (non-flash)
Jul 24 16:40:31 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc135a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a'): ({'sdb'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Removing single pathed devices sdb {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[549b59be-2675-48a0-bdf2-77db68ffd6ed]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20c2f16-ab7a-492d-a5c4-5ac730421ce4]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Flushing IO for device /dev/sdb {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[364dbb28-8b5f-4e22-8c9b-99cb6a33ebb9]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[702b2428-f65e-4e8f-abc3-753b41330920]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1196362-6449-4a69-ae6b-3a1b5c409516]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d946b45-80ac-4dc4-8ec2-341c085376b5]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a, portal: 172.16.0.220,3260]
Jul 24 16:40:31 user nova-compute[70243]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a, portal: 172.16.0.220,3260] successful.
Jul 24 16:40:31 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:695dc1da-54d9-4d35-bc3f-11065f5d9c9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a589d54f-3f5e-4fce-bf78-9cb64b8a9d5c]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] <== disconnect_volume: return (329ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:40:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:40:32 user nova-compute[70243]: DEBUG nova.objects.instance [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lazy-loading 'flavor' on Instance uuid b77a2e65-7abb-42ee-ae10-f8df46b93078 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:40:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-58f4c2e4-b04a-4d65-a5a8-34754f8de889 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "b77a2e65-7abb-42ee-ae10-f8df46b93078" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.707s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:40:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:40:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:40:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:40:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:40:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "75b26864-1539-4106-b741-3b3f5c7e898a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:40:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG nova.objects.instance [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lazy-loading 'flavor' on Instance uuid 75b26864-1539-4106-b741-3b3f5c7e898a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "75b26864-1539-4106-b741-3b3f5c7e898a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:40:40 user nova-compute[70243]: INFO nova.compute.manager [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Attaching volume 2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 to /dev/vdb
Jul 24 16:40:40 user nova-compute[70243]: DEBUG os_brick.utils [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fd8e3f-974e-449c-9f12-e439bb0d8329]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[849a097c-de55-44a9-82b1-604ad237b7f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a585f48-082b-4374-87c5-74d353bf6c05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b01a62d-0e5b-446a-ac8c-b28f0babb517]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:40:40 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:40:40 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad717a5-36be-4075-b3b1-c96f09a26d4e]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG os_brick.utils [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:40:40 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Updating existing volume attachment record: d4b5f6cc-3a0a-48ae-833c-799fe1d8cc86 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:40:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGNvfPSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:40:46 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:40:46 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:40:46 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:40:46 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:40:46 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:40:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fad980d-4ba9-4151-a7f6-3edd30046d37]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:40:46 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c59ad1-9c29-487e-b274-5c014b3c835d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521] added
Jul 24 16:40:46 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[977f7b0e-8967-45d8-b73e-ba315ca0bc2b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bd3933-23c3-4f53-8d94-03b00d1cc785]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lGNvfPSE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lGNvfPSE" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[459db6b5-a274-4ed2-b1e7-23b168c6c888]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lGNvfPSE'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[918aad3c-a1de-4991-b877-11f05b0900f8]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbae00f6-54d2-484a-959a-8443d104ddc0]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:40:46 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:40:46 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:40:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:47 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a5e0f9-f8cb-436d-bc52-61bc29b26593]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521, portal: 172.16.0.220,3260]
Jul 24 16:40:47 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521, portal: 172.16.0.220,3260] successful.
Jul 24 16:40:47 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:47 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9572849-8c1d-4595-98d8-49c3fff4dbad]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:47 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[87381615-795f-4256-8ce9-6b2a62f165f6]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:40:47 user nova-compute[70243]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 (non-flash)
Jul 24 16:40:47 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:40:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:40:47 user nova-compute[70243]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 (non-flash)
Jul 24 16:40:47 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:40:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:40:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:40:47 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:40:47 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:40:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:47 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f18f83-6844-474f-abc3-0962d03c7fc3]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:47 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:40:48 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:40:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGNvfPSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:40:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:40:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26230303666353430', 'path': '/dev/sdb'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:40:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230303666353430', 'path': '/dev/sdb'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:40:48 user nova-compute[70243]: DEBUG nova.objects.instance [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lazy-loading 'flavor' on Instance uuid 75b26864-1539-4106-b741-3b3f5c7e898a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:40:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:40:48 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:40:48 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:40:48 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:40:48 user nova-compute[70243]:   <serial>2b5ee9d3-df37-4bac-a5b4-71ad4aa22521</serial>
Jul 24 16:40:48 user nova-compute[70243]: </disk>
Jul 24 16:40:48 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:40:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:40:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:40:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] No VIF found with MAC fa:16:3e:81:5b:1b, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:40:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e9193fe0-43ff-4255-b3b6-4218fff014a6 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.514s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:40:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "0cceb071-c478-4914-8243-77c3efbdb5d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:40:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:40:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:40:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:40:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:40:49 user nova-compute[70243]: INFO nova.compute.manager [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Terminating instance
Jul 24 16:40:49 user nova-compute[70243]: DEBUG nova.compute.manager [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:40:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG nova.compute.manager [req-49045596-0a0e-4304-8bd9-1a2afbcd48f3 req-c12f8b8c-42d8-4649-ace2-521ae91652c7 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received event network-vif-unplugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-49045596-0a0e-4304-8bd9-1a2afbcd48f3 req-c12f8b8c-42d8-4649-ace2-521ae91652c7 service nova] Acquiring lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-49045596-0a0e-4304-8bd9-1a2afbcd48f3 req-c12f8b8c-42d8-4649-ace2-521ae91652c7 service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-49045596-0a0e-4304-8bd9-1a2afbcd48f3 req-c12f8b8c-42d8-4649-ace2-521ae91652c7 service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG nova.compute.manager [req-49045596-0a0e-4304-8bd9-1a2afbcd48f3 req-c12f8b8c-42d8-4649-ace2-521ae91652c7 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] No waiting events found dispatching network-vif-unplugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG nova.compute.manager [req-49045596-0a0e-4304-8bd9-1a2afbcd48f3 req-c12f8b8c-42d8-4649-ace2-521ae91652c7 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received event network-vif-unplugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:50 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Instance destroyed successfully.
Jul 24 16:40:50 user nova-compute[70243]: DEBUG nova.objects.instance [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'resources' on Instance uuid 0cceb071-c478-4914-8243-77c3efbdb5d3 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:34:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-674586026',display_name='tempest-ServerRescueNegativeTestJSON-server-674586026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-674586026',id=30,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuU6JYcS7LI0dMV51kZaOp9oaBO7Yr+j/yzhEYlC/QFScz4HdKIfkBYKmCyDus2pxFhM6QsjAcT5q3iW8P89kzGFTNoGUkewoJ2IFeiomz5ox1neIK2P3bIiJHIeWHoXg==',key_name='tempest-keypair-2085747341',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:36:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c25474ae9fb49cb92c611e77f2dbc79',ramdisk_id='',reservation_id='r-3rqt6k04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1414931075',owner_user_name='tempest-ServerRescueNegativeTestJSON-1414931075-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:38:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcb7fb5c11bb4d65b9c39923840685c6',uuid=0cceb071-c478-4914-8243-77c3efbdb5d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "address": "fa:16:3e:46:16:b8", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e9e4c6-7d", "ovs_interfaceid": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converting VIF {"id": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "address": "fa:16:3e:46:16:b8", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e9e4c6-7d", "ovs_interfaceid": "31e9e4c6-7d4c-4077-a725-02e3b9f6f61a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:16:b8,bridge_name='br-int',has_traffic_filtering=True,id=31e9e4c6-7d4c-4077-a725-02e3b9f6f61a,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e9e4c6-7d') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG os_vif [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:16:b8,bridge_name='br-int',has_traffic_filtering=True,id=31e9e4c6-7d4c-4077-a725-02e3b9f6f61a,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e9e4c6-7d') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31e9e4c6-7d, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:40:50 user nova-compute[70243]: INFO os_vif [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:16:b8,bridge_name='br-int',has_traffic_filtering=True,id=31e9e4c6-7d4c-4077-a725-02e3b9f6f61a,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e9e4c6-7d')
Jul 24 16:40:50 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Deleting instance files /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3_del
Jul 24 16:40:50 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Deletion of /opt/stack/data/nova/instances/0cceb071-c478-4914-8243-77c3efbdb5d3_del complete
Jul 24 16:40:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "75b26864-1539-4106-b741-3b3f5c7e898a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:40:50 user nova-compute[70243]: INFO nova.compute.manager [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Detaching volume 2b5ee9d3-df37-4bac-a5b4-71ad4aa22521
Jul 24 16:40:50 user nova-compute[70243]: INFO nova.compute.manager [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Took 0.96 seconds to destroy the instance on the hypervisor.
Jul 24 16:40:50 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:40:50 user nova-compute[70243]: INFO nova.virt.block_device [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Attempting to driver detach volume 2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 from mountpoint /dev/vdb
Jul 24 16:40:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Attempting to detach device vdb from instance 75b26864-1539-4106-b741-3b3f5c7e898a from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:40:50 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:40:50 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:40:50 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:40:50 user nova-compute[70243]:   <serial>2b5ee9d3-df37-4bac-a5b4-71ad4aa22521</serial>
Jul 24 16:40:50 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:40:50 user nova-compute[70243]: </disk>
Jul 24 16:40:50 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:40:50 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Successfully detached device vdb from instance 75b26864-1539-4106-b741-3b3f5c7e898a from the persistent domain config.
Jul 24 16:40:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 75b26864-1539-4106-b741-3b3f5c7e898a from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:40:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:40:50 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:40:50 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:40:50 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:40:50 user nova-compute[70243]:   <serial>2b5ee9d3-df37-4bac-a5b4-71ad4aa22521</serial>
Jul 24 16:40:50 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:40:50 user nova-compute[70243]: </disk>
Jul 24 16:40:50 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690216851.2540522, 75b26864-1539-4106-b741-3b3f5c7e898a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 75b26864-1539-4106-b741-3b3f5c7e898a {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:40:51 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Successfully detached device vdb from instance 75b26864-1539-4106-b741-3b3f5c7e898a from the live domain config.
Jul 24 16:40:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGNvfPSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:40:51 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:40:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be18830-ac57-47b0-87f9-6b32dfa6e954]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:40:51 user nova-compute[70243]: No targets found.
Jul 24 16:40:51 user nova-compute[70243]: iSNS:
Jul 24 16:40:51 user nova-compute[70243]: No targets found.
Jul 24 16:40:51 user nova-compute[70243]: STATIC:
Jul 24 16:40:51 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3
Jul 24 16:40:51 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:40:51 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:40:51 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521
Jul 24 16:40:51 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:40:51 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:40:51 user nova-compute[70243]: FIRMWARE:
Jul 24 16:40:51 user nova-compute[70243]: No targets found.
Jul 24 16:40:51 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:40:51 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:40:51 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cf863d-d978-41ab-81f5-6586ad39b583]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3dc462-ecc6-440d-8fec-80639f99f998]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:40:51 user nova-compute[70243]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 (non-flash)
Jul 24 16:40:51 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:40:51 user nova-compute[70243]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 (non-flash)
Jul 24 16:40:51 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91ac7e6560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521'): ({'sdb'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Removing single pathed devices sdb {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdf4942-020c-46eb-acd9-938c5298f43d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a82c4c7-dfe7-417d-8fbb-778903a09f5c]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Flushing IO for device /dev/sdb {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d418849-5741-48c9-8fdd-c0f6c58ea639]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc9b8ac-e01d-4e52-81f4-2a1e18ebfb66]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1869e30c-2bf6-4b48-a388-a11d64023101]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d357e892-7fd7-48bf-a6e9-227cdafada02]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521, portal: 172.16.0.220,3260]
Jul 24 16:40:51 user nova-compute[70243]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521, portal: 172.16.0.220,3260] successful.
Jul 24 16:40:51 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5ee9d3-df37-4bac-a5b4-71ad4aa22521 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ea8c8c-4385-43b9-b63b-86612758cb1a]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] <== disconnect_volume: return (331ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:40:51 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Took 1.10 seconds to deallocate network for instance.
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:40:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:40:52 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:40:52 user nova-compute[70243]: DEBUG nova.compute.manager [req-31e67df5-887c-4066-952e-2a2a69e76f55 req-d94ec3f5-b03d-4478-b446-29970931e774 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received event network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:40:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-31e67df5-887c-4066-952e-2a2a69e76f55 req-d94ec3f5-b03d-4478-b446-29970931e774 service nova] Acquiring lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:40:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-31e67df5-887c-4066-952e-2a2a69e76f55 req-d94ec3f5-b03d-4478-b446-29970931e774 service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:40:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-31e67df5-887c-4066-952e-2a2a69e76f55 req-d94ec3f5-b03d-4478-b446-29970931e774 service nova] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:40:52 user nova-compute[70243]: DEBUG nova.compute.manager [req-31e67df5-887c-4066-952e-2a2a69e76f55 req-d94ec3f5-b03d-4478-b446-29970931e774 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] No waiting events found dispatching network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:40:52 user nova-compute[70243]: WARNING nova.compute.manager [req-31e67df5-887c-4066-952e-2a2a69e76f55 req-d94ec3f5-b03d-4478-b446-29970931e774 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received unexpected event network-vif-plugged-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a for instance with vm_state deleted and task_state None.
Jul 24 16:40:52 user nova-compute[70243]: DEBUG nova.compute.manager [req-31e67df5-887c-4066-952e-2a2a69e76f55 req-d94ec3f5-b03d-4478-b446-29970931e774 service nova] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Received event network-vif-deleted-31e9e4c6-7d4c-4077-a725-02e3b9f6f61a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:40:52 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:40:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:40:52 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Deleted allocations for instance 0cceb071-c478-4914-8243-77c3efbdb5d3
Jul 24 16:40:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-cc747157-a76a-4723-9a03-cc59ed670f7b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "0cceb071-c478-4914-8243-77c3efbdb5d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.583s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:40:52 user nova-compute[70243]: DEBUG nova.objects.instance [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lazy-loading 'flavor' on Instance uuid 75b26864-1539-4106-b741-3b3f5c7e898a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:40:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-6586e8f4-454e-4ab1-bd75-7ac0de05170a tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.720s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:40:54 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:40:54 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:40:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:40:56 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:40:59 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:41:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:00 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:41:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:41:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-75b26864-1539-4106-b741-3b3f5c7e898a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:41:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-75b26864-1539-4106-b741-3b3f5c7e898a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:41:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:41:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Updating instance_info_cache with network_info: [{"id": "885f4554-aa56-4402-a61c-dd97f720d0fe", "address": "fa:16:3e:81:5b:1b", "network": {"id": "51126732-2727-4752-b653-16d223e1d827", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-797458544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6955ddcb9e244a1beb243d63596cada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885f4554-aa", "ovs_interfaceid": "885f4554-aa56-4402-a61c-dd97f720d0fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:41:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-75b26864-1539-4106-b741-3b3f5c7e898a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:41:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:41:00 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:41:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:41:01 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:41:02 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:41:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:02 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:41:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:41:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:41:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:41:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:41:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:41:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:41:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:41:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:41:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:41:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:41:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:41:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:41:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:41:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:41:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:41:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:41:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:41:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c896761-df6a-4f4a-87dd-c5ea30641a89/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:41:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c896761-df6a-4f4a-87dd-c5ea30641a89/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:41:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c896761-df6a-4f4a-87dd-c5ea30641a89/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:41:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c896761-df6a-4f4a-87dd-c5ea30641a89/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:41:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:41:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:41:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:41:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:41:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:41:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:41:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:41:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:41:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:41:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:41:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:41:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:41:05 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:41:05 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:41:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=7951MB free_disk=24.06710433959961GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:41:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 50fecb3a-8f06-4822-8c84-76df51acfe50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:41:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 6f2258de-6b31-48af-81df-37b64da4ca99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:41:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 75b26864-1539-4106-b741-3b3f5c7e898a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:41:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 100c6ba5-de96-4c2a-ae0c-9d3a9199948c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:41:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 00fec25c-8982-4a40-80ae-11d0936e10a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:41:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8c896761-df6a-4f4a-87dd-c5ea30641a89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:41:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance b77a2e65-7abb-42ee-ae10-f8df46b93078 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:41:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:41:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:41:05 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216850.574532, 0cceb071-c478-4914-8243-77c3efbdb5d3 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:41:05 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] VM Stopped (Lifecycle Event)
Jul 24 16:41:05 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2222daa4-7646-4c2a-a471-1cb34765f32e None None] [instance: 0cceb071-c478-4914-8243-77c3efbdb5d3] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:41:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:41:05 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:41:05 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:41:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:41:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:08 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:41:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:18 user nova-compute[70243]: DEBUG nova.compute.manager [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:41:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:18 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:41:18 user nova-compute[70243]: INFO nova.compute.claims [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Claim successful on node user
Jul 24 16:41:18 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:41:18 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:41:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:18 user nova-compute[70243]: DEBUG nova.compute.manager [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:41:18 user nova-compute[70243]: DEBUG nova.compute.manager [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:41:18 user nova-compute[70243]: DEBUG nova.network.neutron [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:41:18 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:41:18 user nova-compute[70243]: DEBUG nova.compute.manager [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG nova.policy [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97ec28618df24ff19401d02c0ca3c1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fc785066034979ade3e9ef1f3ca27c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG nova.compute.manager [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:41:19 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Creating image(s)
Jul 24 16:41:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7bfe8dc-9f4f-44b4-95d4-e2b069774a11/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "/opt/stack/data/nova/instances/a7bfe8dc-9f4f-44b4-95d4-e2b069774a11/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "/opt/stack/data/nova/instances/a7bfe8dc-9f4f-44b4-95d4-e2b069774a11/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.146s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/a7bfe8dc-9f4f-44b4-95d4-e2b069774a11/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/a7bfe8dc-9f4f-44b4-95d4-e2b069774a11/disk 1073741824" returned: 0 in 0.053s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7bfe8dc-9f4f-44b4-95d4-e2b069774a11/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7bfe8dc-9f4f-44b4-95d4-e2b069774a11/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7bfe8dc-9f4f-44b4-95d4-e2b069774a11/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Cannot resize image /opt/stack/data/nova/instances/a7bfe8dc-9f4f-44b4-95d4-e2b069774a11/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG nova.objects.instance [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lazy-loading 'migration_context' on Instance uuid a7bfe8dc-9f4f-44b4-95d4-e2b069774a11 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Ensure instance console log exists: /opt/stack/data/nova/instances/a7bfe8dc-9f4f-44b4-95d4-e2b069774a11/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:20 user nova-compute[70243]: DEBUG nova.network.neutron [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Successfully created port: 94b5f888-d3e5-4acb-b340-176fbc95431d {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:41:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Acquiring lock "00fec25c-8982-4a40-80ae-11d0936e10a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Acquiring lock "00fec25c-8982-4a40-80ae-11d0936e10a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:20 user nova-compute[70243]: INFO nova.compute.manager [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Terminating instance
Jul 24 16:41:20 user nova-compute[70243]: DEBUG nova.compute.manager [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:41:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-04d71080-f6d9-4a71-a90f-bf10a93e86dc req-6f706f84-863c-410b-acb7-694b852934d2 service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Received event network-vif-unplugged-1e316ee9-0ea5-491c-b36b-742446e40042 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:41:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-04d71080-f6d9-4a71-a90f-bf10a93e86dc req-6f706f84-863c-410b-acb7-694b852934d2 service nova] Acquiring lock "00fec25c-8982-4a40-80ae-11d0936e10a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-04d71080-f6d9-4a71-a90f-bf10a93e86dc req-6f706f84-863c-410b-acb7-694b852934d2 service nova] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-04d71080-f6d9-4a71-a90f-bf10a93e86dc req-6f706f84-863c-410b-acb7-694b852934d2 service nova] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-04d71080-f6d9-4a71-a90f-bf10a93e86dc req-6f706f84-863c-410b-acb7-694b852934d2 service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] No waiting events found dispatching network-vif-unplugged-1e316ee9-0ea5-491c-b36b-742446e40042 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:41:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-04d71080-f6d9-4a71-a90f-bf10a93e86dc req-6f706f84-863c-410b-acb7-694b852934d2 service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Received event network-vif-unplugged-1e316ee9-0ea5-491c-b36b-742446e40042 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:41:21 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Instance destroyed successfully.
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.objects.instance [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lazy-loading 'resources' on Instance uuid 00fec25c-8982-4a40-80ae-11d0936e10a0 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:37:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2072320659',display_name='tempest-TestServerVolumeAttachmentScenario-server-2072320659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2072320659',id=34,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNkSZjnGtzTfjk8XT2qqhfrANpryN23F6ixA/QnFxRqDRsvmTRsAqfsKu59Hm6w90dpMlAfUXNtyliCRo/3qsoHKo3/uvN+PJYElwyaAvn6ZNM27VUZpt+/vytLPyGUCQ==',key_name='tempest-keypair-2137048624',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:37:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8d2e94319a14caa8ac0c27c6f242648',ramdisk_id='',reservation_id='r-4uqphkk8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-640607970',owner_user_name='tempest-TestServerVolumeAttachmentScenario-640607970-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:37:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a435e78ca034356b3d09f09418c310c',uuid=00fec25c-8982-4a40-80ae-11d0936e10a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e316ee9-0ea5-491c-b36b-742446e40042", "address": "fa:16:3e:46:27:41", "network": {"id": "fc56dff4-5f20-428e-97eb-4284f448d179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-56253948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8d2e94319a14caa8ac0c27c6f242648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e316ee9-0e", "ovs_interfaceid": "1e316ee9-0ea5-491c-b36b-742446e40042", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Converting VIF {"id": "1e316ee9-0ea5-491c-b36b-742446e40042", "address": "fa:16:3e:46:27:41", "network": {"id": "fc56dff4-5f20-428e-97eb-4284f448d179", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-56253948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8d2e94319a14caa8ac0c27c6f242648", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e316ee9-0e", "ovs_interfaceid": "1e316ee9-0ea5-491c-b36b-742446e40042", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:27:41,bridge_name='br-int',has_traffic_filtering=True,id=1e316ee9-0ea5-491c-b36b-742446e40042,network=Network(fc56dff4-5f20-428e-97eb-4284f448d179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e316ee9-0e') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG os_vif [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:27:41,bridge_name='br-int',has_traffic_filtering=True,id=1e316ee9-0ea5-491c-b36b-742446e40042,network=Network(fc56dff4-5f20-428e-97eb-4284f448d179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e316ee9-0e') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e316ee9-0e, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:41:21 user nova-compute[70243]: INFO os_vif [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:27:41,bridge_name='br-int',has_traffic_filtering=True,id=1e316ee9-0ea5-491c-b36b-742446e40042,network=Network(fc56dff4-5f20-428e-97eb-4284f448d179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e316ee9-0e')
Jul 24 16:41:21 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Deleting instance files /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0_del
Jul 24 16:41:21 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Deletion of /opt/stack/data/nova/instances/00fec25c-8982-4a40-80ae-11d0936e10a0_del complete
Jul 24 16:41:21 user nova-compute[70243]: INFO nova.compute.manager [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 24 16:41:21 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.network.neutron [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Successfully updated port: 94b5f888-d3e5-4acb-b340-176fbc95431d {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "refresh_cache-a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquired lock "refresh_cache-a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.network.neutron [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.network.neutron [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.network.neutron [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Updating instance_info_cache with network_info: [{"id": "94b5f888-d3e5-4acb-b340-176fbc95431d", "address": "fa:16:3e:03:04:e0", "network": {"id": "e788aa0b-b842-4cad-a50d-605499bef92a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-86978474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fc785066034979ade3e9ef1f3ca27c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b5f888-d3", "ovs_interfaceid": "94b5f888-d3e5-4acb-b340-176fbc95431d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Releasing lock "refresh_cache-a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.compute.manager [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Instance network_info: |[{"id": "94b5f888-d3e5-4acb-b340-176fbc95431d", "address": "fa:16:3e:03:04:e0", "network": {"id": "e788aa0b-b842-4cad-a50d-605499bef92a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-86978474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fc785066034979ade3e9ef1f3ca27c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b5f888-d3", "ovs_interfaceid": "94b5f888-d3e5-4acb-b340-176fbc95431d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Start _get_guest_xml network_info=[{"id": "94b5f888-d3e5-4acb-b340-176fbc95431d", "address": "fa:16:3e:03:04:e0", "network": {"id": "e788aa0b-b842-4cad-a50d-605499bef92a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-86978474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fc785066034979ade3e9ef1f3ca27c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b5f888-d3", "ovs_interfaceid": "94b5f888-d3e5-4acb-b340-176fbc95431d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:41:21 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:41:21 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:41:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1548118009',display_name='tempest-VolumesSnapshotTestJSON-instance-1548118009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1548118009',id=37,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZYxkI4I2wSdTpX5uzBhKey2J/JPSpqosdI7tkQSJhqKF4POjN+dITwRF/Al6I6yGGsQYYqR2Aog7k02tWdicGOjOWEc8m7Ha6RgPyruL5HdvPuf0F99AYx+ZixHTs1TQ==',key_name='tempest-keypair-1075488614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2fc785066034979ade3e9ef1f3ca27c',ramdisk_id='',reservation_id='r-9p1u7wml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1620979851',owner_user_name='tempest-VolumesSnapshotTestJSON-1620979851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:41:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97ec28618df24ff19401d02c0ca3c1a2',uuid=a7bfe8dc-9f4f-44b4-95d4-e2b069774a11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94b5f888-d3e5-4acb-b340-176fbc95431d", "address": "fa:16:3e:03:04:e0", "network": {"id": "e788aa0b-b842-4cad-a50d-605499bef92a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-86978474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fc785066034979ade3e9ef1f3ca27c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b5f888-d3", "ovs_interfaceid": "94b5f888-d3e5-4acb-b340-176fbc95431d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Converting VIF {"id": "94b5f888-d3e5-4acb-b340-176fbc95431d", "address": "fa:16:3e:03:04:e0", "network": {"id": "e788aa0b-b842-4cad-a50d-605499bef92a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-86978474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fc785066034979ade3e9ef1f3ca27c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b5f888-d3", "ovs_interfaceid": "94b5f888-d3e5-4acb-b340-176fbc95431d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:04:e0,bridge_name='br-int',has_traffic_filtering=True,id=94b5f888-d3e5-4acb-b340-176fbc95431d,network=Network(e788aa0b-b842-4cad-a50d-605499bef92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b5f888-d3') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.objects.instance [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lazy-loading 'pci_devices' on Instance uuid a7bfe8dc-9f4f-44b4-95d4-e2b069774a11 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:41:21 user nova-compute[70243]:   <uuid>a7bfe8dc-9f4f-44b4-95d4-e2b069774a11</uuid>
Jul 24 16:41:21 user nova-compute[70243]:   <name>instance-00000025</name>
Jul 24 16:41:21 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:41:21 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:41:21 user nova-compute[70243]:   <metadata>
Jul 24 16:41:21 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:41:21 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:41:21 user nova-compute[70243]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1548118009</nova:name>
Jul 24 16:41:21 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:41:21</nova:creationTime>
Jul 24 16:41:21 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:41:21 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:41:21 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:41:21 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:41:21 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:41:21 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:41:21 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:41:21 user nova-compute[70243]:       <nova:owner>
Jul 24 16:41:21 user nova-compute[70243]:         <nova:user uuid="97ec28618df24ff19401d02c0ca3c1a2">tempest-VolumesSnapshotTestJSON-1620979851-project-member</nova:user>
Jul 24 16:41:21 user nova-compute[70243]:         <nova:project uuid="a2fc785066034979ade3e9ef1f3ca27c">tempest-VolumesSnapshotTestJSON-1620979851</nova:project>
Jul 24 16:41:21 user nova-compute[70243]:       </nova:owner>
Jul 24 16:41:21 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:41:21 user nova-compute[70243]:       <nova:ports>
Jul 24 16:41:21 user nova-compute[70243]:         <nova:port uuid="94b5f888-d3e5-4acb-b340-176fbc95431d">
Jul 24 16:41:21 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 24 16:41:21 user nova-compute[70243]:         </nova:port>
Jul 24 16:41:21 user nova-compute[70243]:       </nova:ports>
Jul 24 16:41:21 user nova-compute[70243]:     </nova:instance>
Jul 24 16:41:21 user nova-compute[70243]:   </metadata>
Jul 24 16:41:21 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:41:21 user nova-compute[70243]:     <system>
Jul 24 16:41:21 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:41:21 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:41:21 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:41:21 user nova-compute[70243]:       <entry name="serial">a7bfe8dc-9f4f-44b4-95d4-e2b069774a11</entry>
Jul 24 16:41:21 user nova-compute[70243]:       <entry name="uuid">a7bfe8dc-9f4f-44b4-95d4-e2b069774a11</entry>
Jul 24 16:41:21 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:41:21 user nova-compute[70243]:     </system>
Jul 24 16:41:21 user nova-compute[70243]:   </sysinfo>
Jul 24 16:41:21 user nova-compute[70243]:   <os>
Jul 24 16:41:21 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:41:21 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:41:21 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:41:21 user nova-compute[70243]:   </os>
Jul 24 16:41:21 user nova-compute[70243]:   <features>
Jul 24 16:41:21 user nova-compute[70243]:     <acpi/>
Jul 24 16:41:21 user nova-compute[70243]:     <apic/>
Jul 24 16:41:21 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:41:21 user nova-compute[70243]:   </features>
Jul 24 16:41:21 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:41:21 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:41:21 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:41:21 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:41:21 user nova-compute[70243]:   </clock>
Jul 24 16:41:21 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:41:21 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:41:21 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:41:21 user nova-compute[70243]:   </cpu>
Jul 24 16:41:21 user nova-compute[70243]:   <devices>
Jul 24 16:41:21 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:41:21 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:41:21 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/a7bfe8dc-9f4f-44b4-95d4-e2b069774a11/disk"/>
Jul 24 16:41:21 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:41:21 user nova-compute[70243]:     </disk>
Jul 24 16:41:21 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:41:21 user nova-compute[70243]:       <mac address="fa:16:3e:03:04:e0"/>
Jul 24 16:41:21 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:41:21 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:41:21 user nova-compute[70243]:       <target dev="tap94b5f888-d3"/>
Jul 24 16:41:21 user nova-compute[70243]:     </interface>
Jul 24 16:41:21 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:41:21 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/a7bfe8dc-9f4f-44b4-95d4-e2b069774a11/console.log" append="off"/>
Jul 24 16:41:21 user nova-compute[70243]:     </serial>
Jul 24 16:41:21 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:41:21 user nova-compute[70243]:     <video>
Jul 24 16:41:21 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:41:21 user nova-compute[70243]:     </video>
Jul 24 16:41:21 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:41:21 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:41:21 user nova-compute[70243]:     </rng>
Jul 24 16:41:21 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:41:21 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:41:21 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:41:21 user nova-compute[70243]:     </memballoon>
Jul 24 16:41:21 user nova-compute[70243]:   </devices>
Jul 24 16:41:21 user nova-compute[70243]: </domain>
Jul 24 16:41:21 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:41:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1548118009',display_name='tempest-VolumesSnapshotTestJSON-instance-1548118009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1548118009',id=37,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZYxkI4I2wSdTpX5uzBhKey2J/JPSpqosdI7tkQSJhqKF4POjN+dITwRF/Al6I6yGGsQYYqR2Aog7k02tWdicGOjOWEc8m7Ha6RgPyruL5HdvPuf0F99AYx+ZixHTs1TQ==',key_name='tempest-keypair-1075488614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2fc785066034979ade3e9ef1f3ca27c',ramdisk_id='',reservation_id='r-9p1u7wml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1620979851',owner_user_name='tempest-VolumesSnapshotTestJSON-1620979851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:41:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97ec28618df24ff19401d02c0ca3c1a2',uuid=a7bfe8dc-9f4f-44b4-95d4-e2b069774a11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94b5f888-d3e5-4acb-b340-176fbc95431d", "address": "fa:16:3e:03:04:e0", "network": {"id": "e788aa0b-b842-4cad-a50d-605499bef92a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-86978474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fc785066034979ade3e9ef1f3ca27c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b5f888-d3", "ovs_interfaceid": "94b5f888-d3e5-4acb-b340-176fbc95431d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Converting VIF {"id": "94b5f888-d3e5-4acb-b340-176fbc95431d", "address": "fa:16:3e:03:04:e0", "network": {"id": "e788aa0b-b842-4cad-a50d-605499bef92a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-86978474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fc785066034979ade3e9ef1f3ca27c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b5f888-d3", "ovs_interfaceid": "94b5f888-d3e5-4acb-b340-176fbc95431d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:04:e0,bridge_name='br-int',has_traffic_filtering=True,id=94b5f888-d3e5-4acb-b340-176fbc95431d,network=Network(e788aa0b-b842-4cad-a50d-605499bef92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b5f888-d3') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG os_vif [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:04:e0,bridge_name='br-int',has_traffic_filtering=True,id=94b5f888-d3e5-4acb-b340-176fbc95431d,network=Network(e788aa0b-b842-4cad-a50d-605499bef92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b5f888-d3') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94b5f888-d3, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94b5f888-d3, col_values=(('external_ids', {'iface-id': '94b5f888-d3e5-4acb-b340-176fbc95431d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:04:e0', 'vm-uuid': 'a7bfe8dc-9f4f-44b4-95d4-e2b069774a11'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:21 user nova-compute[70243]: INFO os_vif [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:04:e0,bridge_name='br-int',has_traffic_filtering=True,id=94b5f888-d3e5-4acb-b340-176fbc95431d,network=Network(e788aa0b-b842-4cad-a50d-605499bef92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b5f888-d3')
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] No VIF found with MAC fa:16:3e:03:04:e0, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:41:21 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:41:21 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Took 0.83 seconds to deallocate network for instance.
Jul 24 16:41:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-69bb95cb-3457-4223-8b7d-87a829774d8e req-0595ed71-6cd2-4243-8ef4-5bfcd309522f service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Received event network-vif-deleted-1e316ee9-0ea5-491c-b36b-742446e40042 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:41:22 user nova-compute[70243]: INFO nova.compute.manager [req-69bb95cb-3457-4223-8b7d-87a829774d8e req-0595ed71-6cd2-4243-8ef4-5bfcd309522f service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Neutron deleted interface 1e316ee9-0ea5-491c-b36b-742446e40042; detaching it from the instance and deleting it from the info cache
Jul 24 16:41:22 user nova-compute[70243]: DEBUG nova.network.neutron [req-69bb95cb-3457-4223-8b7d-87a829774d8e req-0595ed71-6cd2-4243-8ef4-5bfcd309522f service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:41:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-69bb95cb-3457-4223-8b7d-87a829774d8e req-0595ed71-6cd2-4243-8ef4-5bfcd309522f service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Detach interface failed, port_id=1e316ee9-0ea5-491c-b36b-742446e40042, reason: Instance 00fec25c-8982-4a40-80ae-11d0936e10a0 could not be found. {{(pid=70243) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 16:41:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:22 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:41:22 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:41:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:22 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Deleted allocations for instance 00fec25c-8982-4a40-80ae-11d0936e10a0
Jul 24 16:41:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-39358945-722a-4650-974b-009615d11467 tempest-TestServerVolumeAttachmentScenario-640607970 tempest-TestServerVolumeAttachmentScenario-640607970-project-member] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.339s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-d2e84df1-4557-4ee9-82c5-0b523a3c3b88 req-5e4bcf18-7d5b-496c-a621-ab3b13896cc6 service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Received event network-vif-plugged-1e316ee9-0ea5-491c-b36b-742446e40042 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:41:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d2e84df1-4557-4ee9-82c5-0b523a3c3b88 req-5e4bcf18-7d5b-496c-a621-ab3b13896cc6 service nova] Acquiring lock "00fec25c-8982-4a40-80ae-11d0936e10a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d2e84df1-4557-4ee9-82c5-0b523a3c3b88 req-5e4bcf18-7d5b-496c-a621-ab3b13896cc6 service nova] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d2e84df1-4557-4ee9-82c5-0b523a3c3b88 req-5e4bcf18-7d5b-496c-a621-ab3b13896cc6 service nova] Lock "00fec25c-8982-4a40-80ae-11d0936e10a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-d2e84df1-4557-4ee9-82c5-0b523a3c3b88 req-5e4bcf18-7d5b-496c-a621-ab3b13896cc6 service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] No waiting events found dispatching network-vif-plugged-1e316ee9-0ea5-491c-b36b-742446e40042 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:41:22 user nova-compute[70243]: WARNING nova.compute.manager [req-d2e84df1-4557-4ee9-82c5-0b523a3c3b88 req-5e4bcf18-7d5b-496c-a621-ab3b13896cc6 service nova] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Received unexpected event network-vif-plugged-1e316ee9-0ea5-491c-b36b-742446e40042 for instance with vm_state deleted and task_state None.
Jul 24 16:41:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-d2e84df1-4557-4ee9-82c5-0b523a3c3b88 req-5e4bcf18-7d5b-496c-a621-ab3b13896cc6 service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Received event network-changed-94b5f888-d3e5-4acb-b340-176fbc95431d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:41:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-d2e84df1-4557-4ee9-82c5-0b523a3c3b88 req-5e4bcf18-7d5b-496c-a621-ab3b13896cc6 service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Refreshing instance network info cache due to event network-changed-94b5f888-d3e5-4acb-b340-176fbc95431d. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:41:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d2e84df1-4557-4ee9-82c5-0b523a3c3b88 req-5e4bcf18-7d5b-496c-a621-ab3b13896cc6 service nova] Acquiring lock "refresh_cache-a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:41:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d2e84df1-4557-4ee9-82c5-0b523a3c3b88 req-5e4bcf18-7d5b-496c-a621-ab3b13896cc6 service nova] Acquired lock "refresh_cache-a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:41:22 user nova-compute[70243]: DEBUG nova.network.neutron [req-d2e84df1-4557-4ee9-82c5-0b523a3c3b88 req-5e4bcf18-7d5b-496c-a621-ab3b13896cc6 service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Refreshing network info cache for port 94b5f888-d3e5-4acb-b340-176fbc95431d {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:41:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:23 user nova-compute[70243]: DEBUG nova.network.neutron [req-d2e84df1-4557-4ee9-82c5-0b523a3c3b88 req-5e4bcf18-7d5b-496c-a621-ab3b13896cc6 service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Updated VIF entry in instance network info cache for port 94b5f888-d3e5-4acb-b340-176fbc95431d. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:41:23 user nova-compute[70243]: DEBUG nova.network.neutron [req-d2e84df1-4557-4ee9-82c5-0b523a3c3b88 req-5e4bcf18-7d5b-496c-a621-ab3b13896cc6 service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Updating instance_info_cache with network_info: [{"id": "94b5f888-d3e5-4acb-b340-176fbc95431d", "address": "fa:16:3e:03:04:e0", "network": {"id": "e788aa0b-b842-4cad-a50d-605499bef92a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-86978474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fc785066034979ade3e9ef1f3ca27c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b5f888-d3", "ovs_interfaceid": "94b5f888-d3e5-4acb-b340-176fbc95431d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:41:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d2e84df1-4557-4ee9-82c5-0b523a3c3b88 req-5e4bcf18-7d5b-496c-a621-ab3b13896cc6 service nova] Releasing lock "refresh_cache-a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:41:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-ab918ce9-7366-47aa-820f-09db47ce97f5 req-873cea02-97e3-4729-af0c-5c843efabb9e service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Received event network-vif-plugged-94b5f888-d3e5-4acb-b340-176fbc95431d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:41:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ab918ce9-7366-47aa-820f-09db47ce97f5 req-873cea02-97e3-4729-af0c-5c843efabb9e service nova] Acquiring lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ab918ce9-7366-47aa-820f-09db47ce97f5 req-873cea02-97e3-4729-af0c-5c843efabb9e service nova] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ab918ce9-7366-47aa-820f-09db47ce97f5 req-873cea02-97e3-4729-af0c-5c843efabb9e service nova] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-ab918ce9-7366-47aa-820f-09db47ce97f5 req-873cea02-97e3-4729-af0c-5c843efabb9e service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] No waiting events found dispatching network-vif-plugged-94b5f888-d3e5-4acb-b340-176fbc95431d {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:41:24 user nova-compute[70243]: WARNING nova.compute.manager [req-ab918ce9-7366-47aa-820f-09db47ce97f5 req-873cea02-97e3-4729-af0c-5c843efabb9e service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Received unexpected event network-vif-plugged-94b5f888-d3e5-4acb-b340-176fbc95431d for instance with vm_state building and task_state spawning.
Jul 24 16:41:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:25 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216885.6541967, a7bfe8dc-9f4f-44b4-95d4-e2b069774a11 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:41:25 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] VM Resumed (Lifecycle Event)
Jul 24 16:41:25 user nova-compute[70243]: DEBUG nova.compute.manager [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:41:25 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:41:25 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Instance spawned successfully.
Jul 24 16:41:25 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:41:25 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:41:25 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:41:25 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:41:25 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:41:25 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:41:25 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:41:25 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:41:25 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:41:25 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:41:25 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216885.6581573, a7bfe8dc-9f4f-44b4-95d4-e2b069774a11 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:41:25 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] VM Started (Lifecycle Event)
Jul 24 16:41:25 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:41:25 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:41:25 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:41:25 user nova-compute[70243]: INFO nova.compute.manager [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Took 6.71 seconds to spawn the instance on the hypervisor.
Jul 24 16:41:25 user nova-compute[70243]: DEBUG nova.compute.manager [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:41:25 user nova-compute[70243]: INFO nova.compute.manager [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Took 7.50 seconds to build instance.
Jul 24 16:41:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-eeb48146-475c-4e7e-a131-3ed300516bb1 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.597s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-be9d2b2c-5b7d-4ca6-9a99-5ec14f2b3ce4 req-b9cdd4e7-334c-445d-a1a5-23e8c45d88ac service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Received event network-vif-plugged-94b5f888-d3e5-4acb-b340-176fbc95431d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:41:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-be9d2b2c-5b7d-4ca6-9a99-5ec14f2b3ce4 req-b9cdd4e7-334c-445d-a1a5-23e8c45d88ac service nova] Acquiring lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-be9d2b2c-5b7d-4ca6-9a99-5ec14f2b3ce4 req-b9cdd4e7-334c-445d-a1a5-23e8c45d88ac service nova] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-be9d2b2c-5b7d-4ca6-9a99-5ec14f2b3ce4 req-b9cdd4e7-334c-445d-a1a5-23e8c45d88ac service nova] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-be9d2b2c-5b7d-4ca6-9a99-5ec14f2b3ce4 req-b9cdd4e7-334c-445d-a1a5-23e8c45d88ac service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] No waiting events found dispatching network-vif-plugged-94b5f888-d3e5-4acb-b340-176fbc95431d {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:41:26 user nova-compute[70243]: WARNING nova.compute.manager [req-be9d2b2c-5b7d-4ca6-9a99-5ec14f2b3ce4 req-b9cdd4e7-334c-445d-a1a5-23e8c45d88ac service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Received unexpected event network-vif-plugged-94b5f888-d3e5-4acb-b340-176fbc95431d for instance with vm_state active and task_state None.
Jul 24 16:41:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Acquiring lock "b77a2e65-7abb-42ee-ae10-f8df46b93078" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "b77a2e65-7abb-42ee-ae10-f8df46b93078" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Acquiring lock "b77a2e65-7abb-42ee-ae10-f8df46b93078-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "b77a2e65-7abb-42ee-ae10-f8df46b93078-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "b77a2e65-7abb-42ee-ae10-f8df46b93078-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:26 user nova-compute[70243]: INFO nova.compute.manager [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Terminating instance
Jul 24 16:41:26 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:41:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-4fff5b6a-9fae-4995-946d-d3377f65a7d7 req-1c027faa-2a07-4412-ae0c-6eca6eb0bab8 service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Received event network-vif-unplugged-c5651f32-74b1-4cb2-82bc-d8a5e9049502 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:41:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4fff5b6a-9fae-4995-946d-d3377f65a7d7 req-1c027faa-2a07-4412-ae0c-6eca6eb0bab8 service nova] Acquiring lock "b77a2e65-7abb-42ee-ae10-f8df46b93078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4fff5b6a-9fae-4995-946d-d3377f65a7d7 req-1c027faa-2a07-4412-ae0c-6eca6eb0bab8 service nova] Lock "b77a2e65-7abb-42ee-ae10-f8df46b93078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4fff5b6a-9fae-4995-946d-d3377f65a7d7 req-1c027faa-2a07-4412-ae0c-6eca6eb0bab8 service nova] Lock "b77a2e65-7abb-42ee-ae10-f8df46b93078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-4fff5b6a-9fae-4995-946d-d3377f65a7d7 req-1c027faa-2a07-4412-ae0c-6eca6eb0bab8 service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] No waiting events found dispatching network-vif-unplugged-c5651f32-74b1-4cb2-82bc-d8a5e9049502 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:41:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-4fff5b6a-9fae-4995-946d-d3377f65a7d7 req-1c027faa-2a07-4412-ae0c-6eca6eb0bab8 service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Received event network-vif-unplugged-c5651f32-74b1-4cb2-82bc-d8a5e9049502 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:41:27 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Instance destroyed successfully.
Jul 24 16:41:27 user nova-compute[70243]: DEBUG nova.objects.instance [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lazy-loading 'resources' on Instance uuid b77a2e65-7abb-42ee-ae10-f8df46b93078 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:41:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:38:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1161803364',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1161803364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1161803',id=36,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXOK59YsXzBNrFm9i748sRhrqud7Kwk5+TYK3kd0geCWTWumJEYFl0OfzfIU5BGO15EMabBuWFZLtfoF4SF2+gMsWHEMcZeH5IG90XkGC0Yo4vOzh0w/MZOwfKI8aARyQ==',key_name='tempest-keypair-930806319',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:38:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba424603ae5749a9aa59cb0360dc9d9c',ramdisk_id='',reservation_id='r-kj0vcokv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1695730546',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='875f54352894419b90a0d2ad337ab1e3',uuid=b77a2e65-7abb-42ee-ae10-f8df46b93078,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5651f32-74b1-4cb2-82bc-d8a5e9049502", "address": "fa:16:3e:ba:5c:ac", "network": {"id": "69dc6b7b-bfde-4a33-b2ad-950c352fbaf6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-455133887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba424603ae5749a9aa59cb0360dc9d9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5651f32-74", "ovs_interfaceid": "c5651f32-74b1-4cb2-82bc-d8a5e9049502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:41:27 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Converting VIF {"id": "c5651f32-74b1-4cb2-82bc-d8a5e9049502", "address": "fa:16:3e:ba:5c:ac", "network": {"id": "69dc6b7b-bfde-4a33-b2ad-950c352fbaf6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-455133887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba424603ae5749a9aa59cb0360dc9d9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5651f32-74", "ovs_interfaceid": "c5651f32-74b1-4cb2-82bc-d8a5e9049502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:41:27 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:5c:ac,bridge_name='br-int',has_traffic_filtering=True,id=c5651f32-74b1-4cb2-82bc-d8a5e9049502,network=Network(69dc6b7b-bfde-4a33-b2ad-950c352fbaf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5651f32-74') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:41:27 user nova-compute[70243]: DEBUG os_vif [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:5c:ac,bridge_name='br-int',has_traffic_filtering=True,id=c5651f32-74b1-4cb2-82bc-d8a5e9049502,network=Network(69dc6b7b-bfde-4a33-b2ad-950c352fbaf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5651f32-74') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:41:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5651f32-74, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:41:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:27 user nova-compute[70243]: INFO os_vif [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:5c:ac,bridge_name='br-int',has_traffic_filtering=True,id=c5651f32-74b1-4cb2-82bc-d8a5e9049502,network=Network(69dc6b7b-bfde-4a33-b2ad-950c352fbaf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5651f32-74')
Jul 24 16:41:27 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Deleting instance files /opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078_del
Jul 24 16:41:27 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Deletion of /opt/stack/data/nova/instances/b77a2e65-7abb-42ee-ae10-f8df46b93078_del complete
Jul 24 16:41:27 user nova-compute[70243]: INFO nova.compute.manager [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Took 0.99 seconds to destroy the instance on the hypervisor.
Jul 24 16:41:27 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:41:27 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:41:27 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:41:28 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:41:28 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Took 0.85 seconds to deallocate network for instance.
Jul 24 16:41:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-e3b1560f-c3fb-4be1-8485-3bf0b3183ffc req-c8c8b968-67ad-4ce3-b53b-0ad8ecae6552 service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Received event network-vif-deleted-c5651f32-74b1-4cb2-82bc-d8a5e9049502 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:41:28 user nova-compute[70243]: INFO nova.compute.manager [req-e3b1560f-c3fb-4be1-8485-3bf0b3183ffc req-c8c8b968-67ad-4ce3-b53b-0ad8ecae6552 service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Neutron deleted interface c5651f32-74b1-4cb2-82bc-d8a5e9049502; detaching it from the instance and deleting it from the info cache
Jul 24 16:41:28 user nova-compute[70243]: DEBUG nova.network.neutron [req-e3b1560f-c3fb-4be1-8485-3bf0b3183ffc req-c8c8b968-67ad-4ce3-b53b-0ad8ecae6552 service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:41:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-e3b1560f-c3fb-4be1-8485-3bf0b3183ffc req-c8c8b968-67ad-4ce3-b53b-0ad8ecae6552 service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Detach interface failed, port_id=c5651f32-74b1-4cb2-82bc-d8a5e9049502, reason: Instance b77a2e65-7abb-42ee-ae10-f8df46b93078 could not be found. {{(pid=70243) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 16:41:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:28 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:41:28 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:41:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:28 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Deleted allocations for instance b77a2e65-7abb-42ee-ae10-f8df46b93078
Jul 24 16:41:29 user nova-compute[70243]: DEBUG nova.compute.manager [req-19114de1-5940-4c9b-8b12-dc1bb011ea9c req-d588ccf2-e475-4f8b-aaf3-e852d55af903 service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Received event network-vif-plugged-c5651f32-74b1-4cb2-82bc-d8a5e9049502 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:41:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-19114de1-5940-4c9b-8b12-dc1bb011ea9c req-d588ccf2-e475-4f8b-aaf3-e852d55af903 service nova] Acquiring lock "b77a2e65-7abb-42ee-ae10-f8df46b93078-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-19114de1-5940-4c9b-8b12-dc1bb011ea9c req-d588ccf2-e475-4f8b-aaf3-e852d55af903 service nova] Lock "b77a2e65-7abb-42ee-ae10-f8df46b93078-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-19114de1-5940-4c9b-8b12-dc1bb011ea9c req-d588ccf2-e475-4f8b-aaf3-e852d55af903 service nova] Lock "b77a2e65-7abb-42ee-ae10-f8df46b93078-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:29 user nova-compute[70243]: DEBUG nova.compute.manager [req-19114de1-5940-4c9b-8b12-dc1bb011ea9c req-d588ccf2-e475-4f8b-aaf3-e852d55af903 service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] No waiting events found dispatching network-vif-plugged-c5651f32-74b1-4cb2-82bc-d8a5e9049502 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:41:29 user nova-compute[70243]: WARNING nova.compute.manager [req-19114de1-5940-4c9b-8b12-dc1bb011ea9c req-d588ccf2-e475-4f8b-aaf3-e852d55af903 service nova] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Received unexpected event network-vif-plugged-c5651f32-74b1-4cb2-82bc-d8a5e9049502 for instance with vm_state deleted and task_state None.
Jul 24 16:41:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ab3d1b37-6d12-459b-863c-eaf61dd3c6a8 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546 tempest-TestServerVolumeAttachScenarioOldVersion-1695730546-project-member] Lock "b77a2e65-7abb-42ee-ae10-f8df46b93078" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.347s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:32 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:36 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216881.0397518, 00fec25c-8982-4a40-80ae-11d0936e10a0 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:41:36 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] VM Stopped (Lifecycle Event)
Jul 24 16:41:36 user nova-compute[70243]: DEBUG nova.compute.manager [None req-55e0a3bb-1e31-4cc6-9901-e78ff454f0f2 None None] [instance: 00fec25c-8982-4a40-80ae-11d0936e10a0] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:41:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:41:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:42 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216887.5439157, b77a2e65-7abb-42ee-ae10-f8df46b93078 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:41:42 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] VM Stopped (Lifecycle Event)
Jul 24 16:41:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d28a01b1-2cdf-4583-a8a9-7d4bd9f4cee1 None None] [instance: b77a2e65-7abb-42ee-ae10-f8df46b93078] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:41:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "6f2258de-6b31-48af-81df-37b64da4ca99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "6f2258de-6b31-48af-81df-37b64da4ca99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:51 user nova-compute[70243]: INFO nova.compute.manager [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Terminating instance
Jul 24 16:41:51 user nova-compute[70243]: DEBUG nova.compute.manager [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:41:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:52 user nova-compute[70243]: DEBUG nova.compute.manager [req-978f4a18-48e0-4858-a973-356e66dbe42d req-2101de18-6bc5-43f5-b52c-078098dd73fa service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Received event network-vif-unplugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:41:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-978f4a18-48e0-4858-a973-356e66dbe42d req-2101de18-6bc5-43f5-b52c-078098dd73fa service nova] Acquiring lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-978f4a18-48e0-4858-a973-356e66dbe42d req-2101de18-6bc5-43f5-b52c-078098dd73fa service nova] Lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:52 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-978f4a18-48e0-4858-a973-356e66dbe42d req-2101de18-6bc5-43f5-b52c-078098dd73fa service nova] Lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:52 user nova-compute[70243]: DEBUG nova.compute.manager [req-978f4a18-48e0-4858-a973-356e66dbe42d req-2101de18-6bc5-43f5-b52c-078098dd73fa service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] No waiting events found dispatching network-vif-unplugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:41:52 user nova-compute[70243]: DEBUG nova.compute.manager [req-978f4a18-48e0-4858-a973-356e66dbe42d req-2101de18-6bc5-43f5-b52c-078098dd73fa service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Received event network-vif-unplugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:41:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:52 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Instance destroyed successfully.
Jul 24 16:41:52 user nova-compute[70243]: DEBUG nova.objects.instance [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'resources' on Instance uuid 6f2258de-6b31-48af-81df-37b64da4ca99 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:41:52 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:25:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-394931060',display_name='tempest-ServerRescueNegativeTestJSON-server-394931060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-394931060',id=19,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:27:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c25474ae9fb49cb92c611e77f2dbc79',ramdisk_id='',reservation_id='r-s6khqx0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1414931075',owner_user_name='tempest-ServerRescueNegativeTestJSON-1414931075-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:27:38Z,user_data=None,user_id='fcb7fb5c11bb4d65b9c39923840685c6',uuid=6f2258de-6b31-48af-81df-37b64da4ca99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "address": "fa:16:3e:d4:bf:cd", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a2f7cb-1b", "ovs_interfaceid": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:41:52 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converting VIF {"id": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "address": "fa:16:3e:d4:bf:cd", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a2f7cb-1b", "ovs_interfaceid": "38a2f7cb-1b7b-48c1-8bb5-2ae805783d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:41:52 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:bf:cd,bridge_name='br-int',has_traffic_filtering=True,id=38a2f7cb-1b7b-48c1-8bb5-2ae805783d61,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a2f7cb-1b') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:41:52 user nova-compute[70243]: DEBUG os_vif [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:bf:cd,bridge_name='br-int',has_traffic_filtering=True,id=38a2f7cb-1b7b-48c1-8bb5-2ae805783d61,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a2f7cb-1b') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:41:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38a2f7cb-1b, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:41:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:41:52 user nova-compute[70243]: INFO os_vif [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:bf:cd,bridge_name='br-int',has_traffic_filtering=True,id=38a2f7cb-1b7b-48c1-8bb5-2ae805783d61,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a2f7cb-1b')
Jul 24 16:41:52 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Deleting instance files /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99_del
Jul 24 16:41:52 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Deletion of /opt/stack/data/nova/instances/6f2258de-6b31-48af-81df-37b64da4ca99_del complete
Jul 24 16:41:52 user nova-compute[70243]: INFO nova.compute.manager [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Took 0.95 seconds to destroy the instance on the hypervisor.
Jul 24 16:41:52 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:41:52 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:41:52 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:41:53 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:41:53 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Took 0.78 seconds to deallocate network for instance.
Jul 24 16:41:53 user nova-compute[70243]: DEBUG nova.compute.manager [req-85421c21-8e98-4ecb-aae2-c55d475e9575 req-1a5c6607-0c74-457a-badb-028dec6b5b8d service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Received event network-vif-deleted-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:41:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:53 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:41:53 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:41:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:53 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Deleted allocations for instance 6f2258de-6b31-48af-81df-37b64da4ca99
Jul 24 16:41:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-20455c8f-393a-46c0-a8e0-8cc0074ffc9f tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "6f2258de-6b31-48af-81df-37b64da4ca99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.286s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:54 user nova-compute[70243]: DEBUG nova.compute.manager [req-a4df84e0-b3f0-4e73-934e-4bb908e850e9 req-ad360e4b-5830-4e48-96a3-dd848d67b1ea service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Received event network-vif-plugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:41:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a4df84e0-b3f0-4e73-934e-4bb908e850e9 req-ad360e4b-5830-4e48-96a3-dd848d67b1ea service nova] Acquiring lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:41:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a4df84e0-b3f0-4e73-934e-4bb908e850e9 req-ad360e4b-5830-4e48-96a3-dd848d67b1ea service nova] Lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:41:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a4df84e0-b3f0-4e73-934e-4bb908e850e9 req-ad360e4b-5830-4e48-96a3-dd848d67b1ea service nova] Lock "6f2258de-6b31-48af-81df-37b64da4ca99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:41:54 user nova-compute[70243]: DEBUG nova.compute.manager [req-a4df84e0-b3f0-4e73-934e-4bb908e850e9 req-ad360e4b-5830-4e48-96a3-dd848d67b1ea service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] No waiting events found dispatching network-vif-plugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:41:54 user nova-compute[70243]: WARNING nova.compute.manager [req-a4df84e0-b3f0-4e73-934e-4bb908e850e9 req-ad360e4b-5830-4e48-96a3-dd848d67b1ea service nova] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Received unexpected event network-vif-plugged-38a2f7cb-1b7b-48c1-8bb5-2ae805783d61 for instance with vm_state deleted and task_state None.
Jul 24 16:41:54 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:41:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:56 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:41:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:41:58 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:41:59 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:42:00 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:42:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:42:01 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:42:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:42:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-100c6ba5-de96-4c2a-ae0c-9d3a9199948c" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:42:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-100c6ba5-de96-4c2a-ae0c-9d3a9199948c" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:42:01 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:42:01 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Updating instance_info_cache with network_info: [{"id": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "address": "fa:16:3e:03:1c:93", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ce0c89-39", "ovs_interfaceid": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:42:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-100c6ba5-de96-4c2a-ae0c-9d3a9199948c" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:42:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:42:02 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:42:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:42:04 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:42:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:42:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:42:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:42:04 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:42:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7bfe8dc-9f4f-44b4-95d4-e2b069774a11/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:42:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7bfe8dc-9f4f-44b4-95d4-e2b069774a11/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:42:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7bfe8dc-9f4f-44b4-95d4-e2b069774a11/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:42:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7bfe8dc-9f4f-44b4-95d4-e2b069774a11/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:42:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:42:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:42:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:42:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:42:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:42:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:42:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:42:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:42:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:42:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c896761-df6a-4f4a-87dd-c5ea30641a89/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:42:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c896761-df6a-4f4a-87dd-c5ea30641a89/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:42:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c896761-df6a-4f4a-87dd-c5ea30641a89/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:42:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c896761-df6a-4f4a-87dd-c5ea30641a89/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:42:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:42:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:42:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:42:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:42:06 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:42:06 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:42:06 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8083MB free_disk=24.11174774169922GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:42:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:42:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:42:06 user nova-compute[70243]: INFO nova.compute.manager [None req-58094519-37b0-421a-9aaa-0295d6c52271 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Unrescuing
Jul 24 16:42:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-58094519-37b0-421a-9aaa-0295d6c52271 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "refresh_cache-8c896761-df6a-4f4a-87dd-c5ea30641a89" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:42:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-58094519-37b0-421a-9aaa-0295d6c52271 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquired lock "refresh_cache-8c896761-df6a-4f4a-87dd-c5ea30641a89" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:42:06 user nova-compute[70243]: DEBUG nova.network.neutron [None req-58094519-37b0-421a-9aaa-0295d6c52271 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:42:06 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 50fecb3a-8f06-4822-8c84-76df51acfe50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:42:06 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 75b26864-1539-4106-b741-3b3f5c7e898a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:42:06 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 100c6ba5-de96-4c2a-ae0c-9d3a9199948c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:42:06 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8c896761-df6a-4f4a-87dd-c5ea30641a89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:42:06 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance a7bfe8dc-9f4f-44b4-95d4-e2b069774a11 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:42:06 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:42:06 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:42:06 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:42:06 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:42:06 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:42:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:42:06 user nova-compute[70243]: DEBUG nova.network.neutron [None req-58094519-37b0-421a-9aaa-0295d6c52271 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Updating instance_info_cache with network_info: [{"id": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "address": "fa:16:3e:a5:da:73", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa5a7d4-ef", "ovs_interfaceid": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:42:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-58094519-37b0-421a-9aaa-0295d6c52271 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Releasing lock "refresh_cache-8c896761-df6a-4f4a-87dd-c5ea30641a89" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:42:06 user nova-compute[70243]: DEBUG nova.objects.instance [None req-58094519-37b0-421a-9aaa-0295d6c52271 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'flavor' on Instance uuid 8c896761-df6a-4f4a-87dd-c5ea30641a89 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:42:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:07 user nova-compute[70243]: DEBUG nova.compute.manager [req-068eb0d3-4e3f-44d4-b8e0-12412671d061 req-aa2291cc-a690-4796-9441-4de64716bf18 service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received event network-vif-unplugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:42:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-068eb0d3-4e3f-44d4-b8e0-12412671d061 req-aa2291cc-a690-4796-9441-4de64716bf18 service nova] Acquiring lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:42:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-068eb0d3-4e3f-44d4-b8e0-12412671d061 req-aa2291cc-a690-4796-9441-4de64716bf18 service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:42:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-068eb0d3-4e3f-44d4-b8e0-12412671d061 req-aa2291cc-a690-4796-9441-4de64716bf18 service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:42:07 user nova-compute[70243]: DEBUG nova.compute.manager [req-068eb0d3-4e3f-44d4-b8e0-12412671d061 req-aa2291cc-a690-4796-9441-4de64716bf18 service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] No waiting events found dispatching network-vif-unplugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:42:07 user nova-compute[70243]: WARNING nova.compute.manager [req-068eb0d3-4e3f-44d4-b8e0-12412671d061 req-aa2291cc-a690-4796-9441-4de64716bf18 service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received unexpected event network-vif-unplugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 for instance with vm_state rescued and task_state unrescuing.
Jul 24 16:42:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:07 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:42:07 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216912.5899906, 6f2258de-6b31-48af-81df-37b64da4ca99 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:42:07 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] VM Stopped (Lifecycle Event)
Jul 24 16:42:07 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:42:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d2227df6-a0ab-4cba-941a-9c11053f1a5a None None] [instance: 6f2258de-6b31-48af-81df-37b64da4ca99] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:42:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:07 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Instance destroyed successfully.
Jul 24 16:42:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-0642d046-9f17-4860-9898-0e29f85abf17 req-f1686705-b39c-4fe5-b205-f218e3e5e63d service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received event network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:42:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0642d046-9f17-4860-9898-0e29f85abf17 req-f1686705-b39c-4fe5-b205-f218e3e5e63d service nova] Acquiring lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:42:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0642d046-9f17-4860-9898-0e29f85abf17 req-f1686705-b39c-4fe5-b205-f218e3e5e63d service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:42:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0642d046-9f17-4860-9898-0e29f85abf17 req-f1686705-b39c-4fe5-b205-f218e3e5e63d service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:42:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-0642d046-9f17-4860-9898-0e29f85abf17 req-f1686705-b39c-4fe5-b205-f218e3e5e63d service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] No waiting events found dispatching network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:42:09 user nova-compute[70243]: WARNING nova.compute.manager [req-0642d046-9f17-4860-9898-0e29f85abf17 req-f1686705-b39c-4fe5-b205-f218e3e5e63d service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received unexpected event network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 for instance with vm_state rescued and task_state unrescuing.
Jul 24 16:42:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-0642d046-9f17-4860-9898-0e29f85abf17 req-f1686705-b39c-4fe5-b205-f218e3e5e63d service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received event network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:42:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0642d046-9f17-4860-9898-0e29f85abf17 req-f1686705-b39c-4fe5-b205-f218e3e5e63d service nova] Acquiring lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:42:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0642d046-9f17-4860-9898-0e29f85abf17 req-f1686705-b39c-4fe5-b205-f218e3e5e63d service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:42:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0642d046-9f17-4860-9898-0e29f85abf17 req-f1686705-b39c-4fe5-b205-f218e3e5e63d service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:42:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-0642d046-9f17-4860-9898-0e29f85abf17 req-f1686705-b39c-4fe5-b205-f218e3e5e63d service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] No waiting events found dispatching network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:42:09 user nova-compute[70243]: WARNING nova.compute.manager [req-0642d046-9f17-4860-9898-0e29f85abf17 req-f1686705-b39c-4fe5-b205-f218e3e5e63d service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received unexpected event network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 for instance with vm_state rescued and task_state unrescuing.
Jul 24 16:42:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Removed pending event for 8c896761-df6a-4f4a-87dd-c5ea30641a89 due to event {{(pid=70243) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 16:42:11 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216931.0938084, 8c896761-df6a-4f4a-87dd-c5ea30641a89 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:42:11 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] VM Resumed (Lifecycle Event)
Jul 24 16:42:11 user nova-compute[70243]: DEBUG nova.compute.manager [None req-58094519-37b0-421a-9aaa-0295d6c52271 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:42:11 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:42:11 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:42:11 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690216931.095274, 8c896761-df6a-4f4a-87dd-c5ea30641a89 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:42:11 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] VM Started (Lifecycle Event)
Jul 24 16:42:11 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:42:11 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:42:11 user nova-compute[70243]: DEBUG nova.compute.manager [req-2de201c8-d0c8-48d2-843b-760b3cda0b32 req-5a470777-da91-4625-baa6-24f36588cde3 service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received event network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:42:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2de201c8-d0c8-48d2-843b-760b3cda0b32 req-5a470777-da91-4625-baa6-24f36588cde3 service nova] Acquiring lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:42:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2de201c8-d0c8-48d2-843b-760b3cda0b32 req-5a470777-da91-4625-baa6-24f36588cde3 service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:42:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2de201c8-d0c8-48d2-843b-760b3cda0b32 req-5a470777-da91-4625-baa6-24f36588cde3 service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:42:11 user nova-compute[70243]: DEBUG nova.compute.manager [req-2de201c8-d0c8-48d2-843b-760b3cda0b32 req-5a470777-da91-4625-baa6-24f36588cde3 service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] No waiting events found dispatching network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:42:11 user nova-compute[70243]: WARNING nova.compute.manager [req-2de201c8-d0c8-48d2-843b-760b3cda0b32 req-5a470777-da91-4625-baa6-24f36588cde3 service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received unexpected event network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 for instance with vm_state active and task_state None.
Jul 24 16:42:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "75b26864-1539-4106-b741-3b3f5c7e898a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:42:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:42:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "75b26864-1539-4106-b741-3b3f5c7e898a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:42:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:42:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:42:12 user nova-compute[70243]: INFO nova.compute.manager [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Terminating instance
Jul 24 16:42:12 user nova-compute[70243]: DEBUG nova.compute.manager [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:42:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:13 user nova-compute[70243]: DEBUG nova.compute.manager [req-8c1011c1-766f-4bfb-8802-afc3b4d2eca2 req-8d601d77-dd19-473f-bba4-bc3c56b7d347 service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Received event network-vif-unplugged-885f4554-aa56-4402-a61c-dd97f720d0fe {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:42:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8c1011c1-766f-4bfb-8802-afc3b4d2eca2 req-8d601d77-dd19-473f-bba4-bc3c56b7d347 service nova] Acquiring lock "75b26864-1539-4106-b741-3b3f5c7e898a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:42:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8c1011c1-766f-4bfb-8802-afc3b4d2eca2 req-8d601d77-dd19-473f-bba4-bc3c56b7d347 service nova] Lock "75b26864-1539-4106-b741-3b3f5c7e898a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:42:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8c1011c1-766f-4bfb-8802-afc3b4d2eca2 req-8d601d77-dd19-473f-bba4-bc3c56b7d347 service nova] Lock "75b26864-1539-4106-b741-3b3f5c7e898a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:42:13 user nova-compute[70243]: DEBUG nova.compute.manager [req-8c1011c1-766f-4bfb-8802-afc3b4d2eca2 req-8d601d77-dd19-473f-bba4-bc3c56b7d347 service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] No waiting events found dispatching network-vif-unplugged-885f4554-aa56-4402-a61c-dd97f720d0fe {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:42:13 user nova-compute[70243]: DEBUG nova.compute.manager [req-8c1011c1-766f-4bfb-8802-afc3b4d2eca2 req-8d601d77-dd19-473f-bba4-bc3c56b7d347 service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Received event network-vif-unplugged-885f4554-aa56-4402-a61c-dd97f720d0fe for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:42:13 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Instance destroyed successfully.
Jul 24 16:42:13 user nova-compute[70243]: DEBUG nova.objects.instance [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lazy-loading 'resources' on Instance uuid 75b26864-1539-4106-b741-3b3f5c7e898a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:42:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-710720691',display_name='tempest-SnapshotDataIntegrityTests-server-710720691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-710720691',id=31,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGrsslzNHkm/l035QP8brFXojPaCGqpMNYRGZskY81NUFwTVIjLpt6FbNleiiDftXlM36f234Lqz3fNof9toAO1JGPoJx9NT8g0tLnFfDFD0Z6Wg7Jt0bqxmdDbh12c0g==',key_name='tempest-keypair-2018840211',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:35:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6955ddcb9e244a1beb243d63596cada',ramdisk_id='',reservation_id='r-0uefodcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-118169928',owner_user_name='tempest-SnapshotDataIntegrityTests-118169928-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:35:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19ffbd1cce754a8a83772a76205e34fc',uuid=75b26864-1539-4106-b741-3b3f5c7e898a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "885f4554-aa56-4402-a61c-dd97f720d0fe", "address": "fa:16:3e:81:5b:1b", "network": {"id": "51126732-2727-4752-b653-16d223e1d827", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-797458544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6955ddcb9e244a1beb243d63596cada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885f4554-aa", "ovs_interfaceid": "885f4554-aa56-4402-a61c-dd97f720d0fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:42:13 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Converting VIF {"id": "885f4554-aa56-4402-a61c-dd97f720d0fe", "address": "fa:16:3e:81:5b:1b", "network": {"id": "51126732-2727-4752-b653-16d223e1d827", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-797458544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6955ddcb9e244a1beb243d63596cada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885f4554-aa", "ovs_interfaceid": "885f4554-aa56-4402-a61c-dd97f720d0fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:42:13 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:5b:1b,bridge_name='br-int',has_traffic_filtering=True,id=885f4554-aa56-4402-a61c-dd97f720d0fe,network=Network(51126732-2727-4752-b653-16d223e1d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap885f4554-aa') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:42:13 user nova-compute[70243]: DEBUG os_vif [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:5b:1b,bridge_name='br-int',has_traffic_filtering=True,id=885f4554-aa56-4402-a61c-dd97f720d0fe,network=Network(51126732-2727-4752-b653-16d223e1d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap885f4554-aa') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:42:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap885f4554-aa, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:42:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:42:13 user nova-compute[70243]: INFO os_vif [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:5b:1b,bridge_name='br-int',has_traffic_filtering=True,id=885f4554-aa56-4402-a61c-dd97f720d0fe,network=Network(51126732-2727-4752-b653-16d223e1d827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap885f4554-aa')
Jul 24 16:42:13 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Deleting instance files /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a_del
Jul 24 16:42:13 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Deletion of /opt/stack/data/nova/instances/75b26864-1539-4106-b741-3b3f5c7e898a_del complete
Jul 24 16:42:13 user nova-compute[70243]: INFO nova.compute.manager [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 24 16:42:13 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:42:13 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:42:13 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:42:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:15 user nova-compute[70243]: DEBUG nova.compute.manager [req-fe3ed8a6-4e32-4433-a3b6-1986e0237efe req-46225c30-3e49-46da-aa75-785f848538fd service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Received event network-vif-plugged-885f4554-aa56-4402-a61c-dd97f720d0fe {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:42:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fe3ed8a6-4e32-4433-a3b6-1986e0237efe req-46225c30-3e49-46da-aa75-785f848538fd service nova] Acquiring lock "75b26864-1539-4106-b741-3b3f5c7e898a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:42:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fe3ed8a6-4e32-4433-a3b6-1986e0237efe req-46225c30-3e49-46da-aa75-785f848538fd service nova] Lock "75b26864-1539-4106-b741-3b3f5c7e898a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:42:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fe3ed8a6-4e32-4433-a3b6-1986e0237efe req-46225c30-3e49-46da-aa75-785f848538fd service nova] Lock "75b26864-1539-4106-b741-3b3f5c7e898a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:42:15 user nova-compute[70243]: DEBUG nova.compute.manager [req-fe3ed8a6-4e32-4433-a3b6-1986e0237efe req-46225c30-3e49-46da-aa75-785f848538fd service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] No waiting events found dispatching network-vif-plugged-885f4554-aa56-4402-a61c-dd97f720d0fe {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:42:15 user nova-compute[70243]: WARNING nova.compute.manager [req-fe3ed8a6-4e32-4433-a3b6-1986e0237efe req-46225c30-3e49-46da-aa75-785f848538fd service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Received unexpected event network-vif-plugged-885f4554-aa56-4402-a61c-dd97f720d0fe for instance with vm_state active and task_state deleting.
Jul 24 16:42:15 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:42:15 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Took 1.92 seconds to deallocate network for instance.
Jul 24 16:42:15 user nova-compute[70243]: DEBUG nova.compute.manager [req-bde920af-999d-43dd-b7b9-571c9cb43f69 req-ca67b1c7-25ab-47b9-8f5a-73dce5854812 service nova] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Received event network-vif-deleted-885f4554-aa56-4402-a61c-dd97f720d0fe {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:42:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:42:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:42:15 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:42:15 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:42:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:42:15 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Deleted allocations for instance 75b26864-1539-4106-b741-3b3f5c7e898a
Jul 24 16:42:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7a185bef-a66e-40b0-95de-4c6900288154 tempest-SnapshotDataIntegrityTests-118169928 tempest-SnapshotDataIntegrityTests-118169928-project-member] Lock "75b26864-1539-4106-b741-3b3f5c7e898a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.287s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:42:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:28 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216933.4619586, 75b26864-1539-4106-b741-3b3f5c7e898a => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:42:28 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] VM Stopped (Lifecycle Event)
Jul 24 16:42:28 user nova-compute[70243]: DEBUG nova.compute.manager [None req-0cadfb6a-df7c-45b7-ae2c-19007b4be63a None None] [instance: 75b26864-1539-4106-b741-3b3f5c7e898a] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:42:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "50fecb3a-8f06-4822-8c84-76df51acfe50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:42:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:42:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:42:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:42:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:42:42 user nova-compute[70243]: INFO nova.compute.manager [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Terminating instance
Jul 24 16:42:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:42:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:42 user nova-compute[70243]: DEBUG nova.compute.manager [req-3eec35fe-cb77-43cd-9eff-04138838995d req-563740e1-2f42-4b06-87b3-8d6e802018f8 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received event network-vif-unplugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:42:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3eec35fe-cb77-43cd-9eff-04138838995d req-563740e1-2f42-4b06-87b3-8d6e802018f8 service nova] Acquiring lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:42:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3eec35fe-cb77-43cd-9eff-04138838995d req-563740e1-2f42-4b06-87b3-8d6e802018f8 service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:42:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3eec35fe-cb77-43cd-9eff-04138838995d req-563740e1-2f42-4b06-87b3-8d6e802018f8 service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:42:42 user nova-compute[70243]: DEBUG nova.compute.manager [req-3eec35fe-cb77-43cd-9eff-04138838995d req-563740e1-2f42-4b06-87b3-8d6e802018f8 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] No waiting events found dispatching network-vif-unplugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:42:42 user nova-compute[70243]: DEBUG nova.compute.manager [req-3eec35fe-cb77-43cd-9eff-04138838995d req-563740e1-2f42-4b06-87b3-8d6e802018f8 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received event network-vif-unplugged-657cc261-2d12-42c2-a879-f8cc121bd811 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:42:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:43 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Instance destroyed successfully.
Jul 24 16:42:43 user nova-compute[70243]: DEBUG nova.objects.instance [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lazy-loading 'resources' on Instance uuid 50fecb3a-8f06-4822-8c84-76df51acfe50 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:42:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1525531413',display_name='tempest-ServerRescueNegativeTestJSON-server-1525531413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1525531413',id=18,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:30:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c25474ae9fb49cb92c611e77f2dbc79',ramdisk_id='',reservation_id='r-yg0b8tqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1414931075',owner_user_name='tempest-ServerRescueNegativeTestJSON-1414931075-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:32:22Z,user_data=None,user_id='fcb7fb5c11bb4d65b9c39923840685c6',uuid=50fecb3a-8f06-4822-8c84-76df51acfe50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "657cc261-2d12-42c2-a879-f8cc121bd811", "address": "fa:16:3e:93:0d:e3", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657cc261-2d", "ovs_interfaceid": "657cc261-2d12-42c2-a879-f8cc121bd811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:42:43 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converting VIF {"id": "657cc261-2d12-42c2-a879-f8cc121bd811", "address": "fa:16:3e:93:0d:e3", "network": {"id": "e404f70f-ea00-4112-9416-f2156ec1b9c2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1040970951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c25474ae9fb49cb92c611e77f2dbc79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657cc261-2d", "ovs_interfaceid": "657cc261-2d12-42c2-a879-f8cc121bd811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:42:43 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:0d:e3,bridge_name='br-int',has_traffic_filtering=True,id=657cc261-2d12-42c2-a879-f8cc121bd811,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657cc261-2d') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:42:43 user nova-compute[70243]: DEBUG os_vif [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:0d:e3,bridge_name='br-int',has_traffic_filtering=True,id=657cc261-2d12-42c2-a879-f8cc121bd811,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657cc261-2d') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:42:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap657cc261-2d, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:42:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:43 user nova-compute[70243]: INFO os_vif [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:0d:e3,bridge_name='br-int',has_traffic_filtering=True,id=657cc261-2d12-42c2-a879-f8cc121bd811,network=Network(e404f70f-ea00-4112-9416-f2156ec1b9c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657cc261-2d')
Jul 24 16:42:43 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Deleting instance files /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50_del
Jul 24 16:42:43 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Deletion of /opt/stack/data/nova/instances/50fecb3a-8f06-4822-8c84-76df51acfe50_del complete
Jul 24 16:42:43 user nova-compute[70243]: INFO nova.compute.manager [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 24 16:42:43 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:42:43 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:42:43 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:42:43 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:42:43 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Took 0.46 seconds to deallocate network for instance.
Jul 24 16:42:43 user nova-compute[70243]: DEBUG nova.compute.manager [req-c12f27b6-7332-4d57-a228-a0930b3232ab req-3d58bf49-77ac-4e1e-b564-5ca3e0b0e3e1 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received event network-vif-deleted-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:42:43 user nova-compute[70243]: INFO nova.compute.manager [req-c12f27b6-7332-4d57-a228-a0930b3232ab req-3d58bf49-77ac-4e1e-b564-5ca3e0b0e3e1 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Neutron deleted interface 657cc261-2d12-42c2-a879-f8cc121bd811; detaching it from the instance and deleting it from the info cache
Jul 24 16:42:43 user nova-compute[70243]: DEBUG nova.network.neutron [req-c12f27b6-7332-4d57-a228-a0930b3232ab req-3d58bf49-77ac-4e1e-b564-5ca3e0b0e3e1 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:42:43 user nova-compute[70243]: DEBUG nova.compute.manager [req-c12f27b6-7332-4d57-a228-a0930b3232ab req-3d58bf49-77ac-4e1e-b564-5ca3e0b0e3e1 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Detach interface failed, port_id=657cc261-2d12-42c2-a879-f8cc121bd811, reason: Instance 50fecb3a-8f06-4822-8c84-76df51acfe50 could not be found. {{(pid=70243) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 16:42:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:42:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:42:44 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:42:44 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:42:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:42:44 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Deleted allocations for instance 50fecb3a-8f06-4822-8c84-76df51acfe50
Jul 24 16:42:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a08a1ed1-7589-4a56-bc91-9b9ae401589b tempest-ServerRescueNegativeTestJSON-1414931075 tempest-ServerRescueNegativeTestJSON-1414931075-project-member] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.745s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:42:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-96b984f4-6bd2-487c-806f-2f7a10e0b21d req-491cc8fa-a593-4392-9021-7139abcedb58 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received event network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:42:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-96b984f4-6bd2-487c-806f-2f7a10e0b21d req-491cc8fa-a593-4392-9021-7139abcedb58 service nova] Acquiring lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:42:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-96b984f4-6bd2-487c-806f-2f7a10e0b21d req-491cc8fa-a593-4392-9021-7139abcedb58 service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:42:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-96b984f4-6bd2-487c-806f-2f7a10e0b21d req-491cc8fa-a593-4392-9021-7139abcedb58 service nova] Lock "50fecb3a-8f06-4822-8c84-76df51acfe50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:42:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-96b984f4-6bd2-487c-806f-2f7a10e0b21d req-491cc8fa-a593-4392-9021-7139abcedb58 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] No waiting events found dispatching network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:42:44 user nova-compute[70243]: WARNING nova.compute.manager [req-96b984f4-6bd2-487c-806f-2f7a10e0b21d req-491cc8fa-a593-4392-9021-7139abcedb58 service nova] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Received unexpected event network-vif-plugged-657cc261-2d12-42c2-a879-f8cc121bd811 for instance with vm_state deleted and task_state None.
Jul 24 16:42:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:42:56 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:42:58 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690216963.237913, 50fecb3a-8f06-4822-8c84-76df51acfe50 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:42:58 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] VM Stopped (Lifecycle Event)
Jul 24 16:42:58 user nova-compute[70243]: DEBUG nova.compute.manager [None req-45562674-e6ce-4b96-8813-5bb7f862bcd9 None None] [instance: 50fecb3a-8f06-4822-8c84-76df51acfe50] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:42:58 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:42:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:42:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:42:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:42:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:42:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:42:59 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:43:00 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:43:02 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:43:02 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:43:02 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Didn't find any instances for network info cache update. {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 16:43:02 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:43:02 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:43:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:04 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:43:04 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:43:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:04 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:43:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:43:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7bfe8dc-9f4f-44b4-95d4-e2b069774a11/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7bfe8dc-9f4f-44b4-95d4-e2b069774a11/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7bfe8dc-9f4f-44b4-95d4-e2b069774a11/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7bfe8dc-9f4f-44b4-95d4-e2b069774a11/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:05 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:43:05 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:43:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8556MB free_disk=24.165489196777344GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:43:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 100c6ba5-de96-4c2a-ae0c-9d3a9199948c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:43:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8c896761-df6a-4f4a-87dd-c5ea30641a89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:43:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance a7bfe8dc-9f4f-44b4-95d4-e2b069774a11 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:43:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:43:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:43:05 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:43:05 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:43:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:43:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:06 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:43:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-1b9bd31d-4e9d-4a6c-9b79-34678067a446 req-e4e5cd44-dd77-430f-9875-640c5313f57b service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Received event network-changed-94b5f888-d3e5-4acb-b340-176fbc95431d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:43:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-1b9bd31d-4e9d-4a6c-9b79-34678067a446 req-e4e5cd44-dd77-430f-9875-640c5313f57b service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Refreshing instance network info cache due to event network-changed-94b5f888-d3e5-4acb-b340-176fbc95431d. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:43:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1b9bd31d-4e9d-4a6c-9b79-34678067a446 req-e4e5cd44-dd77-430f-9875-640c5313f57b service nova] Acquiring lock "refresh_cache-a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:43:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1b9bd31d-4e9d-4a6c-9b79-34678067a446 req-e4e5cd44-dd77-430f-9875-640c5313f57b service nova] Acquired lock "refresh_cache-a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:43:09 user nova-compute[70243]: DEBUG nova.network.neutron [req-1b9bd31d-4e9d-4a6c-9b79-34678067a446 req-e4e5cd44-dd77-430f-9875-640c5313f57b service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Refreshing network info cache for port 94b5f888-d3e5-4acb-b340-176fbc95431d {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:43:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:09 user nova-compute[70243]: DEBUG nova.objects.instance [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lazy-loading 'flavor' on Instance uuid a7bfe8dc-9f4f-44b4-95d4-e2b069774a11 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:43:09 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Ignoring supplied device name: /dev/vdb
Jul 24 16:43:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:09 user nova-compute[70243]: INFO nova.compute.manager [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Attaching volume 9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc to /dev/vdb
Jul 24 16:43:09 user nova-compute[70243]: DEBUG os_brick.utils [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41176b3-ec21-495b-9993-f35c8a0b9e1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafa8f35-1231-4f01-be93-1786c03b4674]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a53b7a-006a-45d5-bfb3-13f7c222f6e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fc7367-0561-459c-920c-9a361b257e00]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:43:10 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:43:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d234773-b26f-4ead-b118-86ab481d2bbc]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG os_brick.utils [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Updating existing volume attachment record: 0f791d9c-3eb5-4807-a9e6-caef31d473d4 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG nova.network.neutron [req-1b9bd31d-4e9d-4a6c-9b79-34678067a446 req-e4e5cd44-dd77-430f-9875-640c5313f57b service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Updated VIF entry in instance network info cache for port 94b5f888-d3e5-4acb-b340-176fbc95431d. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG nova.network.neutron [req-1b9bd31d-4e9d-4a6c-9b79-34678067a446 req-e4e5cd44-dd77-430f-9875-640c5313f57b service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Updating instance_info_cache with network_info: [{"id": "94b5f888-d3e5-4acb-b340-176fbc95431d", "address": "fa:16:3e:03:04:e0", "network": {"id": "e788aa0b-b842-4cad-a50d-605499bef92a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-86978474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fc785066034979ade3e9ef1f3ca27c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b5f888-d3", "ovs_interfaceid": "94b5f888-d3e5-4acb-b340-176fbc95431d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1b9bd31d-4e9d-4a6c-9b79-34678067a446 req-e4e5cd44-dd77-430f-9875-640c5313f57b service nova] Releasing lock "refresh_cache-a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:43:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZnFHRPWk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:43:16 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:43:16 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:43:16 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c07df0-007c-442d-9847-75b96cde3a2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:43:16 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d92268b-dc98-4640-9451-9d1e777ad069]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc] added
Jul 24 16:43:16 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a38331-3c54-4139-8b1b-c8e1ec3b2dbb]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9da8cee-2f5c-48f3-a141-fd21e48e20dd]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZnFHRPWk {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZnFHRPWk" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[59595371-36de-4e83-baa3-3e04d3c15768]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZnFHRPWk'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ddee1e-94b3-4aa7-8302-9eb26897259d]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7068d7-2104-4161-a1f3-727e811dfb1d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:43:16 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:43:16 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1252eb1-4b14-4c3d-85d9-adc3bb25b99b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc, portal: 172.16.0.220,3260]
Jul 24 16:43:16 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc, portal: 172.16.0.220,3260] successful.
Jul 24 16:43:16 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb2c5d5-b262-4b96-8448-76004c8a510b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2699cc-1a43-4e32-bca7-d9aa692f17d1]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:43:16 user nova-compute[70243]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc (non-flash)
Jul 24 16:43:16 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:43:16 user nova-compute[70243]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc (non-flash)
Jul 24 16:43:16 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4800480d-7e86-4cb0-8d83-795d00acdcba]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:43:16 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZnFHRPWk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:43:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:43:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23263313635333061', 'path': '/dev/sdb'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:43:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263313635333061', 'path': '/dev/sdb'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:43:17 user nova-compute[70243]: DEBUG nova.objects.instance [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lazy-loading 'flavor' on Instance uuid a7bfe8dc-9f4f-44b4-95d4-e2b069774a11 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:43:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:43:17 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:43:17 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:43:17 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:43:17 user nova-compute[70243]:   <serial>9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc</serial>
Jul 24 16:43:17 user nova-compute[70243]: </disk>
Jul 24 16:43:17 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:43:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:43:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:43:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] No VIF found with MAC fa:16:3e:03:04:e0, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:43:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2897f182-832b-4b4a-9ce5-58731336ca6e tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.181s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:43:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Acquiring lock "98a87000-0c6d-456e-af2e-4a987968cec5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "98a87000-0c6d-456e-af2e-4a987968cec5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:44 user nova-compute[70243]: DEBUG nova.compute.manager [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:43:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:44 user nova-compute[70243]: INFO nova.compute.manager [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Detaching volume 9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc
Jul 24 16:43:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:44 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:43:44 user nova-compute[70243]: INFO nova.compute.claims [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Claim successful on node user
Jul 24 16:43:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:44 user nova-compute[70243]: INFO nova.virt.block_device [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Attempting to driver detach volume 9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc from mountpoint /dev/vdb
Jul 24 16:43:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Attempting to detach device vdb from instance a7bfe8dc-9f4f-44b4-95d4-e2b069774a11 from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:43:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:43:44 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:43:44 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:43:44 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:43:44 user nova-compute[70243]:   <serial>9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc</serial>
Jul 24 16:43:44 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:43:44 user nova-compute[70243]: </disk>
Jul 24 16:43:44 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:43:44 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Successfully detached device vdb from instance a7bfe8dc-9f4f-44b4-95d4-e2b069774a11 from the persistent domain config.
Jul 24 16:43:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a7bfe8dc-9f4f-44b4-95d4-e2b069774a11 from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:43:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:43:44 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:43:44 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:43:44 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:43:44 user nova-compute[70243]:   <serial>9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc</serial>
Jul 24 16:43:44 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:43:44 user nova-compute[70243]: </disk>
Jul 24 16:43:44 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:43:44 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:43:44 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:43:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:44 user nova-compute[70243]: DEBUG nova.compute.manager [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:43:44 user nova-compute[70243]: DEBUG nova.compute.manager [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:43:44 user nova-compute[70243]: DEBUG nova.network.neutron [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:43:44 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:43:44 user nova-compute[70243]: DEBUG nova.compute.manager [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG nova.policy [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd85dab5b3c84255b3d784cfeed397c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4884b7eb022949d298aa11ee84a03ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG nova.compute.manager [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:43:45 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Creating image(s)
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Acquiring lock "/opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "/opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "/opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690217025.1550999, a7bfe8dc-9f4f-44b4-95d4-e2b069774a11 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a7bfe8dc-9f4f-44b4-95d4-e2b069774a11 {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:43:45 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Successfully detached device vdb from instance a7bfe8dc-9f4f-44b4-95d4-e2b069774a11 from the live domain config.
Jul 24 16:43:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZnFHRPWk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:43:45 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:43:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad4e9df-7e31-4be1-a246-4d1f34022d85]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:43:45 user nova-compute[70243]: No targets found.
Jul 24 16:43:45 user nova-compute[70243]: iSNS:
Jul 24 16:43:45 user nova-compute[70243]: No targets found.
Jul 24 16:43:45 user nova-compute[70243]: STATIC:
Jul 24 16:43:45 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc
Jul 24 16:43:45 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:43:45 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:43:45 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3
Jul 24 16:43:45 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:43:45 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:43:45 user nova-compute[70243]: FIRMWARE:
Jul 24 16:43:45 user nova-compute[70243]: No targets found.
Jul 24 16:43:45 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:43:45 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:43:45 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[73116c26-bbf4-40b6-9e70-c3bce6e884bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a447378-6683-4589-bd4c-5b8ce184f5d6]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:43:45 user nova-compute[70243]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc (non-flash)
Jul 24 16:43:45 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:43:45 user nova-compute[70243]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc (non-flash)
Jul 24 16:43:45 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc136680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc'): ({'sdb'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Removing single pathed devices sdb {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[200b2c57-5f6d-4f58-a12b-ee5d353d7d61]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b25f1c-2005-436e-970f-9363b1da644e]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Flushing IO for device /dev/sdb {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk 1073741824" returned: 0 in 0.054s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f0296e-65d7-4aac-bf34-62687ae5c253]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6268779-b69a-43e1-b0e7-7bb59fd8e700]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa02b45d-c828-46f0-920f-d969f9a222e2]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.134s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f1ef9a-7894-49e8-ba08-a9e12d6a9803]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc, portal: 172.16.0.220,3260]
Jul 24 16:43:45 user nova-compute[70243]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc, portal: 172.16.0.220,3260] successful.
Jul 24 16:43:45 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be35266-f691-4050-a3ab-49d26732a346]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] <== disconnect_volume: return (413ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG nova.network.neutron [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Successfully created port: c99192e2-c6e1-457d-959a-af1fc5c081ea {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Cannot resize image /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG nova.objects.instance [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lazy-loading 'migration_context' on Instance uuid 98a87000-0c6d-456e-af2e-4a987968cec5 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Ensure instance console log exists: /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG nova.network.neutron [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Successfully updated port: c99192e2-c6e1-457d-959a-af1fc5c081ea {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG nova.compute.manager [req-fd7f7384-6880-4100-b8fc-b4b0c73f11b9 req-517456af-bc70-436e-9766-c49f07a8e9e5 service nova] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Received event network-changed-c99192e2-c6e1-457d-959a-af1fc5c081ea {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG nova.compute.manager [req-fd7f7384-6880-4100-b8fc-b4b0c73f11b9 req-517456af-bc70-436e-9766-c49f07a8e9e5 service nova] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Refreshing instance network info cache due to event network-changed-c99192e2-c6e1-457d-959a-af1fc5c081ea. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd7f7384-6880-4100-b8fc-b4b0c73f11b9 req-517456af-bc70-436e-9766-c49f07a8e9e5 service nova] Acquiring lock "refresh_cache-98a87000-0c6d-456e-af2e-4a987968cec5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd7f7384-6880-4100-b8fc-b4b0c73f11b9 req-517456af-bc70-436e-9766-c49f07a8e9e5 service nova] Acquired lock "refresh_cache-98a87000-0c6d-456e-af2e-4a987968cec5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG nova.network.neutron [req-fd7f7384-6880-4100-b8fc-b4b0c73f11b9 req-517456af-bc70-436e-9766-c49f07a8e9e5 service nova] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Refreshing network info cache for port c99192e2-c6e1-457d-959a-af1fc5c081ea {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Acquiring lock "refresh_cache-98a87000-0c6d-456e-af2e-4a987968cec5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG nova.network.neutron [req-fd7f7384-6880-4100-b8fc-b4b0c73f11b9 req-517456af-bc70-436e-9766-c49f07a8e9e5 service nova] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG nova.network.neutron [req-fd7f7384-6880-4100-b8fc-b4b0c73f11b9 req-517456af-bc70-436e-9766-c49f07a8e9e5 service nova] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fd7f7384-6880-4100-b8fc-b4b0c73f11b9 req-517456af-bc70-436e-9766-c49f07a8e9e5 service nova] Releasing lock "refresh_cache-98a87000-0c6d-456e-af2e-4a987968cec5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Acquired lock "refresh_cache-98a87000-0c6d-456e-af2e-4a987968cec5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG nova.network.neutron [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG nova.objects.instance [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lazy-loading 'flavor' on Instance uuid a7bfe8dc-9f4f-44b4-95d4-e2b069774a11 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ce9c9873-603d-4771-bfa5-66eede435863 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.254s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.140s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:46 user nova-compute[70243]: INFO nova.compute.manager [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Terminating instance
Jul 24 16:43:46 user nova-compute[70243]: DEBUG nova.compute.manager [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG nova.network.neutron [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:46 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:47 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Instance destroyed successfully.
Jul 24 16:43:47 user nova-compute[70243]: DEBUG nova.objects.instance [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lazy-loading 'resources' on Instance uuid a7bfe8dc-9f4f-44b4-95d4-e2b069774a11 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:41:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1548118009',display_name='tempest-VolumesSnapshotTestJSON-instance-1548118009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1548118009',id=37,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZYxkI4I2wSdTpX5uzBhKey2J/JPSpqosdI7tkQSJhqKF4POjN+dITwRF/Al6I6yGGsQYYqR2Aog7k02tWdicGOjOWEc8m7Ha6RgPyruL5HdvPuf0F99AYx+ZixHTs1TQ==',key_name='tempest-keypair-1075488614',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:41:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2fc785066034979ade3e9ef1f3ca27c',ramdisk_id='',reservation_id='r-9p1u7wml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1620979851',owner_user_name='tempest-VolumesSnapshotTestJSON-1620979851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97ec28618df24ff19401d02c0ca3c1a2',uuid=a7bfe8dc-9f4f-44b4-95d4-e2b069774a11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94b5f888-d3e5-4acb-b340-176fbc95431d", "address": "fa:16:3e:03:04:e0", "network": {"id": "e788aa0b-b842-4cad-a50d-605499bef92a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-86978474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fc785066034979ade3e9ef1f3ca27c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b5f888-d3", "ovs_interfaceid": "94b5f888-d3e5-4acb-b340-176fbc95431d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Converting VIF {"id": "94b5f888-d3e5-4acb-b340-176fbc95431d", "address": "fa:16:3e:03:04:e0", "network": {"id": "e788aa0b-b842-4cad-a50d-605499bef92a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-86978474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fc785066034979ade3e9ef1f3ca27c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b5f888-d3", "ovs_interfaceid": "94b5f888-d3e5-4acb-b340-176fbc95431d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:04:e0,bridge_name='br-int',has_traffic_filtering=True,id=94b5f888-d3e5-4acb-b340-176fbc95431d,network=Network(e788aa0b-b842-4cad-a50d-605499bef92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b5f888-d3') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG os_vif [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:04:e0,bridge_name='br-int',has_traffic_filtering=True,id=94b5f888-d3e5-4acb-b340-176fbc95431d,network=Network(e788aa0b-b842-4cad-a50d-605499bef92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b5f888-d3') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94b5f888-d3, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:43:47 user nova-compute[70243]: INFO os_vif [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:04:e0,bridge_name='br-int',has_traffic_filtering=True,id=94b5f888-d3e5-4acb-b340-176fbc95431d,network=Network(e788aa0b-b842-4cad-a50d-605499bef92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b5f888-d3')
Jul 24 16:43:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZnFHRPWk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:43:47 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:43:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6474024-2295-4ffa-8b7e-0246627631f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:43:47 user nova-compute[70243]: No targets found.
Jul 24 16:43:47 user nova-compute[70243]: iSNS:
Jul 24 16:43:47 user nova-compute[70243]: No targets found.
Jul 24 16:43:47 user nova-compute[70243]: STATIC:
Jul 24 16:43:47 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3
Jul 24 16:43:47 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:43:47 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:43:47 user nova-compute[70243]: FIRMWARE:
Jul 24 16:43:47 user nova-compute[70243]: No targets found.
Jul 24 16:43:47 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:43:47 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:43:47 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e96f7c3-8fd3-4df3-a9e8-bfec66ee7cfc', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc6cce6-a5ef-4ce5-a043-a165c1a7008b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c805564b-ed26-49eb-b405-b8b2e869439a]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:43:47 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:43:47 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc164dc0>, {}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Disconnecting from: [] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] <== disconnect_volume: return (74ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:43:47 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Deleting instance files /opt/stack/data/nova/instances/a7bfe8dc-9f4f-44b4-95d4-e2b069774a11_del
Jul 24 16:43:47 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Deletion of /opt/stack/data/nova/instances/a7bfe8dc-9f4f-44b4-95d4-e2b069774a11_del complete
Jul 24 16:43:47 user nova-compute[70243]: INFO nova.compute.manager [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 24 16:43:47 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:43:47 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.network.neutron [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Updating instance_info_cache with network_info: [{"id": "c99192e2-c6e1-457d-959a-af1fc5c081ea", "address": "fa:16:3e:c4:97:6b", "network": {"id": "99653fe8-b4ff-4412-a691-fe3efeaebfb4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-172568374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4884b7eb022949d298aa11ee84a03ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99192e2-c6", "ovs_interfaceid": "c99192e2-c6e1-457d-959a-af1fc5c081ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Releasing lock "refresh_cache-98a87000-0c6d-456e-af2e-4a987968cec5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.compute.manager [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Instance network_info: |[{"id": "c99192e2-c6e1-457d-959a-af1fc5c081ea", "address": "fa:16:3e:c4:97:6b", "network": {"id": "99653fe8-b4ff-4412-a691-fe3efeaebfb4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-172568374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4884b7eb022949d298aa11ee84a03ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99192e2-c6", "ovs_interfaceid": "c99192e2-c6e1-457d-959a-af1fc5c081ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Start _get_guest_xml network_info=[{"id": "c99192e2-c6e1-457d-959a-af1fc5c081ea", "address": "fa:16:3e:c4:97:6b", "network": {"id": "99653fe8-b4ff-4412-a691-fe3efeaebfb4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-172568374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4884b7eb022949d298aa11ee84a03ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99192e2-c6", "ovs_interfaceid": "c99192e2-c6e1-457d-959a-af1fc5c081ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:43:48 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:43:48 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:43:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:43:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1881039386',display_name='tempest-ServersNegativeTestJSON-server-1881039386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1881039386',id=38,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4884b7eb022949d298aa11ee84a03ec9',ramdisk_id='',reservation_id='r-jodi91ja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-851329711',owner_user_name='tempest-ServersNegativeTestJSON-851329711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:43:45Z,user_data=None,user_id='cd85dab5b3c84255b3d784cfeed397c3',uuid=98a87000-0c6d-456e-af2e-4a987968cec5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c99192e2-c6e1-457d-959a-af1fc5c081ea", "address": "fa:16:3e:c4:97:6b", "network": {"id": "99653fe8-b4ff-4412-a691-fe3efeaebfb4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-172568374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4884b7eb022949d298aa11ee84a03ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99192e2-c6", "ovs_interfaceid": "c99192e2-c6e1-457d-959a-af1fc5c081ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Converting VIF {"id": "c99192e2-c6e1-457d-959a-af1fc5c081ea", "address": "fa:16:3e:c4:97:6b", "network": {"id": "99653fe8-b4ff-4412-a691-fe3efeaebfb4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-172568374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4884b7eb022949d298aa11ee84a03ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99192e2-c6", "ovs_interfaceid": "c99192e2-c6e1-457d-959a-af1fc5c081ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:97:6b,bridge_name='br-int',has_traffic_filtering=True,id=c99192e2-c6e1-457d-959a-af1fc5c081ea,network=Network(99653fe8-b4ff-4412-a691-fe3efeaebfb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99192e2-c6') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.objects.instance [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lazy-loading 'pci_devices' on Instance uuid 98a87000-0c6d-456e-af2e-4a987968cec5 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:43:48 user nova-compute[70243]:   <uuid>98a87000-0c6d-456e-af2e-4a987968cec5</uuid>
Jul 24 16:43:48 user nova-compute[70243]:   <name>instance-00000026</name>
Jul 24 16:43:48 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:43:48 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:43:48 user nova-compute[70243]:   <metadata>
Jul 24 16:43:48 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:43:48 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:43:48 user nova-compute[70243]:       <nova:name>tempest-ServersNegativeTestJSON-server-1881039386</nova:name>
Jul 24 16:43:48 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:43:48</nova:creationTime>
Jul 24 16:43:48 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:43:48 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:43:48 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:43:48 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:43:48 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:43:48 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:43:48 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:43:48 user nova-compute[70243]:       <nova:owner>
Jul 24 16:43:48 user nova-compute[70243]:         <nova:user uuid="cd85dab5b3c84255b3d784cfeed397c3">tempest-ServersNegativeTestJSON-851329711-project-member</nova:user>
Jul 24 16:43:48 user nova-compute[70243]:         <nova:project uuid="4884b7eb022949d298aa11ee84a03ec9">tempest-ServersNegativeTestJSON-851329711</nova:project>
Jul 24 16:43:48 user nova-compute[70243]:       </nova:owner>
Jul 24 16:43:48 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:43:48 user nova-compute[70243]:       <nova:ports>
Jul 24 16:43:48 user nova-compute[70243]:         <nova:port uuid="c99192e2-c6e1-457d-959a-af1fc5c081ea">
Jul 24 16:43:48 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 24 16:43:48 user nova-compute[70243]:         </nova:port>
Jul 24 16:43:48 user nova-compute[70243]:       </nova:ports>
Jul 24 16:43:48 user nova-compute[70243]:     </nova:instance>
Jul 24 16:43:48 user nova-compute[70243]:   </metadata>
Jul 24 16:43:48 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:43:48 user nova-compute[70243]:     <system>
Jul 24 16:43:48 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:43:48 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:43:48 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:43:48 user nova-compute[70243]:       <entry name="serial">98a87000-0c6d-456e-af2e-4a987968cec5</entry>
Jul 24 16:43:48 user nova-compute[70243]:       <entry name="uuid">98a87000-0c6d-456e-af2e-4a987968cec5</entry>
Jul 24 16:43:48 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:43:48 user nova-compute[70243]:     </system>
Jul 24 16:43:48 user nova-compute[70243]:   </sysinfo>
Jul 24 16:43:48 user nova-compute[70243]:   <os>
Jul 24 16:43:48 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:43:48 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:43:48 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:43:48 user nova-compute[70243]:   </os>
Jul 24 16:43:48 user nova-compute[70243]:   <features>
Jul 24 16:43:48 user nova-compute[70243]:     <acpi/>
Jul 24 16:43:48 user nova-compute[70243]:     <apic/>
Jul 24 16:43:48 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:43:48 user nova-compute[70243]:   </features>
Jul 24 16:43:48 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:43:48 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:43:48 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:43:48 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:43:48 user nova-compute[70243]:   </clock>
Jul 24 16:43:48 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:43:48 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:43:48 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:43:48 user nova-compute[70243]:   </cpu>
Jul 24 16:43:48 user nova-compute[70243]:   <devices>
Jul 24 16:43:48 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:43:48 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:43:48 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk"/>
Jul 24 16:43:48 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:43:48 user nova-compute[70243]:     </disk>
Jul 24 16:43:48 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:43:48 user nova-compute[70243]:       <mac address="fa:16:3e:c4:97:6b"/>
Jul 24 16:43:48 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:43:48 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:43:48 user nova-compute[70243]:       <target dev="tapc99192e2-c6"/>
Jul 24 16:43:48 user nova-compute[70243]:     </interface>
Jul 24 16:43:48 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:43:48 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/console.log" append="off"/>
Jul 24 16:43:48 user nova-compute[70243]:     </serial>
Jul 24 16:43:48 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:43:48 user nova-compute[70243]:     <video>
Jul 24 16:43:48 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:43:48 user nova-compute[70243]:     </video>
Jul 24 16:43:48 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:43:48 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:43:48 user nova-compute[70243]:     </rng>
Jul 24 16:43:48 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:43:48 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:43:48 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:43:48 user nova-compute[70243]:     </memballoon>
Jul 24 16:43:48 user nova-compute[70243]:   </devices>
Jul 24 16:43:48 user nova-compute[70243]: </domain>
Jul 24 16:43:48 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:43:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1881039386',display_name='tempest-ServersNegativeTestJSON-server-1881039386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1881039386',id=38,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4884b7eb022949d298aa11ee84a03ec9',ramdisk_id='',reservation_id='r-jodi91ja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-851329711',owner_user_name='tempest-ServersNegativeTestJSON-851329711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:43:45Z,user_data=None,user_id='cd85dab5b3c84255b3d784cfeed397c3',uuid=98a87000-0c6d-456e-af2e-4a987968cec5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c99192e2-c6e1-457d-959a-af1fc5c081ea", "address": "fa:16:3e:c4:97:6b", "network": {"id": "99653fe8-b4ff-4412-a691-fe3efeaebfb4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-172568374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4884b7eb022949d298aa11ee84a03ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99192e2-c6", "ovs_interfaceid": "c99192e2-c6e1-457d-959a-af1fc5c081ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Converting VIF {"id": "c99192e2-c6e1-457d-959a-af1fc5c081ea", "address": "fa:16:3e:c4:97:6b", "network": {"id": "99653fe8-b4ff-4412-a691-fe3efeaebfb4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-172568374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4884b7eb022949d298aa11ee84a03ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99192e2-c6", "ovs_interfaceid": "c99192e2-c6e1-457d-959a-af1fc5c081ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:97:6b,bridge_name='br-int',has_traffic_filtering=True,id=c99192e2-c6e1-457d-959a-af1fc5c081ea,network=Network(99653fe8-b4ff-4412-a691-fe3efeaebfb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99192e2-c6') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG os_vif [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:97:6b,bridge_name='br-int',has_traffic_filtering=True,id=c99192e2-c6e1-457d-959a-af1fc5c081ea,network=Network(99653fe8-b4ff-4412-a691-fe3efeaebfb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99192e2-c6') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc99192e2-c6, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc99192e2-c6, col_values=(('external_ids', {'iface-id': 'c99192e2-c6e1-457d-959a-af1fc5c081ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:97:6b', 'vm-uuid': '98a87000-0c6d-456e-af2e-4a987968cec5'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:48 user nova-compute[70243]: INFO os_vif [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:97:6b,bridge_name='br-int',has_traffic_filtering=True,id=c99192e2-c6e1-457d-959a-af1fc5c081ea,network=Network(99653fe8-b4ff-4412-a691-fe3efeaebfb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99192e2-c6')
Jul 24 16:43:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] No VIF found with MAC fa:16:3e:c4:97:6b, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.compute.manager [req-374745bd-f50c-4743-9938-128ba0cbdbda req-352602f5-de5a-44a2-9944-8f96c8b06ccc service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Received event network-vif-unplugged-94b5f888-d3e5-4acb-b340-176fbc95431d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-374745bd-f50c-4743-9938-128ba0cbdbda req-352602f5-de5a-44a2-9944-8f96c8b06ccc service nova] Acquiring lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-374745bd-f50c-4743-9938-128ba0cbdbda req-352602f5-de5a-44a2-9944-8f96c8b06ccc service nova] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-374745bd-f50c-4743-9938-128ba0cbdbda req-352602f5-de5a-44a2-9944-8f96c8b06ccc service nova] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.compute.manager [req-374745bd-f50c-4743-9938-128ba0cbdbda req-352602f5-de5a-44a2-9944-8f96c8b06ccc service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] No waiting events found dispatching network-vif-unplugged-94b5f888-d3e5-4acb-b340-176fbc95431d {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.compute.manager [req-374745bd-f50c-4743-9938-128ba0cbdbda req-352602f5-de5a-44a2-9944-8f96c8b06ccc service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Received event network-vif-unplugged-94b5f888-d3e5-4acb-b340-176fbc95431d for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.compute.manager [req-374745bd-f50c-4743-9938-128ba0cbdbda req-352602f5-de5a-44a2-9944-8f96c8b06ccc service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Received event network-vif-plugged-94b5f888-d3e5-4acb-b340-176fbc95431d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-374745bd-f50c-4743-9938-128ba0cbdbda req-352602f5-de5a-44a2-9944-8f96c8b06ccc service nova] Acquiring lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-374745bd-f50c-4743-9938-128ba0cbdbda req-352602f5-de5a-44a2-9944-8f96c8b06ccc service nova] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-374745bd-f50c-4743-9938-128ba0cbdbda req-352602f5-de5a-44a2-9944-8f96c8b06ccc service nova] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.compute.manager [req-374745bd-f50c-4743-9938-128ba0cbdbda req-352602f5-de5a-44a2-9944-8f96c8b06ccc service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] No waiting events found dispatching network-vif-plugged-94b5f888-d3e5-4acb-b340-176fbc95431d {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:43:48 user nova-compute[70243]: WARNING nova.compute.manager [req-374745bd-f50c-4743-9938-128ba0cbdbda req-352602f5-de5a-44a2-9944-8f96c8b06ccc service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Received unexpected event network-vif-plugged-94b5f888-d3e5-4acb-b340-176fbc95431d for instance with vm_state active and task_state deleting.
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.compute.manager [req-374745bd-f50c-4743-9938-128ba0cbdbda req-352602f5-de5a-44a2-9944-8f96c8b06ccc service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Received event network-vif-plugged-94b5f888-d3e5-4acb-b340-176fbc95431d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-374745bd-f50c-4743-9938-128ba0cbdbda req-352602f5-de5a-44a2-9944-8f96c8b06ccc service nova] Acquiring lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-374745bd-f50c-4743-9938-128ba0cbdbda req-352602f5-de5a-44a2-9944-8f96c8b06ccc service nova] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-374745bd-f50c-4743-9938-128ba0cbdbda req-352602f5-de5a-44a2-9944-8f96c8b06ccc service nova] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.compute.manager [req-374745bd-f50c-4743-9938-128ba0cbdbda req-352602f5-de5a-44a2-9944-8f96c8b06ccc service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] No waiting events found dispatching network-vif-plugged-94b5f888-d3e5-4acb-b340-176fbc95431d {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:43:48 user nova-compute[70243]: WARNING nova.compute.manager [req-374745bd-f50c-4743-9938-128ba0cbdbda req-352602f5-de5a-44a2-9944-8f96c8b06ccc service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Received unexpected event network-vif-plugged-94b5f888-d3e5-4acb-b340-176fbc95431d for instance with vm_state active and task_state deleting.
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:43:48 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Took 1.01 seconds to deallocate network for instance.
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.compute.manager [req-1b0a9978-15a1-46ee-bfe3-13214ff87cd8 req-40d65686-158a-4f41-b7fd-ff9ff71c74b0 service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Received event network-vif-deleted-94b5f888-d3e5-4acb-b340-176fbc95431d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:43:48 user nova-compute[70243]: WARNING nova.volume.cinder [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Attachment 0f791d9c-3eb5-4807-a9e6-caef31d473d4 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 0f791d9c-3eb5-4807-a9e6-caef31d473d4. (HTTP 404) (Request-ID: req-97133151-6987-45af-9e59-26cd5fe630e4)
Jul 24 16:43:48 user nova-compute[70243]: INFO nova.compute.manager [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Took 0.02 seconds to detach 1 volumes for instance.
Jul 24 16:43:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:43:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:49 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Deleted allocations for instance a7bfe8dc-9f4f-44b4-95d4-e2b069774a11
Jul 24 16:43:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-17fef9bc-a41c-49f5-a821-0f4ba17f3f72 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.327s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:49 user nova-compute[70243]: DEBUG nova.compute.manager [req-2c94020d-bfba-47c6-a8ad-e2a2046c85b7 req-37a34e02-7abf-4ef2-aaa0-ac01733816e3 service nova] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Received event network-vif-plugged-c99192e2-c6e1-457d-959a-af1fc5c081ea {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:43:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2c94020d-bfba-47c6-a8ad-e2a2046c85b7 req-37a34e02-7abf-4ef2-aaa0-ac01733816e3 service nova] Acquiring lock "98a87000-0c6d-456e-af2e-4a987968cec5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2c94020d-bfba-47c6-a8ad-e2a2046c85b7 req-37a34e02-7abf-4ef2-aaa0-ac01733816e3 service nova] Lock "98a87000-0c6d-456e-af2e-4a987968cec5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2c94020d-bfba-47c6-a8ad-e2a2046c85b7 req-37a34e02-7abf-4ef2-aaa0-ac01733816e3 service nova] Lock "98a87000-0c6d-456e-af2e-4a987968cec5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:49 user nova-compute[70243]: DEBUG nova.compute.manager [req-2c94020d-bfba-47c6-a8ad-e2a2046c85b7 req-37a34e02-7abf-4ef2-aaa0-ac01733816e3 service nova] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] No waiting events found dispatching network-vif-plugged-c99192e2-c6e1-457d-959a-af1fc5c081ea {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:43:49 user nova-compute[70243]: WARNING nova.compute.manager [req-2c94020d-bfba-47c6-a8ad-e2a2046c85b7 req-37a34e02-7abf-4ef2-aaa0-ac01733816e3 service nova] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Received unexpected event network-vif-plugged-c99192e2-c6e1-457d-959a-af1fc5c081ea for instance with vm_state building and task_state spawning.
Jul 24 16:43:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:50 user nova-compute[70243]: DEBUG nova.compute.manager [req-443668ee-dcfe-4e84-957a-2902c6a5ff7b req-2abe0986-d479-4652-a124-0da233e0b21e service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Received event network-vif-plugged-94b5f888-d3e5-4acb-b340-176fbc95431d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:43:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-443668ee-dcfe-4e84-957a-2902c6a5ff7b req-2abe0986-d479-4652-a124-0da233e0b21e service nova] Acquiring lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-443668ee-dcfe-4e84-957a-2902c6a5ff7b req-2abe0986-d479-4652-a124-0da233e0b21e service nova] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-443668ee-dcfe-4e84-957a-2902c6a5ff7b req-2abe0986-d479-4652-a124-0da233e0b21e service nova] Lock "a7bfe8dc-9f4f-44b4-95d4-e2b069774a11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:50 user nova-compute[70243]: DEBUG nova.compute.manager [req-443668ee-dcfe-4e84-957a-2902c6a5ff7b req-2abe0986-d479-4652-a124-0da233e0b21e service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] No waiting events found dispatching network-vif-plugged-94b5f888-d3e5-4acb-b340-176fbc95431d {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:43:50 user nova-compute[70243]: WARNING nova.compute.manager [req-443668ee-dcfe-4e84-957a-2902c6a5ff7b req-2abe0986-d479-4652-a124-0da233e0b21e service nova] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Received unexpected event network-vif-plugged-94b5f888-d3e5-4acb-b340-176fbc95431d for instance with vm_state deleted and task_state None.
Jul 24 16:43:51 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217031.6063414, 98a87000-0c6d-456e-af2e-4a987968cec5 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:43:51 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] VM Resumed (Lifecycle Event)
Jul 24 16:43:51 user nova-compute[70243]: DEBUG nova.compute.manager [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:43:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:43:51 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Instance spawned successfully.
Jul 24 16:43:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:43:51 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:43:51 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:43:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:43:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:43:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:43:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:43:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:43:51 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:43:51 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:43:51 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217031.6095462, 98a87000-0c6d-456e-af2e-4a987968cec5 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:43:51 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] VM Started (Lifecycle Event)
Jul 24 16:43:51 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:43:51 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:43:51 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:43:51 user nova-compute[70243]: INFO nova.compute.manager [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Took 6.67 seconds to spawn the instance on the hypervisor.
Jul 24 16:43:51 user nova-compute[70243]: DEBUG nova.compute.manager [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:43:51 user nova-compute[70243]: INFO nova.compute.manager [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Took 7.29 seconds to build instance.
Jul 24 16:43:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-640efbc9-8462-4280-8ad1-89962983844f tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "98a87000-0c6d-456e-af2e-4a987968cec5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.382s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:51 user nova-compute[70243]: DEBUG nova.compute.manager [req-6c4a7aaa-14d0-4d11-8d43-8c8a17ef8916 req-764664c2-1930-46d7-b72a-e022385cf277 service nova] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Received event network-vif-plugged-c99192e2-c6e1-457d-959a-af1fc5c081ea {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:43:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6c4a7aaa-14d0-4d11-8d43-8c8a17ef8916 req-764664c2-1930-46d7-b72a-e022385cf277 service nova] Acquiring lock "98a87000-0c6d-456e-af2e-4a987968cec5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6c4a7aaa-14d0-4d11-8d43-8c8a17ef8916 req-764664c2-1930-46d7-b72a-e022385cf277 service nova] Lock "98a87000-0c6d-456e-af2e-4a987968cec5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6c4a7aaa-14d0-4d11-8d43-8c8a17ef8916 req-764664c2-1930-46d7-b72a-e022385cf277 service nova] Lock "98a87000-0c6d-456e-af2e-4a987968cec5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:51 user nova-compute[70243]: DEBUG nova.compute.manager [req-6c4a7aaa-14d0-4d11-8d43-8c8a17ef8916 req-764664c2-1930-46d7-b72a-e022385cf277 service nova] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] No waiting events found dispatching network-vif-plugged-c99192e2-c6e1-457d-959a-af1fc5c081ea {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:43:51 user nova-compute[70243]: WARNING nova.compute.manager [req-6c4a7aaa-14d0-4d11-8d43-8c8a17ef8916 req-764664c2-1930-46d7-b72a-e022385cf277 service nova] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Received unexpected event network-vif-plugged-c99192e2-c6e1-457d-959a-af1fc5c081ea for instance with vm_state active and task_state None.
Jul 24 16:43:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:57 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:43:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "ae152306-9bc0-47a4-b438-2dde63652863" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "ae152306-9bc0-47a4-b438-2dde63652863" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:57 user nova-compute[70243]: DEBUG nova.compute.manager [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:43:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:57 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:43:57 user nova-compute[70243]: INFO nova.compute.claims [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Claim successful on node user
Jul 24 16:43:58 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG nova.compute.manager [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG nova.compute.manager [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG nova.network.neutron [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:43:58 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:43:58 user nova-compute[70243]: DEBUG nova.compute.manager [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG nova.policy [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae306b319e8c4e61b0a73933dc5c330c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06cf84dc406343afa81260614acc8fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG nova.compute.manager [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:43:58 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Creating image(s)
Jul 24 16:43:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "/opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "/opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk 1073741824" returned: 0 in 0.063s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.151s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:43:58 user nova-compute[70243]: DEBUG nova.network.neutron [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Successfully created port: 0a2f88c3-b6c3-4dc9-9247-f14603933043 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:43:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:43:59 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Cannot resize image /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:43:59 user nova-compute[70243]: DEBUG nova.objects.instance [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'migration_context' on Instance uuid ae152306-9bc0-47a4-b438-2dde63652863 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:43:59 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:43:59 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Ensure instance console log exists: /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:43:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:43:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:43:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:43:59 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:43:59 user nova-compute[70243]: DEBUG nova.network.neutron [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Successfully updated port: 0a2f88c3-b6c3-4dc9-9247-f14603933043 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:43:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "refresh_cache-ae152306-9bc0-47a4-b438-2dde63652863" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:43:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquired lock "refresh_cache-ae152306-9bc0-47a4-b438-2dde63652863" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:43:59 user nova-compute[70243]: DEBUG nova.network.neutron [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:43:59 user nova-compute[70243]: DEBUG nova.compute.manager [req-1973d1fd-a734-4f7f-a1cb-61881f5768ce req-031b6b02-ddbb-48f5-a6ba-df02028dd0be service nova] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Received event network-changed-0a2f88c3-b6c3-4dc9-9247-f14603933043 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:43:59 user nova-compute[70243]: DEBUG nova.compute.manager [req-1973d1fd-a734-4f7f-a1cb-61881f5768ce req-031b6b02-ddbb-48f5-a6ba-df02028dd0be service nova] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Refreshing instance network info cache due to event network-changed-0a2f88c3-b6c3-4dc9-9247-f14603933043. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:43:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1973d1fd-a734-4f7f-a1cb-61881f5768ce req-031b6b02-ddbb-48f5-a6ba-df02028dd0be service nova] Acquiring lock "refresh_cache-ae152306-9bc0-47a4-b438-2dde63652863" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:43:59 user nova-compute[70243]: DEBUG nova.network.neutron [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.network.neutron [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Updating instance_info_cache with network_info: [{"id": "0a2f88c3-b6c3-4dc9-9247-f14603933043", "address": "fa:16:3e:54:a5:20", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2f88c3-b6", "ovs_interfaceid": "0a2f88c3-b6c3-4dc9-9247-f14603933043", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Releasing lock "refresh_cache-ae152306-9bc0-47a4-b438-2dde63652863" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Instance network_info: |[{"id": "0a2f88c3-b6c3-4dc9-9247-f14603933043", "address": "fa:16:3e:54:a5:20", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2f88c3-b6", "ovs_interfaceid": "0a2f88c3-b6c3-4dc9-9247-f14603933043", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1973d1fd-a734-4f7f-a1cb-61881f5768ce req-031b6b02-ddbb-48f5-a6ba-df02028dd0be service nova] Acquired lock "refresh_cache-ae152306-9bc0-47a4-b438-2dde63652863" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.network.neutron [req-1973d1fd-a734-4f7f-a1cb-61881f5768ce req-031b6b02-ddbb-48f5-a6ba-df02028dd0be service nova] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Refreshing network info cache for port 0a2f88c3-b6c3-4dc9-9247-f14603933043 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Start _get_guest_xml network_info=[{"id": "0a2f88c3-b6c3-4dc9-9247-f14603933043", "address": "fa:16:3e:54:a5:20", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2f88c3-b6", "ovs_interfaceid": "0a2f88c3-b6c3-4dc9-9247-f14603933043", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:44:00 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:44:00 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:43:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-82290159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-82290159',id=39,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06cf84dc406343afa81260614acc8fdd',ramdisk_id='',reservation_id='r-uxfpsxy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:43:58Z,user_data=None,user_id='ae306b319e8c4e61b0a73933dc5c330c',uuid=ae152306-9bc0-47a4-b438-2dde63652863,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a2f88c3-b6c3-4dc9-9247-f14603933043", "address": "fa:16:3e:54:a5:20", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2f88c3-b6", "ovs_interfaceid": "0a2f88c3-b6c3-4dc9-9247-f14603933043", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converting VIF {"id": "0a2f88c3-b6c3-4dc9-9247-f14603933043", "address": "fa:16:3e:54:a5:20", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2f88c3-b6", "ovs_interfaceid": "0a2f88c3-b6c3-4dc9-9247-f14603933043", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:a5:20,bridge_name='br-int',has_traffic_filtering=True,id=0a2f88c3-b6c3-4dc9-9247-f14603933043,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a2f88c3-b6') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.objects.instance [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'pci_devices' on Instance uuid ae152306-9bc0-47a4-b438-2dde63652863 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:44:00 user nova-compute[70243]:   <uuid>ae152306-9bc0-47a4-b438-2dde63652863</uuid>
Jul 24 16:44:00 user nova-compute[70243]:   <name>instance-00000027</name>
Jul 24 16:44:00 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:44:00 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:44:00 user nova-compute[70243]:   <metadata>
Jul 24 16:44:00 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:44:00 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:44:00 user nova-compute[70243]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-82290159</nova:name>
Jul 24 16:44:00 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:44:00</nova:creationTime>
Jul 24 16:44:00 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:44:00 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:44:00 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:44:00 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:44:00 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:44:00 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:44:00 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:44:00 user nova-compute[70243]:       <nova:owner>
Jul 24 16:44:00 user nova-compute[70243]:         <nova:user uuid="ae306b319e8c4e61b0a73933dc5c330c">tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member</nova:user>
Jul 24 16:44:00 user nova-compute[70243]:         <nova:project uuid="06cf84dc406343afa81260614acc8fdd">tempest-ServerBootFromVolumeStableRescueTest-1579673828</nova:project>
Jul 24 16:44:00 user nova-compute[70243]:       </nova:owner>
Jul 24 16:44:00 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:44:00 user nova-compute[70243]:       <nova:ports>
Jul 24 16:44:00 user nova-compute[70243]:         <nova:port uuid="0a2f88c3-b6c3-4dc9-9247-f14603933043">
Jul 24 16:44:00 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 16:44:00 user nova-compute[70243]:         </nova:port>
Jul 24 16:44:00 user nova-compute[70243]:       </nova:ports>
Jul 24 16:44:00 user nova-compute[70243]:     </nova:instance>
Jul 24 16:44:00 user nova-compute[70243]:   </metadata>
Jul 24 16:44:00 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:44:00 user nova-compute[70243]:     <system>
Jul 24 16:44:00 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:44:00 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:44:00 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:44:00 user nova-compute[70243]:       <entry name="serial">ae152306-9bc0-47a4-b438-2dde63652863</entry>
Jul 24 16:44:00 user nova-compute[70243]:       <entry name="uuid">ae152306-9bc0-47a4-b438-2dde63652863</entry>
Jul 24 16:44:00 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:44:00 user nova-compute[70243]:     </system>
Jul 24 16:44:00 user nova-compute[70243]:   </sysinfo>
Jul 24 16:44:00 user nova-compute[70243]:   <os>
Jul 24 16:44:00 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:44:00 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:44:00 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:44:00 user nova-compute[70243]:   </os>
Jul 24 16:44:00 user nova-compute[70243]:   <features>
Jul 24 16:44:00 user nova-compute[70243]:     <acpi/>
Jul 24 16:44:00 user nova-compute[70243]:     <apic/>
Jul 24 16:44:00 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:44:00 user nova-compute[70243]:   </features>
Jul 24 16:44:00 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:44:00 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:44:00 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:44:00 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:44:00 user nova-compute[70243]:   </clock>
Jul 24 16:44:00 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:44:00 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:44:00 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:44:00 user nova-compute[70243]:   </cpu>
Jul 24 16:44:00 user nova-compute[70243]:   <devices>
Jul 24 16:44:00 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:44:00 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:44:00 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk"/>
Jul 24 16:44:00 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:44:00 user nova-compute[70243]:     </disk>
Jul 24 16:44:00 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:44:00 user nova-compute[70243]:       <mac address="fa:16:3e:54:a5:20"/>
Jul 24 16:44:00 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:44:00 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:44:00 user nova-compute[70243]:       <target dev="tap0a2f88c3-b6"/>
Jul 24 16:44:00 user nova-compute[70243]:     </interface>
Jul 24 16:44:00 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:44:00 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/console.log" append="off"/>
Jul 24 16:44:00 user nova-compute[70243]:     </serial>
Jul 24 16:44:00 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:44:00 user nova-compute[70243]:     <video>
Jul 24 16:44:00 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:44:00 user nova-compute[70243]:     </video>
Jul 24 16:44:00 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:44:00 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:44:00 user nova-compute[70243]:     </rng>
Jul 24 16:44:00 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:44:00 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:44:00 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:44:00 user nova-compute[70243]:     </memballoon>
Jul 24 16:44:00 user nova-compute[70243]:   </devices>
Jul 24 16:44:00 user nova-compute[70243]: </domain>
Jul 24 16:44:00 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:43:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-82290159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-82290159',id=39,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06cf84dc406343afa81260614acc8fdd',ramdisk_id='',reservation_id='r-uxfpsxy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:43:58Z,user_data=None,user_id='ae306b319e8c4e61b0a73933dc5c330c',uuid=ae152306-9bc0-47a4-b438-2dde63652863,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a2f88c3-b6c3-4dc9-9247-f14603933043", "address": "fa:16:3e:54:a5:20", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2f88c3-b6", "ovs_interfaceid": "0a2f88c3-b6c3-4dc9-9247-f14603933043", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converting VIF {"id": "0a2f88c3-b6c3-4dc9-9247-f14603933043", "address": "fa:16:3e:54:a5:20", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2f88c3-b6", "ovs_interfaceid": "0a2f88c3-b6c3-4dc9-9247-f14603933043", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:a5:20,bridge_name='br-int',has_traffic_filtering=True,id=0a2f88c3-b6c3-4dc9-9247-f14603933043,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a2f88c3-b6') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG os_vif [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:a5:20,bridge_name='br-int',has_traffic_filtering=True,id=0a2f88c3-b6c3-4dc9-9247-f14603933043,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a2f88c3-b6') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a2f88c3-b6, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0a2f88c3-b6, col_values=(('external_ids', {'iface-id': '0a2f88c3-b6c3-4dc9-9247-f14603933043', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:a5:20', 'vm-uuid': 'ae152306-9bc0-47a4-b438-2dde63652863'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:00 user nova-compute[70243]: INFO os_vif [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:a5:20,bridge_name='br-int',has_traffic_filtering=True,id=0a2f88c3-b6c3-4dc9-9247-f14603933043,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a2f88c3-b6')
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] No VIF found with MAC fa:16:3e:54:a5:20, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.network.neutron [req-1973d1fd-a734-4f7f-a1cb-61881f5768ce req-031b6b02-ddbb-48f5-a6ba-df02028dd0be service nova] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Updated VIF entry in instance network info cache for port 0a2f88c3-b6c3-4dc9-9247-f14603933043. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG nova.network.neutron [req-1973d1fd-a734-4f7f-a1cb-61881f5768ce req-031b6b02-ddbb-48f5-a6ba-df02028dd0be service nova] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Updating instance_info_cache with network_info: [{"id": "0a2f88c3-b6c3-4dc9-9247-f14603933043", "address": "fa:16:3e:54:a5:20", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2f88c3-b6", "ovs_interfaceid": "0a2f88c3-b6c3-4dc9-9247-f14603933043", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:44:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1973d1fd-a734-4f7f-a1cb-61881f5768ce req-031b6b02-ddbb-48f5-a6ba-df02028dd0be service nova] Releasing lock "refresh_cache-ae152306-9bc0-47a4-b438-2dde63652863" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:44:01 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:44:01 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:44:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:01 user nova-compute[70243]: DEBUG nova.compute.manager [req-c8f35bb9-1c21-4ac5-a471-32f49082dede req-4f1c4790-5804-4e2d-94c3-3ed2c9aebefa service nova] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Received event network-vif-plugged-0a2f88c3-b6c3-4dc9-9247-f14603933043 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:44:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c8f35bb9-1c21-4ac5-a471-32f49082dede req-4f1c4790-5804-4e2d-94c3-3ed2c9aebefa service nova] Acquiring lock "ae152306-9bc0-47a4-b438-2dde63652863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:44:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c8f35bb9-1c21-4ac5-a471-32f49082dede req-4f1c4790-5804-4e2d-94c3-3ed2c9aebefa service nova] Lock "ae152306-9bc0-47a4-b438-2dde63652863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:44:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c8f35bb9-1c21-4ac5-a471-32f49082dede req-4f1c4790-5804-4e2d-94c3-3ed2c9aebefa service nova] Lock "ae152306-9bc0-47a4-b438-2dde63652863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:44:01 user nova-compute[70243]: DEBUG nova.compute.manager [req-c8f35bb9-1c21-4ac5-a471-32f49082dede req-4f1c4790-5804-4e2d-94c3-3ed2c9aebefa service nova] [instance: ae152306-9bc0-47a4-b438-2dde63652863] No waiting events found dispatching network-vif-plugged-0a2f88c3-b6c3-4dc9-9247-f14603933043 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:44:01 user nova-compute[70243]: WARNING nova.compute.manager [req-c8f35bb9-1c21-4ac5-a471-32f49082dede req-4f1c4790-5804-4e2d-94c3-3ed2c9aebefa service nova] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Received unexpected event network-vif-plugged-0a2f88c3-b6c3-4dc9-9247-f14603933043 for instance with vm_state building and task_state spawning.
Jul 24 16:44:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:02 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:44:02 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:44:02 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 16:44:02 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Skipping network cache update for instance because it is Building. {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9835}}
Jul 24 16:44:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-100c6ba5-de96-4c2a-ae0c-9d3a9199948c" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:44:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-100c6ba5-de96-4c2a-ae0c-9d3a9199948c" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:44:02 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:44:02 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lazy-loading 'info_cache' on Instance uuid 100c6ba5-de96-4c2a-ae0c-9d3a9199948c {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:44:02 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690217027.496566, a7bfe8dc-9f4f-44b4-95d4-e2b069774a11 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:44:02 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] VM Stopped (Lifecycle Event)
Jul 24 16:44:02 user nova-compute[70243]: DEBUG nova.compute.manager [None req-de53f12f-1d93-4297-9ef1-e500b9ecd178 None None] [instance: a7bfe8dc-9f4f-44b4-95d4-e2b069774a11] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:44:02 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Updating instance_info_cache with network_info: [{"id": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "address": "fa:16:3e:03:1c:93", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ce0c89-39", "ovs_interfaceid": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:44:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-100c6ba5-de96-4c2a-ae0c-9d3a9199948c" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:44:02 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:44:03 user nova-compute[70243]: DEBUG nova.compute.manager [req-815aefad-6d5c-4e8e-b607-6e1cb194e1ec req-16a4bc31-9915-4424-bc15-8002d6e47126 service nova] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Received event network-vif-plugged-0a2f88c3-b6c3-4dc9-9247-f14603933043 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:44:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-815aefad-6d5c-4e8e-b607-6e1cb194e1ec req-16a4bc31-9915-4424-bc15-8002d6e47126 service nova] Acquiring lock "ae152306-9bc0-47a4-b438-2dde63652863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:44:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-815aefad-6d5c-4e8e-b607-6e1cb194e1ec req-16a4bc31-9915-4424-bc15-8002d6e47126 service nova] Lock "ae152306-9bc0-47a4-b438-2dde63652863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:44:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-815aefad-6d5c-4e8e-b607-6e1cb194e1ec req-16a4bc31-9915-4424-bc15-8002d6e47126 service nova] Lock "ae152306-9bc0-47a4-b438-2dde63652863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:44:03 user nova-compute[70243]: DEBUG nova.compute.manager [req-815aefad-6d5c-4e8e-b607-6e1cb194e1ec req-16a4bc31-9915-4424-bc15-8002d6e47126 service nova] [instance: ae152306-9bc0-47a4-b438-2dde63652863] No waiting events found dispatching network-vif-plugged-0a2f88c3-b6c3-4dc9-9247-f14603933043 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:44:03 user nova-compute[70243]: WARNING nova.compute.manager [req-815aefad-6d5c-4e8e-b607-6e1cb194e1ec req-16a4bc31-9915-4424-bc15-8002d6e47126 service nova] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Received unexpected event network-vif-plugged-0a2f88c3-b6c3-4dc9-9247-f14603933043 for instance with vm_state building and task_state spawning.
Jul 24 16:44:03 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217043.826432, ae152306-9bc0-47a4-b438-2dde63652863 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:44:03 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ae152306-9bc0-47a4-b438-2dde63652863] VM Resumed (Lifecycle Event)
Jul 24 16:44:03 user nova-compute[70243]: DEBUG nova.compute.manager [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:44:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:44:03 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Instance spawned successfully.
Jul 24 16:44:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:44:03 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:44:03 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:44:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:44:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:44:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:44:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:44:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:44:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:44:03 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ae152306-9bc0-47a4-b438-2dde63652863] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:44:03 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217043.8313065, ae152306-9bc0-47a4-b438-2dde63652863 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:44:03 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ae152306-9bc0-47a4-b438-2dde63652863] VM Started (Lifecycle Event)
Jul 24 16:44:03 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:44:03 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:44:03 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: ae152306-9bc0-47a4-b438-2dde63652863] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:44:03 user nova-compute[70243]: INFO nova.compute.manager [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Took 5.61 seconds to spawn the instance on the hypervisor.
Jul 24 16:44:03 user nova-compute[70243]: DEBUG nova.compute.manager [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:44:04 user nova-compute[70243]: INFO nova.compute.manager [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Took 6.18 seconds to build instance.
Jul 24 16:44:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-0b694795-1793-4989-92c7-7b6883db3498 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "ae152306-9bc0-47a4-b438-2dde63652863" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.268s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:44:04 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:44:04 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:44:04 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:44:04 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:44:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:44:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:44:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:44:04 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:44:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:44:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:44:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:44:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:44:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:44:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:44:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:44:04 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:44:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:44:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:44:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:44:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:44:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:44:05 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:44:05 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:44:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8500MB free_disk=24.188522338867188GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:44:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:44:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:44:06 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 100c6ba5-de96-4c2a-ae0c-9d3a9199948c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:44:06 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8c896761-df6a-4f4a-87dd-c5ea30641a89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:44:06 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 98a87000-0c6d-456e-af2e-4a987968cec5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:44:06 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance ae152306-9bc0-47a4-b438-2dde63652863 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:44:06 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:44:06 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:44:06 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:44:06 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:44:06 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:44:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:44:08 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:44:08 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:44:08 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:44:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:10 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:44:12 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:44:12 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70243) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 16:44:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:15 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:44:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Cleaning up deleted instances {{(pid=70243) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 16:44:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] There are 0 instances to clean {{(pid=70243) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 16:44:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:44:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:44:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:44:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:44:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:44:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "34af24e7-8c92-4b45-8d85-c3b328ec313b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "34af24e7-8c92-4b45-8d85-c3b328ec313b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Triggering sync for uuid 100c6ba5-de96-4c2a-ae0c-9d3a9199948c {{(pid=70243) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Triggering sync for uuid 8c896761-df6a-4f4a-87dd-c5ea30641a89 {{(pid=70243) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Triggering sync for uuid 98a87000-0c6d-456e-af2e-4a987968cec5 {{(pid=70243) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Triggering sync for uuid ae152306-9bc0-47a4-b438-2dde63652863 {{(pid=70243) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "8c896761-df6a-4f4a-87dd-c5ea30641a89" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "98a87000-0c6d-456e-af2e-4a987968cec5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "98a87000-0c6d-456e-af2e-4a987968cec5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "ae152306-9bc0-47a4-b438-2dde63652863" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "ae152306-9bc0-47a4-b438-2dde63652863" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:44:55 user nova-compute[70243]: INFO nova.compute.claims [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Claim successful on node user
Jul 24 16:44:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "98a87000-0c6d-456e-af2e-4a987968cec5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:44:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "ae152306-9bc0-47a4-b438-2dde63652863" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.288s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG nova.network.neutron [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:44:56 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:44:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG nova.policy [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97ec28618df24ff19401d02c0ca3c1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fc785066034979ade3e9ef1f3ca27c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:44:56 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Creating image(s)
Jul 24 16:44:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "/opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "/opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "/opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.140s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.140s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/disk 1073741824" returned: 0 in 0.057s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG nova.network.neutron [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Successfully created port: 9616d294-53f6-4722-9cde-15f82a6646cd {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Cannot resize image /opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:44:56 user nova-compute[70243]: DEBUG nova.objects.instance [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lazy-loading 'migration_context' on Instance uuid 34af24e7-8c92-4b45-8d85-c3b328ec313b {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:44:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:44:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Ensure instance console log exists: /opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:44:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:44:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:44:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:44:57 user nova-compute[70243]: DEBUG nova.network.neutron [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Successfully updated port: 9616d294-53f6-4722-9cde-15f82a6646cd {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:44:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "refresh_cache-34af24e7-8c92-4b45-8d85-c3b328ec313b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:44:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquired lock "refresh_cache-34af24e7-8c92-4b45-8d85-c3b328ec313b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:44:57 user nova-compute[70243]: DEBUG nova.network.neutron [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:44:57 user nova-compute[70243]: DEBUG nova.compute.manager [req-5458eb09-410b-499e-bfb1-931c7717231a req-272034bf-dbd2-447c-bde6-7956437e337f service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Received event network-changed-9616d294-53f6-4722-9cde-15f82a6646cd {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:44:57 user nova-compute[70243]: DEBUG nova.compute.manager [req-5458eb09-410b-499e-bfb1-931c7717231a req-272034bf-dbd2-447c-bde6-7956437e337f service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Refreshing instance network info cache due to event network-changed-9616d294-53f6-4722-9cde-15f82a6646cd. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:44:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5458eb09-410b-499e-bfb1-931c7717231a req-272034bf-dbd2-447c-bde6-7956437e337f service nova] Acquiring lock "refresh_cache-34af24e7-8c92-4b45-8d85-c3b328ec313b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:44:57 user nova-compute[70243]: DEBUG nova.network.neutron [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.network.neutron [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Updating instance_info_cache with network_info: [{"id": "9616d294-53f6-4722-9cde-15f82a6646cd", "address": "fa:16:3e:c5:3a:62", "network": {"id": "e788aa0b-b842-4cad-a50d-605499bef92a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-86978474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fc785066034979ade3e9ef1f3ca27c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616d294-53", "ovs_interfaceid": "9616d294-53f6-4722-9cde-15f82a6646cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Releasing lock "refresh_cache-34af24e7-8c92-4b45-8d85-c3b328ec313b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Instance network_info: |[{"id": "9616d294-53f6-4722-9cde-15f82a6646cd", "address": "fa:16:3e:c5:3a:62", "network": {"id": "e788aa0b-b842-4cad-a50d-605499bef92a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-86978474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fc785066034979ade3e9ef1f3ca27c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616d294-53", "ovs_interfaceid": "9616d294-53f6-4722-9cde-15f82a6646cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5458eb09-410b-499e-bfb1-931c7717231a req-272034bf-dbd2-447c-bde6-7956437e337f service nova] Acquired lock "refresh_cache-34af24e7-8c92-4b45-8d85-c3b328ec313b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.network.neutron [req-5458eb09-410b-499e-bfb1-931c7717231a req-272034bf-dbd2-447c-bde6-7956437e337f service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Refreshing network info cache for port 9616d294-53f6-4722-9cde-15f82a6646cd {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Start _get_guest_xml network_info=[{"id": "9616d294-53f6-4722-9cde-15f82a6646cd", "address": "fa:16:3e:c5:3a:62", "network": {"id": "e788aa0b-b842-4cad-a50d-605499bef92a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-86978474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fc785066034979ade3e9ef1f3ca27c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616d294-53", "ovs_interfaceid": "9616d294-53f6-4722-9cde-15f82a6646cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:44:58 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:44:58 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1601848313',display_name='tempest-VolumesSnapshotTestJSON-instance-1601848313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1601848313',id=40,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+Qyhdm0bGM/gDAGWfnMY960Aid7S9XiC7I6MWhjTOKXTA12NQ+DbTqSt8CoLmgFTUe3BrYQWoMHdg8+JRphuiFhoFkSDr1DaaZiOfHyBCyh1cku2DlekCd6fT+bQkEVA==',key_name='tempest-keypair-1023766368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2fc785066034979ade3e9ef1f3ca27c',ramdisk_id='',reservation_id='r-tnaem3dv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1620979851',owner_user_name='tempest-VolumesSnapshotTestJSON-1620979851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:44:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97ec28618df24ff19401d02c0ca3c1a2',uuid=34af24e7-8c92-4b45-8d85-c3b328ec313b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9616d294-53f6-4722-9cde-15f82a6646cd", "address": "fa:16:3e:c5:3a:62", "network": {"id": "e788aa0b-b842-4cad-a50d-605499bef92a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-86978474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fc785066034979ade3e9ef1f3ca27c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616d294-53", "ovs_interfaceid": "9616d294-53f6-4722-9cde-15f82a6646cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Converting VIF {"id": "9616d294-53f6-4722-9cde-15f82a6646cd", "address": "fa:16:3e:c5:3a:62", "network": {"id": "e788aa0b-b842-4cad-a50d-605499bef92a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-86978474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fc785066034979ade3e9ef1f3ca27c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616d294-53", "ovs_interfaceid": "9616d294-53f6-4722-9cde-15f82a6646cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:3a:62,bridge_name='br-int',has_traffic_filtering=True,id=9616d294-53f6-4722-9cde-15f82a6646cd,network=Network(e788aa0b-b842-4cad-a50d-605499bef92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9616d294-53') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.objects.instance [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lazy-loading 'pci_devices' on Instance uuid 34af24e7-8c92-4b45-8d85-c3b328ec313b {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:44:58 user nova-compute[70243]:   <uuid>34af24e7-8c92-4b45-8d85-c3b328ec313b</uuid>
Jul 24 16:44:58 user nova-compute[70243]:   <name>instance-00000028</name>
Jul 24 16:44:58 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:44:58 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:44:58 user nova-compute[70243]:   <metadata>
Jul 24 16:44:58 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:44:58 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:44:58 user nova-compute[70243]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1601848313</nova:name>
Jul 24 16:44:58 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:44:58</nova:creationTime>
Jul 24 16:44:58 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:44:58 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:44:58 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:44:58 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:44:58 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:44:58 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:44:58 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:44:58 user nova-compute[70243]:       <nova:owner>
Jul 24 16:44:58 user nova-compute[70243]:         <nova:user uuid="97ec28618df24ff19401d02c0ca3c1a2">tempest-VolumesSnapshotTestJSON-1620979851-project-member</nova:user>
Jul 24 16:44:58 user nova-compute[70243]:         <nova:project uuid="a2fc785066034979ade3e9ef1f3ca27c">tempest-VolumesSnapshotTestJSON-1620979851</nova:project>
Jul 24 16:44:58 user nova-compute[70243]:       </nova:owner>
Jul 24 16:44:58 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:44:58 user nova-compute[70243]:       <nova:ports>
Jul 24 16:44:58 user nova-compute[70243]:         <nova:port uuid="9616d294-53f6-4722-9cde-15f82a6646cd">
Jul 24 16:44:58 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 16:44:58 user nova-compute[70243]:         </nova:port>
Jul 24 16:44:58 user nova-compute[70243]:       </nova:ports>
Jul 24 16:44:58 user nova-compute[70243]:     </nova:instance>
Jul 24 16:44:58 user nova-compute[70243]:   </metadata>
Jul 24 16:44:58 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:44:58 user nova-compute[70243]:     <system>
Jul 24 16:44:58 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:44:58 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:44:58 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:44:58 user nova-compute[70243]:       <entry name="serial">34af24e7-8c92-4b45-8d85-c3b328ec313b</entry>
Jul 24 16:44:58 user nova-compute[70243]:       <entry name="uuid">34af24e7-8c92-4b45-8d85-c3b328ec313b</entry>
Jul 24 16:44:58 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:44:58 user nova-compute[70243]:     </system>
Jul 24 16:44:58 user nova-compute[70243]:   </sysinfo>
Jul 24 16:44:58 user nova-compute[70243]:   <os>
Jul 24 16:44:58 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:44:58 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:44:58 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:44:58 user nova-compute[70243]:   </os>
Jul 24 16:44:58 user nova-compute[70243]:   <features>
Jul 24 16:44:58 user nova-compute[70243]:     <acpi/>
Jul 24 16:44:58 user nova-compute[70243]:     <apic/>
Jul 24 16:44:58 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:44:58 user nova-compute[70243]:   </features>
Jul 24 16:44:58 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:44:58 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:44:58 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:44:58 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:44:58 user nova-compute[70243]:   </clock>
Jul 24 16:44:58 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:44:58 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:44:58 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:44:58 user nova-compute[70243]:   </cpu>
Jul 24 16:44:58 user nova-compute[70243]:   <devices>
Jul 24 16:44:58 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:44:58 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:44:58 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/disk"/>
Jul 24 16:44:58 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:44:58 user nova-compute[70243]:     </disk>
Jul 24 16:44:58 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:44:58 user nova-compute[70243]:       <mac address="fa:16:3e:c5:3a:62"/>
Jul 24 16:44:58 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:44:58 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:44:58 user nova-compute[70243]:       <target dev="tap9616d294-53"/>
Jul 24 16:44:58 user nova-compute[70243]:     </interface>
Jul 24 16:44:58 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:44:58 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/console.log" append="off"/>
Jul 24 16:44:58 user nova-compute[70243]:     </serial>
Jul 24 16:44:58 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:44:58 user nova-compute[70243]:     <video>
Jul 24 16:44:58 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:44:58 user nova-compute[70243]:     </video>
Jul 24 16:44:58 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:44:58 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:44:58 user nova-compute[70243]:     </rng>
Jul 24 16:44:58 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:44:58 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:44:58 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:44:58 user nova-compute[70243]:     </memballoon>
Jul 24 16:44:58 user nova-compute[70243]:   </devices>
Jul 24 16:44:58 user nova-compute[70243]: </domain>
Jul 24 16:44:58 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1601848313',display_name='tempest-VolumesSnapshotTestJSON-instance-1601848313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1601848313',id=40,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+Qyhdm0bGM/gDAGWfnMY960Aid7S9XiC7I6MWhjTOKXTA12NQ+DbTqSt8CoLmgFTUe3BrYQWoMHdg8+JRphuiFhoFkSDr1DaaZiOfHyBCyh1cku2DlekCd6fT+bQkEVA==',key_name='tempest-keypair-1023766368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2fc785066034979ade3e9ef1f3ca27c',ramdisk_id='',reservation_id='r-tnaem3dv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1620979851',owner_user_name='tempest-VolumesSnapshotTestJSON-1620979851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:44:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97ec28618df24ff19401d02c0ca3c1a2',uuid=34af24e7-8c92-4b45-8d85-c3b328ec313b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9616d294-53f6-4722-9cde-15f82a6646cd", "address": "fa:16:3e:c5:3a:62", "network": {"id": "e788aa0b-b842-4cad-a50d-605499bef92a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-86978474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fc785066034979ade3e9ef1f3ca27c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616d294-53", "ovs_interfaceid": "9616d294-53f6-4722-9cde-15f82a6646cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Converting VIF {"id": "9616d294-53f6-4722-9cde-15f82a6646cd", "address": "fa:16:3e:c5:3a:62", "network": {"id": "e788aa0b-b842-4cad-a50d-605499bef92a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-86978474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fc785066034979ade3e9ef1f3ca27c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616d294-53", "ovs_interfaceid": "9616d294-53f6-4722-9cde-15f82a6646cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:3a:62,bridge_name='br-int',has_traffic_filtering=True,id=9616d294-53f6-4722-9cde-15f82a6646cd,network=Network(e788aa0b-b842-4cad-a50d-605499bef92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9616d294-53') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG os_vif [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:3a:62,bridge_name='br-int',has_traffic_filtering=True,id=9616d294-53f6-4722-9cde-15f82a6646cd,network=Network(e788aa0b-b842-4cad-a50d-605499bef92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9616d294-53') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9616d294-53, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9616d294-53, col_values=(('external_ids', {'iface-id': '9616d294-53f6-4722-9cde-15f82a6646cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:3a:62', 'vm-uuid': '34af24e7-8c92-4b45-8d85-c3b328ec313b'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:58 user nova-compute[70243]: INFO os_vif [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:3a:62,bridge_name='br-int',has_traffic_filtering=True,id=9616d294-53f6-4722-9cde-15f82a6646cd,network=Network(e788aa0b-b842-4cad-a50d-605499bef92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9616d294-53')
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] No VIF found with MAC fa:16:3e:c5:3a:62, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.network.neutron [req-5458eb09-410b-499e-bfb1-931c7717231a req-272034bf-dbd2-447c-bde6-7956437e337f service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Updated VIF entry in instance network info cache for port 9616d294-53f6-4722-9cde-15f82a6646cd. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG nova.network.neutron [req-5458eb09-410b-499e-bfb1-931c7717231a req-272034bf-dbd2-447c-bde6-7956437e337f service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Updating instance_info_cache with network_info: [{"id": "9616d294-53f6-4722-9cde-15f82a6646cd", "address": "fa:16:3e:c5:3a:62", "network": {"id": "e788aa0b-b842-4cad-a50d-605499bef92a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-86978474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fc785066034979ade3e9ef1f3ca27c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616d294-53", "ovs_interfaceid": "9616d294-53f6-4722-9cde-15f82a6646cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:44:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5458eb09-410b-499e-bfb1-931c7717231a req-272034bf-dbd2-447c-bde6-7956437e337f service nova] Releasing lock "refresh_cache-34af24e7-8c92-4b45-8d85-c3b328ec313b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:44:59 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:44:59 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:44:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:44:59 user nova-compute[70243]: DEBUG nova.compute.manager [req-d140e2f7-a7a9-4f92-86f6-08641ff2ac1f req-b4f5cea4-dc8c-46d1-905f-3e9bde1904af service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Received event network-vif-plugged-9616d294-53f6-4722-9cde-15f82a6646cd {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:44:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d140e2f7-a7a9-4f92-86f6-08641ff2ac1f req-b4f5cea4-dc8c-46d1-905f-3e9bde1904af service nova] Acquiring lock "34af24e7-8c92-4b45-8d85-c3b328ec313b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:44:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d140e2f7-a7a9-4f92-86f6-08641ff2ac1f req-b4f5cea4-dc8c-46d1-905f-3e9bde1904af service nova] Lock "34af24e7-8c92-4b45-8d85-c3b328ec313b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:44:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d140e2f7-a7a9-4f92-86f6-08641ff2ac1f req-b4f5cea4-dc8c-46d1-905f-3e9bde1904af service nova] Lock "34af24e7-8c92-4b45-8d85-c3b328ec313b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:44:59 user nova-compute[70243]: DEBUG nova.compute.manager [req-d140e2f7-a7a9-4f92-86f6-08641ff2ac1f req-b4f5cea4-dc8c-46d1-905f-3e9bde1904af service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] No waiting events found dispatching network-vif-plugged-9616d294-53f6-4722-9cde-15f82a6646cd {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:44:59 user nova-compute[70243]: WARNING nova.compute.manager [req-d140e2f7-a7a9-4f92-86f6-08641ff2ac1f req-b4f5cea4-dc8c-46d1-905f-3e9bde1904af service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Received unexpected event network-vif-plugged-9616d294-53f6-4722-9cde-15f82a6646cd for instance with vm_state building and task_state spawning.
Jul 24 16:45:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:01 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217101.5984795, 34af24e7-8c92-4b45-8d85-c3b328ec313b => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:45:01 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] VM Resumed (Lifecycle Event)
Jul 24 16:45:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:45:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:45:01 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Instance spawned successfully.
Jul 24 16:45:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:45:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:45:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:45:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:45:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:45:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:45:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:45:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:45:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:45:01 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:45:01 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217101.6029081, 34af24e7-8c92-4b45-8d85-c3b328ec313b => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:45:01 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] VM Started (Lifecycle Event)
Jul 24 16:45:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:45:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:45:01 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:45:01 user nova-compute[70243]: INFO nova.compute.manager [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Took 5.38 seconds to spawn the instance on the hypervisor.
Jul 24 16:45:01 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:45:01 user nova-compute[70243]: DEBUG nova.compute.manager [req-ff2eed9b-79c8-4715-8295-bf7bd8843905 req-1b2c1630-6d1e-4c5a-b267-c7e72b2a2d69 service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Received event network-vif-plugged-9616d294-53f6-4722-9cde-15f82a6646cd {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:45:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ff2eed9b-79c8-4715-8295-bf7bd8843905 req-1b2c1630-6d1e-4c5a-b267-c7e72b2a2d69 service nova] Acquiring lock "34af24e7-8c92-4b45-8d85-c3b328ec313b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:45:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ff2eed9b-79c8-4715-8295-bf7bd8843905 req-1b2c1630-6d1e-4c5a-b267-c7e72b2a2d69 service nova] Lock "34af24e7-8c92-4b45-8d85-c3b328ec313b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:45:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ff2eed9b-79c8-4715-8295-bf7bd8843905 req-1b2c1630-6d1e-4c5a-b267-c7e72b2a2d69 service nova] Lock "34af24e7-8c92-4b45-8d85-c3b328ec313b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:45:01 user nova-compute[70243]: DEBUG nova.compute.manager [req-ff2eed9b-79c8-4715-8295-bf7bd8843905 req-1b2c1630-6d1e-4c5a-b267-c7e72b2a2d69 service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] No waiting events found dispatching network-vif-plugged-9616d294-53f6-4722-9cde-15f82a6646cd {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:45:01 user nova-compute[70243]: WARNING nova.compute.manager [req-ff2eed9b-79c8-4715-8295-bf7bd8843905 req-1b2c1630-6d1e-4c5a-b267-c7e72b2a2d69 service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Received unexpected event network-vif-plugged-9616d294-53f6-4722-9cde-15f82a6646cd for instance with vm_state building and task_state spawning.
Jul 24 16:45:01 user nova-compute[70243]: INFO nova.compute.manager [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Took 6.00 seconds to build instance.
Jul 24 16:45:01 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d444791f-7d91-4379-ac3d-a94bdb6fc04b tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "34af24e7-8c92-4b45-8d85-c3b328ec313b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.096s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:45:02 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:45:02 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:45:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-8c896761-df6a-4f4a-87dd-c5ea30641a89" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:45:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-8c896761-df6a-4f4a-87dd-c5ea30641a89" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:45:02 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:45:02 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Updating instance_info_cache with network_info: [{"id": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "address": "fa:16:3e:a5:da:73", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa5a7d4-ef", "ovs_interfaceid": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:45:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-8c896761-df6a-4f4a-87dd-c5ea30641a89" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:45:02 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:45:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:03 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:45:03 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:45:05 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:45:05 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:45:05 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:45:05 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:45:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:45:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:45:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:45:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:45:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:45:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:45:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:45:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:45:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:45:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:45:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:45:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:45:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:45:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:45:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:45:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:45:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:45:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:45:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:45:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:45:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:45:06 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:45:06 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:45:06 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8412MB free_disk=24.114944458007812GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:45:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:45:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:45:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 100c6ba5-de96-4c2a-ae0c-9d3a9199948c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:45:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8c896761-df6a-4f4a-87dd-c5ea30641a89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:45:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 98a87000-0c6d-456e-af2e-4a987968cec5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:45:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance ae152306-9bc0-47a4-b438-2dde63652863 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:45:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 34af24e7-8c92-4b45-8d85-c3b328ec313b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:45:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:45:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:45:07 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing inventories for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 16:45:07 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Updating ProviderTree inventory for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 16:45:07 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Updating inventory in ProviderTree for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 16:45:07 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing aggregate associations for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0, aggregates: None {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 16:45:07 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing trait associations for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0, traits: HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 16:45:07 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:45:07 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:45:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:45:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:45:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:09 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:45:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:45:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:45:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:45:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:45:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Acquiring lock "2947b710-0e36-4949-96dc-ce455b0bc040" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:45:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "2947b710-0e36-4949-96dc-ce455b0bc040" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:45:35 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:45:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:45:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:45:35 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:45:35 user nova-compute[70243]: INFO nova.compute.claims [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Claim successful on node user
Jul 24 16:45:35 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:45:35 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:45:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.285s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:45:35 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:45:36 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:45:36 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG nova.policy [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd85dab5b3c84255b3d784cfeed397c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4884b7eb022949d298aa11ee84a03ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:45:36 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Creating image(s)
Jul 24 16:45:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Acquiring lock "/opt/stack/data/nova/instances/2947b710-0e36-4949-96dc-ce455b0bc040/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "/opt/stack/data/nova/instances/2947b710-0e36-4949-96dc-ce455b0bc040/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "/opt/stack/data/nova/instances/2947b710-0e36-4949-96dc-ce455b0bc040/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.131s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/2947b710-0e36-4949-96dc-ce455b0bc040/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/2947b710-0e36-4949-96dc-ce455b0bc040/disk 1073741824" returned: 0 in 0.051s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2947b710-0e36-4949-96dc-ce455b0bc040/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2947b710-0e36-4949-96dc-ce455b0bc040/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Successfully created port: 507e83bb-2cc6-404c-8b20-c52674fc43e0 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2947b710-0e36-4949-96dc-ce455b0bc040/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Cannot resize image /opt/stack/data/nova/instances/2947b710-0e36-4949-96dc-ce455b0bc040/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG nova.objects.instance [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lazy-loading 'migration_context' on Instance uuid 2947b710-0e36-4949-96dc-ce455b0bc040 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Ensure instance console log exists: /opt/stack/data/nova/instances/2947b710-0e36-4949-96dc-ce455b0bc040/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:45:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:45:37 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Successfully updated port: 507e83bb-2cc6-404c-8b20-c52674fc43e0 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:45:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Acquiring lock "refresh_cache-2947b710-0e36-4949-96dc-ce455b0bc040" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:45:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Acquired lock "refresh_cache-2947b710-0e36-4949-96dc-ce455b0bc040" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:45:37 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:45:37 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:45:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-8ff16cab-52dc-4580-a9bd-7a5e887445f5 req-512e6fdc-7e37-4641-b2df-d694c1cef150 service nova] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Received event network-changed-507e83bb-2cc6-404c-8b20-c52674fc43e0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:45:37 user nova-compute[70243]: DEBUG nova.compute.manager [req-8ff16cab-52dc-4580-a9bd-7a5e887445f5 req-512e6fdc-7e37-4641-b2df-d694c1cef150 service nova] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Refreshing instance network info cache due to event network-changed-507e83bb-2cc6-404c-8b20-c52674fc43e0. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:45:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8ff16cab-52dc-4580-a9bd-7a5e887445f5 req-512e6fdc-7e37-4641-b2df-d694c1cef150 service nova] Acquiring lock "refresh_cache-2947b710-0e36-4949-96dc-ce455b0bc040" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:45:37 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Updating instance_info_cache with network_info: [{"id": "507e83bb-2cc6-404c-8b20-c52674fc43e0", "address": "fa:16:3e:74:dd:16", "network": {"id": "99653fe8-b4ff-4412-a691-fe3efeaebfb4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-172568374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4884b7eb022949d298aa11ee84a03ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507e83bb-2c", "ovs_interfaceid": "507e83bb-2cc6-404c-8b20-c52674fc43e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:45:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Releasing lock "refresh_cache-2947b710-0e36-4949-96dc-ce455b0bc040" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:45:37 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Instance network_info: |[{"id": "507e83bb-2cc6-404c-8b20-c52674fc43e0", "address": "fa:16:3e:74:dd:16", "network": {"id": "99653fe8-b4ff-4412-a691-fe3efeaebfb4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-172568374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4884b7eb022949d298aa11ee84a03ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507e83bb-2c", "ovs_interfaceid": "507e83bb-2cc6-404c-8b20-c52674fc43e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:45:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8ff16cab-52dc-4580-a9bd-7a5e887445f5 req-512e6fdc-7e37-4641-b2df-d694c1cef150 service nova] Acquired lock "refresh_cache-2947b710-0e36-4949-96dc-ce455b0bc040" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:45:37 user nova-compute[70243]: DEBUG nova.network.neutron [req-8ff16cab-52dc-4580-a9bd-7a5e887445f5 req-512e6fdc-7e37-4641-b2df-d694c1cef150 service nova] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Refreshing network info cache for port 507e83bb-2cc6-404c-8b20-c52674fc43e0 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:45:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Start _get_guest_xml network_info=[{"id": "507e83bb-2cc6-404c-8b20-c52674fc43e0", "address": "fa:16:3e:74:dd:16", "network": {"id": "99653fe8-b4ff-4412-a691-fe3efeaebfb4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-172568374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4884b7eb022949d298aa11ee84a03ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507e83bb-2c", "ovs_interfaceid": "507e83bb-2cc6-404c-8b20-c52674fc43e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:45:37 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:45:37 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:45:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:45:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:45:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:45:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:45:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:45:37 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:45:37 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:45:37 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:45:37 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1377989575',display_name='tempest-ServersNegativeTestJSON-server-1377989575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1377989575',id=41,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4884b7eb022949d298aa11ee84a03ec9',ramdisk_id='',reservation_id='r-8n8fj3fy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-851329711',owner_user_name='tempest-ServersNegativeTestJSON-851329711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:45:36Z,user_data=None,user_id='cd85dab5b3c84255b3d784cfeed397c3',uuid=2947b710-0e36-4949-96dc-ce455b0bc040,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "507e83bb-2cc6-404c-8b20-c52674fc43e0", "address": "fa:16:3e:74:dd:16", "network": {"id": "99653fe8-b4ff-4412-a691-fe3efeaebfb4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-172568374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4884b7eb022949d298aa11ee84a03ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507e83bb-2c", "ovs_interfaceid": "507e83bb-2cc6-404c-8b20-c52674fc43e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Converting VIF {"id": "507e83bb-2cc6-404c-8b20-c52674fc43e0", "address": "fa:16:3e:74:dd:16", "network": {"id": "99653fe8-b4ff-4412-a691-fe3efeaebfb4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-172568374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4884b7eb022949d298aa11ee84a03ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507e83bb-2c", "ovs_interfaceid": "507e83bb-2cc6-404c-8b20-c52674fc43e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:dd:16,bridge_name='br-int',has_traffic_filtering=True,id=507e83bb-2cc6-404c-8b20-c52674fc43e0,network=Network(99653fe8-b4ff-4412-a691-fe3efeaebfb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap507e83bb-2c') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG nova.objects.instance [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lazy-loading 'pci_devices' on Instance uuid 2947b710-0e36-4949-96dc-ce455b0bc040 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:45:38 user nova-compute[70243]:   <uuid>2947b710-0e36-4949-96dc-ce455b0bc040</uuid>
Jul 24 16:45:38 user nova-compute[70243]:   <name>instance-00000029</name>
Jul 24 16:45:38 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:45:38 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:45:38 user nova-compute[70243]:   <metadata>
Jul 24 16:45:38 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:45:38 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:45:38 user nova-compute[70243]:       <nova:name>tempest-ServersNegativeTestJSON-server-1377989575</nova:name>
Jul 24 16:45:38 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:45:37</nova:creationTime>
Jul 24 16:45:38 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:45:38 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:45:38 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:45:38 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:45:38 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:45:38 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:45:38 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:45:38 user nova-compute[70243]:       <nova:owner>
Jul 24 16:45:38 user nova-compute[70243]:         <nova:user uuid="cd85dab5b3c84255b3d784cfeed397c3">tempest-ServersNegativeTestJSON-851329711-project-member</nova:user>
Jul 24 16:45:38 user nova-compute[70243]:         <nova:project uuid="4884b7eb022949d298aa11ee84a03ec9">tempest-ServersNegativeTestJSON-851329711</nova:project>
Jul 24 16:45:38 user nova-compute[70243]:       </nova:owner>
Jul 24 16:45:38 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:45:38 user nova-compute[70243]:       <nova:ports>
Jul 24 16:45:38 user nova-compute[70243]:         <nova:port uuid="507e83bb-2cc6-404c-8b20-c52674fc43e0">
Jul 24 16:45:38 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 24 16:45:38 user nova-compute[70243]:         </nova:port>
Jul 24 16:45:38 user nova-compute[70243]:       </nova:ports>
Jul 24 16:45:38 user nova-compute[70243]:     </nova:instance>
Jul 24 16:45:38 user nova-compute[70243]:   </metadata>
Jul 24 16:45:38 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:45:38 user nova-compute[70243]:     <system>
Jul 24 16:45:38 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:45:38 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:45:38 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:45:38 user nova-compute[70243]:       <entry name="serial">2947b710-0e36-4949-96dc-ce455b0bc040</entry>
Jul 24 16:45:38 user nova-compute[70243]:       <entry name="uuid">2947b710-0e36-4949-96dc-ce455b0bc040</entry>
Jul 24 16:45:38 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:45:38 user nova-compute[70243]:     </system>
Jul 24 16:45:38 user nova-compute[70243]:   </sysinfo>
Jul 24 16:45:38 user nova-compute[70243]:   <os>
Jul 24 16:45:38 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:45:38 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:45:38 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:45:38 user nova-compute[70243]:   </os>
Jul 24 16:45:38 user nova-compute[70243]:   <features>
Jul 24 16:45:38 user nova-compute[70243]:     <acpi/>
Jul 24 16:45:38 user nova-compute[70243]:     <apic/>
Jul 24 16:45:38 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:45:38 user nova-compute[70243]:   </features>
Jul 24 16:45:38 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:45:38 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:45:38 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:45:38 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:45:38 user nova-compute[70243]:   </clock>
Jul 24 16:45:38 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:45:38 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:45:38 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:45:38 user nova-compute[70243]:   </cpu>
Jul 24 16:45:38 user nova-compute[70243]:   <devices>
Jul 24 16:45:38 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:45:38 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:45:38 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/2947b710-0e36-4949-96dc-ce455b0bc040/disk"/>
Jul 24 16:45:38 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:45:38 user nova-compute[70243]:     </disk>
Jul 24 16:45:38 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:45:38 user nova-compute[70243]:       <mac address="fa:16:3e:74:dd:16"/>
Jul 24 16:45:38 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:45:38 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:45:38 user nova-compute[70243]:       <target dev="tap507e83bb-2c"/>
Jul 24 16:45:38 user nova-compute[70243]:     </interface>
Jul 24 16:45:38 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:45:38 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/2947b710-0e36-4949-96dc-ce455b0bc040/console.log" append="off"/>
Jul 24 16:45:38 user nova-compute[70243]:     </serial>
Jul 24 16:45:38 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:45:38 user nova-compute[70243]:     <video>
Jul 24 16:45:38 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:45:38 user nova-compute[70243]:     </video>
Jul 24 16:45:38 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:45:38 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:45:38 user nova-compute[70243]:     </rng>
Jul 24 16:45:38 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:45:38 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:45:38 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:45:38 user nova-compute[70243]:     </memballoon>
Jul 24 16:45:38 user nova-compute[70243]:   </devices>
Jul 24 16:45:38 user nova-compute[70243]: </domain>
Jul 24 16:45:38 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1377989575',display_name='tempest-ServersNegativeTestJSON-server-1377989575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1377989575',id=41,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4884b7eb022949d298aa11ee84a03ec9',ramdisk_id='',reservation_id='r-8n8fj3fy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-851329711',owner_user_name='tempest-ServersNegativeTestJSON-851329711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:45:36Z,user_data=None,user_id='cd85dab5b3c84255b3d784cfeed397c3',uuid=2947b710-0e36-4949-96dc-ce455b0bc040,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "507e83bb-2cc6-404c-8b20-c52674fc43e0", "address": "fa:16:3e:74:dd:16", "network": {"id": "99653fe8-b4ff-4412-a691-fe3efeaebfb4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-172568374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4884b7eb022949d298aa11ee84a03ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507e83bb-2c", "ovs_interfaceid": "507e83bb-2cc6-404c-8b20-c52674fc43e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Converting VIF {"id": "507e83bb-2cc6-404c-8b20-c52674fc43e0", "address": "fa:16:3e:74:dd:16", "network": {"id": "99653fe8-b4ff-4412-a691-fe3efeaebfb4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-172568374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4884b7eb022949d298aa11ee84a03ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507e83bb-2c", "ovs_interfaceid": "507e83bb-2cc6-404c-8b20-c52674fc43e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:dd:16,bridge_name='br-int',has_traffic_filtering=True,id=507e83bb-2cc6-404c-8b20-c52674fc43e0,network=Network(99653fe8-b4ff-4412-a691-fe3efeaebfb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap507e83bb-2c') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG os_vif [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:dd:16,bridge_name='br-int',has_traffic_filtering=True,id=507e83bb-2cc6-404c-8b20-c52674fc43e0,network=Network(99653fe8-b4ff-4412-a691-fe3efeaebfb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap507e83bb-2c') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap507e83bb-2c, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap507e83bb-2c, col_values=(('external_ids', {'iface-id': '507e83bb-2cc6-404c-8b20-c52674fc43e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:dd:16', 'vm-uuid': '2947b710-0e36-4949-96dc-ce455b0bc040'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:38 user nova-compute[70243]: INFO os_vif [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:dd:16,bridge_name='br-int',has_traffic_filtering=True,id=507e83bb-2cc6-404c-8b20-c52674fc43e0,network=Network(99653fe8-b4ff-4412-a691-fe3efeaebfb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap507e83bb-2c')
Jul 24 16:45:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] No VIF found with MAC fa:16:3e:74:dd:16, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG nova.network.neutron [req-8ff16cab-52dc-4580-a9bd-7a5e887445f5 req-512e6fdc-7e37-4641-b2df-d694c1cef150 service nova] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Updated VIF entry in instance network info cache for port 507e83bb-2cc6-404c-8b20-c52674fc43e0. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG nova.network.neutron [req-8ff16cab-52dc-4580-a9bd-7a5e887445f5 req-512e6fdc-7e37-4641-b2df-d694c1cef150 service nova] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Updating instance_info_cache with network_info: [{"id": "507e83bb-2cc6-404c-8b20-c52674fc43e0", "address": "fa:16:3e:74:dd:16", "network": {"id": "99653fe8-b4ff-4412-a691-fe3efeaebfb4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-172568374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4884b7eb022949d298aa11ee84a03ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507e83bb-2c", "ovs_interfaceid": "507e83bb-2cc6-404c-8b20-c52674fc43e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:45:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8ff16cab-52dc-4580-a9bd-7a5e887445f5 req-512e6fdc-7e37-4641-b2df-d694c1cef150 service nova] Releasing lock "refresh_cache-2947b710-0e36-4949-96dc-ce455b0bc040" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:45:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:39 user nova-compute[70243]: DEBUG nova.compute.manager [req-c1f44451-59d7-4cbc-bf40-9b2e123fed59 req-5b04a4ea-2a75-43a4-b9ed-ea468189e2b4 service nova] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Received event network-vif-plugged-507e83bb-2cc6-404c-8b20-c52674fc43e0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:45:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c1f44451-59d7-4cbc-bf40-9b2e123fed59 req-5b04a4ea-2a75-43a4-b9ed-ea468189e2b4 service nova] Acquiring lock "2947b710-0e36-4949-96dc-ce455b0bc040-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:45:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c1f44451-59d7-4cbc-bf40-9b2e123fed59 req-5b04a4ea-2a75-43a4-b9ed-ea468189e2b4 service nova] Lock "2947b710-0e36-4949-96dc-ce455b0bc040-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:45:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c1f44451-59d7-4cbc-bf40-9b2e123fed59 req-5b04a4ea-2a75-43a4-b9ed-ea468189e2b4 service nova] Lock "2947b710-0e36-4949-96dc-ce455b0bc040-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:45:39 user nova-compute[70243]: DEBUG nova.compute.manager [req-c1f44451-59d7-4cbc-bf40-9b2e123fed59 req-5b04a4ea-2a75-43a4-b9ed-ea468189e2b4 service nova] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] No waiting events found dispatching network-vif-plugged-507e83bb-2cc6-404c-8b20-c52674fc43e0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:45:39 user nova-compute[70243]: WARNING nova.compute.manager [req-c1f44451-59d7-4cbc-bf40-9b2e123fed59 req-5b04a4ea-2a75-43a4-b9ed-ea468189e2b4 service nova] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Received unexpected event network-vif-plugged-507e83bb-2cc6-404c-8b20-c52674fc43e0 for instance with vm_state building and task_state spawning.
Jul 24 16:45:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:41 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217141.4590387, 2947b710-0e36-4949-96dc-ce455b0bc040 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:45:41 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] VM Resumed (Lifecycle Event)
Jul 24 16:45:41 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:45:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:45:41 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Instance spawned successfully.
Jul 24 16:45:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:45:41 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:45:41 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:45:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:45:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:45:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:45:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:45:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:45:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:45:41 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:45:41 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217141.4625547, 2947b710-0e36-4949-96dc-ce455b0bc040 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:45:41 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] VM Started (Lifecycle Event)
Jul 24 16:45:41 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:45:41 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:45:41 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:45:41 user nova-compute[70243]: INFO nova.compute.manager [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Took 5.43 seconds to spawn the instance on the hypervisor.
Jul 24 16:45:41 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:45:41 user nova-compute[70243]: INFO nova.compute.manager [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Took 6.01 seconds to build instance.
Jul 24 16:45:41 user nova-compute[70243]: DEBUG nova.compute.manager [req-0cf3fc28-393b-425e-a835-2946005c11d8 req-887cf5cf-d706-49de-aaa1-98da78153afe service nova] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Received event network-vif-plugged-507e83bb-2cc6-404c-8b20-c52674fc43e0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:45:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0cf3fc28-393b-425e-a835-2946005c11d8 req-887cf5cf-d706-49de-aaa1-98da78153afe service nova] Acquiring lock "2947b710-0e36-4949-96dc-ce455b0bc040-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:45:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0cf3fc28-393b-425e-a835-2946005c11d8 req-887cf5cf-d706-49de-aaa1-98da78153afe service nova] Lock "2947b710-0e36-4949-96dc-ce455b0bc040-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:45:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0cf3fc28-393b-425e-a835-2946005c11d8 req-887cf5cf-d706-49de-aaa1-98da78153afe service nova] Lock "2947b710-0e36-4949-96dc-ce455b0bc040-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:45:41 user nova-compute[70243]: DEBUG nova.compute.manager [req-0cf3fc28-393b-425e-a835-2946005c11d8 req-887cf5cf-d706-49de-aaa1-98da78153afe service nova] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] No waiting events found dispatching network-vif-plugged-507e83bb-2cc6-404c-8b20-c52674fc43e0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:45:41 user nova-compute[70243]: WARNING nova.compute.manager [req-0cf3fc28-393b-425e-a835-2946005c11d8 req-887cf5cf-d706-49de-aaa1-98da78153afe service nova] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Received unexpected event network-vif-plugged-507e83bb-2cc6-404c-8b20-c52674fc43e0 for instance with vm_state active and task_state None.
Jul 24 16:45:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e35bc9a2-aaee-4e29-8a50-575765db4bd7 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "2947b710-0e36-4949-96dc-ce455b0bc040" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.108s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:45:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:45:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:45:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:45:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:45:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:48 user nova-compute[70243]: DEBUG nova.compute.manager [None req-0dba55e5-4f20-4cae-a03c-d5e62db48f18 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:45:48 user nova-compute[70243]: INFO nova.compute.manager [None req-0dba55e5-4f20-4cae-a03c-d5e62db48f18 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] instance snapshotting
Jul 24 16:45:48 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-0dba55e5-4f20-4cae-a03c-d5e62db48f18 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Beginning live snapshot process
Jul 24 16:45:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0dba55e5-4f20-4cae-a03c-d5e62db48f18 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json -f qcow2 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:45:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0dba55e5-4f20-4cae-a03c-d5e62db48f18 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:45:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0dba55e5-4f20-4cae-a03c-d5e62db48f18 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json -f qcow2 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:45:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0dba55e5-4f20-4cae-a03c-d5e62db48f18 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json -f qcow2" returned: 0 in 0.132s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:45:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0dba55e5-4f20-4cae-a03c-d5e62db48f18 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:45:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0dba55e5-4f20-4cae-a03c-d5e62db48f18 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.134s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:45:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0dba55e5-4f20-4cae-a03c-d5e62db48f18 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_2hvkbwj/426db957b78841eaa10613740ae9d1ff.delta 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:45:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0dba55e5-4f20-4cae-a03c-d5e62db48f18 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_2hvkbwj/426db957b78841eaa10613740ae9d1ff.delta 1073741824" returned: 0 in 0.048s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:45:49 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-0dba55e5-4f20-4cae-a03c-d5e62db48f18 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 24 16:45:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-0dba55e5-4f20-4cae-a03c-d5e62db48f18 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:45:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-0dba55e5-4f20-4cae-a03c-d5e62db48f18 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:45:50 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-0dba55e5-4f20-4cae-a03c-d5e62db48f18 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 24 16:45:50 user nova-compute[70243]: DEBUG nova.privsep.utils [None req-0dba55e5-4f20-4cae-a03c-d5e62db48f18 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70243) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 16:45:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0dba55e5-4f20-4cae-a03c-d5e62db48f18 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_2hvkbwj/426db957b78841eaa10613740ae9d1ff.delta /opt/stack/data/nova/instances/snapshots/tmp_2hvkbwj/426db957b78841eaa10613740ae9d1ff {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:45:51 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-0dba55e5-4f20-4cae-a03c-d5e62db48f18 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_2hvkbwj/426db957b78841eaa10613740ae9d1ff.delta /opt/stack/data/nova/instances/snapshots/tmp_2hvkbwj/426db957b78841eaa10613740ae9d1ff" returned: 0 in 0.291s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:45:51 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-0dba55e5-4f20-4cae-a03c-d5e62db48f18 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Snapshot extracted, beginning image upload
Jul 24 16:45:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:45:53 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-0dba55e5-4f20-4cae-a03c-d5e62db48f18 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Snapshot image upload complete
Jul 24 16:45:53 user nova-compute[70243]: INFO nova.compute.manager [None req-0dba55e5-4f20-4cae-a03c-d5e62db48f18 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Took 4.63 seconds to snapshot the instance on the hypervisor.
Jul 24 16:45:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:45:59 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:46:00 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:46:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:46:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:46:03 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:46:04 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:46:04 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:46:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-98a87000-0c6d-456e-af2e-4a987968cec5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:46:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-98a87000-0c6d-456e-af2e-4a987968cec5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:46:04 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:46:04 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Updating instance_info_cache with network_info: [{"id": "c99192e2-c6e1-457d-959a-af1fc5c081ea", "address": "fa:16:3e:c4:97:6b", "network": {"id": "99653fe8-b4ff-4412-a691-fe3efeaebfb4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-172568374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4884b7eb022949d298aa11ee84a03ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99192e2-c6", "ovs_interfaceid": "c99192e2-c6e1-457d-959a-af1fc5c081ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:46:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-98a87000-0c6d-456e-af2e-4a987968cec5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:46:04 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:46:05 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:46:05 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:46:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:46:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:46:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:46:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:46:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:46:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:46:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2947b710-0e36-4949-96dc-ce455b0bc040/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2947b710-0e36-4949-96dc-ce455b0bc040/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2947b710-0e36-4949-96dc-ce455b0bc040/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2947b710-0e36-4949-96dc-ce455b0bc040/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:07 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:46:07 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:46:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8189MB free_disk=24.00879669189453GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:46:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:46:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:46:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 100c6ba5-de96-4c2a-ae0c-9d3a9199948c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:46:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8c896761-df6a-4f4a-87dd-c5ea30641a89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:46:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 98a87000-0c6d-456e-af2e-4a987968cec5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:46:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance ae152306-9bc0-47a4-b438-2dde63652863 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:46:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 34af24e7-8c92-4b45-8d85-c3b328ec313b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:46:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 2947b710-0e36-4949-96dc-ce455b0bc040 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:46:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:46:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:46:07 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:46:07 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:46:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:46:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:46:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:46:08 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:46:08 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:46:08 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:46:09 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:46:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:46:12 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:46:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:46:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:46:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:46:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:46:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:46:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:46:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:46:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:46:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:46:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:46:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:46:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:46:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:46:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:46:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:46:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:46:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:46:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:46:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:46:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:46:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:46:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:46:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:46:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:46:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:46:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:46:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:46:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:46:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:46:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:46:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:46:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:46:47 user nova-compute[70243]: DEBUG nova.compute.manager [req-fc802239-0369-4d95-b09e-94d02de971ac req-6fbe4ad0-7e69-4ea5-a85f-7d22539ae293 service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Received event network-changed-9616d294-53f6-4722-9cde-15f82a6646cd {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:46:47 user nova-compute[70243]: DEBUG nova.compute.manager [req-fc802239-0369-4d95-b09e-94d02de971ac req-6fbe4ad0-7e69-4ea5-a85f-7d22539ae293 service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Refreshing instance network info cache due to event network-changed-9616d294-53f6-4722-9cde-15f82a6646cd. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:46:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fc802239-0369-4d95-b09e-94d02de971ac req-6fbe4ad0-7e69-4ea5-a85f-7d22539ae293 service nova] Acquiring lock "refresh_cache-34af24e7-8c92-4b45-8d85-c3b328ec313b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:46:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fc802239-0369-4d95-b09e-94d02de971ac req-6fbe4ad0-7e69-4ea5-a85f-7d22539ae293 service nova] Acquired lock "refresh_cache-34af24e7-8c92-4b45-8d85-c3b328ec313b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:46:47 user nova-compute[70243]: DEBUG nova.network.neutron [req-fc802239-0369-4d95-b09e-94d02de971ac req-6fbe4ad0-7e69-4ea5-a85f-7d22539ae293 service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Refreshing network info cache for port 9616d294-53f6-4722-9cde-15f82a6646cd {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:46:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "34af24e7-8c92-4b45-8d85-c3b328ec313b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:46:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "34af24e7-8c92-4b45-8d85-c3b328ec313b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:46:47 user nova-compute[70243]: DEBUG nova.objects.instance [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lazy-loading 'flavor' on Instance uuid 34af24e7-8c92-4b45-8d85-c3b328ec313b {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:46:47 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Ignoring supplied device name: /dev/vdb
Jul 24 16:46:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "34af24e7-8c92-4b45-8d85-c3b328ec313b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:46:47 user nova-compute[70243]: DEBUG nova.network.neutron [req-fc802239-0369-4d95-b09e-94d02de971ac req-6fbe4ad0-7e69-4ea5-a85f-7d22539ae293 service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Updated VIF entry in instance network info cache for port 9616d294-53f6-4722-9cde-15f82a6646cd. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:46:47 user nova-compute[70243]: DEBUG nova.network.neutron [req-fc802239-0369-4d95-b09e-94d02de971ac req-6fbe4ad0-7e69-4ea5-a85f-7d22539ae293 service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Updating instance_info_cache with network_info: [{"id": "9616d294-53f6-4722-9cde-15f82a6646cd", "address": "fa:16:3e:c5:3a:62", "network": {"id": "e788aa0b-b842-4cad-a50d-605499bef92a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-86978474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fc785066034979ade3e9ef1f3ca27c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616d294-53", "ovs_interfaceid": "9616d294-53f6-4722-9cde-15f82a6646cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:46:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fc802239-0369-4d95-b09e-94d02de971ac req-6fbe4ad0-7e69-4ea5-a85f-7d22539ae293 service nova] Releasing lock "refresh_cache-34af24e7-8c92-4b45-8d85-c3b328ec313b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "34af24e7-8c92-4b45-8d85-c3b328ec313b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "34af24e7-8c92-4b45-8d85-c3b328ec313b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:46:48 user nova-compute[70243]: INFO nova.compute.manager [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Attaching volume ec07531f-7134-490f-b297-baf38d072af7 to /dev/vdb
Jul 24 16:46:48 user nova-compute[70243]: DEBUG os_brick.utils [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3b58dd-5c3f-44d0-818e-ee50cf1681d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ae9777-5295-4026-8a80-cedec8868600]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e3e988-b3e1-46f7-b16d-0b2a3ad500a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad82adb-322e-43a8-819e-dcb0fd01dc70]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:46:48 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:46:48 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[76710e7e-a6c0-4fe2-8ac3-b5baadaf5f72]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG os_brick.utils [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:46:48 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Updating existing volume attachment record: 846e61c6-7b49-435f-bddd-822481985207 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:46:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:46:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Rtqczokh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:46:54 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:46:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:46:54 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:46:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:46:54 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:46:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5746d7-a920-4bc6-a6e5-db106a81cb45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:46:54 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f27234a-66ca-47e5-b71e-4cb17edb5da8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7] added
Jul 24 16:46:54 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c771e1-f949-41e8-a079-b8af0d9b8eba]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8952dc-de96-4d75-9abc-f2a3a33e38e8]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Rtqczokh {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Rtqczokh" returned: 0 in 0.024s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abe6de1-ba03-40d0-9636-6a7b23a1e81b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Rtqczokh'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a365b6f2-1837-4b9f-8646-be468c2b0b14]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bacdddc-5e05-4dae-bfde-45a18503173b]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:46:54 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:46:54 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:46:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c9dc1d-5832-4747-a8cd-d9feef57f523]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7, portal: 172.16.0.220,3260]
Jul 24 16:46:55 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7, portal: 172.16.0.220,3260] successful.
Jul 24 16:46:55 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc59233b-d79d-4fb9-8bc7-5da7e770eeae]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2148753-83d7-42ca-a409-122546bef979]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:46:55 user nova-compute[70243]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 (non-flash)
Jul 24 16:46:55 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:46:55 user nova-compute[70243]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 (non-flash)
Jul 24 16:46:55 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b45414-d8b0-4fb7-b64f-798789158b43]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Rtqczokh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "5d83c04d-f127-4d6f-a84f-da05d23a143a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:46:55 user nova-compute[70243]: INFO nova.compute.claims [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Claim successful on node user
Jul 24 16:46:55 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:46:55 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:46:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:46:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:46:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:46:56 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:46:56 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:46:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:46:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:46:56 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26130623263636239', 'path': '/dev/sdb'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:46:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130623263636239', 'path': '/dev/sdb'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:46:56 user nova-compute[70243]: DEBUG nova.objects.instance [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lazy-loading 'flavor' on Instance uuid 34af24e7-8c92-4b45-8d85-c3b328ec313b {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:46:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:46:56 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:46:56 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:46:56 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:46:56 user nova-compute[70243]:   <serial>ec07531f-7134-490f-b297-baf38d072af7</serial>
Jul 24 16:46:56 user nova-compute[70243]: </disk>
Jul 24 16:46:56 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:46:56 user nova-compute[70243]: INFO nova.virt.block_device [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Booting with volume-backed-image 7192dcb0-7da9-4207-b62f-555f7e11e667 at /dev/vda
Jul 24 16:46:56 user nova-compute[70243]: DEBUG nova.policy [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae306b319e8c4e61b0a73933dc5c330c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06cf84dc406343afa81260614acc8fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:46:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:46:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:46:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] No VIF found with MAC fa:16:3e:c5:3a:62, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:46:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:46:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e4589dcc-56bf-4bb1-b28d-edbf0151471d tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "34af24e7-8c92-4b45-8d85-c3b328ec313b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.457s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:46:56 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Successfully created port: 0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:46:57 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Successfully updated port: 0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:46:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "refresh_cache-5d83c04d-f127-4d6f-a84f-da05d23a143a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:46:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquired lock "refresh_cache-5d83c04d-f127-4d6f-a84f-da05d23a143a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:46:57 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:46:57 user nova-compute[70243]: DEBUG nova.compute.manager [req-2fba0f2e-6a23-4cb3-bf0e-c11ec9f8cda0 req-91b2ee9e-de7c-4d84-9532-d122f4b1abea service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received event network-changed-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:46:57 user nova-compute[70243]: DEBUG nova.compute.manager [req-2fba0f2e-6a23-4cb3-bf0e-c11ec9f8cda0 req-91b2ee9e-de7c-4d84-9532-d122f4b1abea service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Refreshing instance network info cache due to event network-changed-0d6be806-d11c-4ff3-b8d2-52339ba59177. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:46:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2fba0f2e-6a23-4cb3-bf0e-c11ec9f8cda0 req-91b2ee9e-de7c-4d84-9532-d122f4b1abea service nova] Acquiring lock "refresh_cache-5d83c04d-f127-4d6f-a84f-da05d23a143a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:46:57 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:46:57 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Updating instance_info_cache with network_info: [{"id": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "address": "fa:16:3e:51:10:29", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6be806-d1", "ovs_interfaceid": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:46:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Releasing lock "refresh_cache-5d83c04d-f127-4d6f-a84f-da05d23a143a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:46:57 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Instance network_info: |[{"id": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "address": "fa:16:3e:51:10:29", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6be806-d1", "ovs_interfaceid": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:46:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2fba0f2e-6a23-4cb3-bf0e-c11ec9f8cda0 req-91b2ee9e-de7c-4d84-9532-d122f4b1abea service nova] Acquired lock "refresh_cache-5d83c04d-f127-4d6f-a84f-da05d23a143a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:46:57 user nova-compute[70243]: DEBUG nova.network.neutron [req-2fba0f2e-6a23-4cb3-bf0e-c11ec9f8cda0 req-91b2ee9e-de7c-4d84-9532-d122f4b1abea service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Refreshing network info cache for port 0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:46:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:46:58 user nova-compute[70243]: DEBUG nova.network.neutron [req-2fba0f2e-6a23-4cb3-bf0e-c11ec9f8cda0 req-91b2ee9e-de7c-4d84-9532-d122f4b1abea service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Updated VIF entry in instance network info cache for port 0d6be806-d11c-4ff3-b8d2-52339ba59177. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:46:58 user nova-compute[70243]: DEBUG nova.network.neutron [req-2fba0f2e-6a23-4cb3-bf0e-c11ec9f8cda0 req-91b2ee9e-de7c-4d84-9532-d122f4b1abea service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Updating instance_info_cache with network_info: [{"id": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "address": "fa:16:3e:51:10:29", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6be806-d1", "ovs_interfaceid": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:46:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2fba0f2e-6a23-4cb3-bf0e-c11ec9f8cda0 req-91b2ee9e-de7c-4d84-9532-d122f4b1abea service nova] Releasing lock "refresh_cache-5d83c04d-f127-4d6f-a84f-da05d23a143a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:47:00 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:47:00 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:47:01 user nova-compute[70243]: DEBUG os_brick.utils [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:47:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68ebd2b-f7db-41f6-afe6-241eec8f03e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd69743-f8ce-434b-8918-f4b06e50dd08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[942db1e6-8746-4b8c-b208-03213a85277b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:01 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e8563e-ee52-48c7-8bb5-9fbb931900f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:01 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:47:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:47:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:47:02 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:47:02 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acd6add-d896-456f-8a25-2a05a6324647]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:47:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:47:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:47:02 user nova-compute[70243]: DEBUG os_brick.utils [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:47:02 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Updating existing volume attachment record: c893e854-1d4f-4ebb-bc07-df4903cd2888 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:47:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:47:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:47:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:47:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:47:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:04 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:47:04 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:47:04 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 16:47:04 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Skipping network cache update for instance because it is Building. {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9835}}
Jul 24 16:47:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-100c6ba5-de96-4c2a-ae0c-9d3a9199948c" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:47:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-100c6ba5-de96-4c2a-ae0c-9d3a9199948c" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:47:04 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:47:04 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lazy-loading 'info_cache' on Instance uuid 100c6ba5-de96-4c2a-ae0c-9d3a9199948c {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:47:04 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Updating instance_info_cache with network_info: [{"id": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "address": "fa:16:3e:03:1c:93", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ce0c89-39", "ovs_interfaceid": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:47:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-100c6ba5-de96-4c2a-ae0c-9d3a9199948c" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:47:04 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:47:05 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:47:05 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:47:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:47:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:47:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:47:05 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:47:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:47:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:47:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2947b710-0e36-4949-96dc-ce455b0bc040/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2947b710-0e36-4949-96dc-ce455b0bc040/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2947b710-0e36-4949-96dc-ce455b0bc040/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2947b710-0e36-4949-96dc-ce455b0bc040/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:07 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:47:07 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:47:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8319MB free_disk=23.999374389648438GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:47:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:47:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:47:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 100c6ba5-de96-4c2a-ae0c-9d3a9199948c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:47:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8c896761-df6a-4f4a-87dd-c5ea30641a89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:47:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 98a87000-0c6d-456e-af2e-4a987968cec5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:47:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance ae152306-9bc0-47a4-b438-2dde63652863 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:47:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 34af24e7-8c92-4b45-8d85-c3b328ec313b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:47:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 2947b710-0e36-4949-96dc-ce455b0bc040 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:47:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5d83c04d-f127-4d6f-a84f-da05d23a143a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:47:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:47:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:47:07 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:47:07 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:47:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:47:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:47:08 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Creating image(s)
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Did not create local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Ensure instance console log exists: /opt/stack/data/nova/instances/5d83c04d-f127-4d6f-a84f-da05d23a143a/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Start _get_guest_xml network_info=[{"id": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "address": "fa:16:3e:51:10:29", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6be806-d1", "ovs_interfaceid": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IPUWLDwr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5d83c04d-f127-4d6f-a84f-da05d23a143a', 'attached_at': '', 'detached_at': '', 'volume_id': '49dd023a-6528-4735-bcdf-a5ca33c750fd', 'serial': '49dd023a-6528-4735-bcdf-a5ca33c750fd'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'c893e854-1d4f-4ebb-bc07-df4903cd2888', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:47:08 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:47:08 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IPUWLDwr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:47:08 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:47:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:47:08 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:47:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:47:08 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f0077c-088d-4d60-85b4-e33d2074ea93]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:47:08 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[78aa2047-c68a-469c-be27-3447ee005911]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd] added
Jul 24 16:47:08 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cfc301-4e4e-4021-9610-f322c27beb20]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[57616864-d4c9-481b-aa51-02ae42c17074]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IPUWLDwr {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IPUWLDwr" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[31452b14-2e0a-4058-b311-14889170f383]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IPUWLDwr'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a27cd3-bd3d-4520-ad83-74d1c1da33cc]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef76c880-42e7-4ce0-a32c-c04906a005c6]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:47:08 user nova-compute[70243]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 (non-flash)
Jul 24 16:47:08 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:47:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:47:08 user nova-compute[70243]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 (non-flash)
Jul 24 16:47:08 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:47:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[812350ed-2e16-4ec9-acc2-bb2b8aae1e51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd, portal: 172.16.0.220,3260]
Jul 24 16:47:09 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd, portal: 172.16.0.220,3260] successful.
Jul 24 16:47:09 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:47:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec4c8c5-3758-4109-ae85-1793a02e827c]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:47:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[45aec728-5c68-4c9b-87fc-a2e838e40051]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:47:09 user nova-compute[70243]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 (non-flash)
Jul 24 16:47:09 user nova-compute[70243]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)
Jul 24 16:47:09 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:47:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:47:09 user nova-compute[70243]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 (non-flash)
Jul 24 16:47:09 user nova-compute[70243]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)
Jul 24 16:47:09 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:47:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:47:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:47:09 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:47:09 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:47:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[283195a5-18a2-4261-a58b-45b18a1ab1be]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:09 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:47:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IPUWLDwr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26636313135383666', 'path': '/dev/sdc'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636313135383666', 'path': '/dev/sdc'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:46:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1882068067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1882068067',id=42,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06cf84dc406343afa81260614acc8fdd',ramdisk_id='',reservation_id='r-6x9eun1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:46:56Z,user_data=None,user_id='ae306b319e8c4e61b0a73933dc5c330c',uuid=5d83c04d-f127-4d6f-a84f-da05d23a143a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "address": "fa:16:3e:51:10:29", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6be806-d1", "ovs_interfaceid": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converting VIF {"id": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "address": "fa:16:3e:51:10:29", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6be806-d1", "ovs_interfaceid": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:10:29,bridge_name='br-int',has_traffic_filtering=True,id=0d6be806-d11c-4ff3-b8d2-52339ba59177,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d6be806-d1') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG nova.objects.instance [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d83c04d-f127-4d6f-a84f-da05d23a143a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:47:10 user nova-compute[70243]:   <uuid>5d83c04d-f127-4d6f-a84f-da05d23a143a</uuid>
Jul 24 16:47:10 user nova-compute[70243]:   <name>instance-0000002a</name>
Jul 24 16:47:10 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:47:10 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:47:10 user nova-compute[70243]:   <metadata>
Jul 24 16:47:10 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:47:10 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:47:10 user nova-compute[70243]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1882068067</nova:name>
Jul 24 16:47:10 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:47:08</nova:creationTime>
Jul 24 16:47:10 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:47:10 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:47:10 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:47:10 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:47:10 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:47:10 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:47:10 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:47:10 user nova-compute[70243]:       <nova:owner>
Jul 24 16:47:10 user nova-compute[70243]:         <nova:user uuid="ae306b319e8c4e61b0a73933dc5c330c">tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member</nova:user>
Jul 24 16:47:10 user nova-compute[70243]:         <nova:project uuid="06cf84dc406343afa81260614acc8fdd">tempest-ServerBootFromVolumeStableRescueTest-1579673828</nova:project>
Jul 24 16:47:10 user nova-compute[70243]:       </nova:owner>
Jul 24 16:47:10 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:47:10 user nova-compute[70243]:       <nova:ports>
Jul 24 16:47:10 user nova-compute[70243]:         <nova:port uuid="0d6be806-d11c-4ff3-b8d2-52339ba59177">
Jul 24 16:47:10 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 24 16:47:10 user nova-compute[70243]:         </nova:port>
Jul 24 16:47:10 user nova-compute[70243]:       </nova:ports>
Jul 24 16:47:10 user nova-compute[70243]:     </nova:instance>
Jul 24 16:47:10 user nova-compute[70243]:   </metadata>
Jul 24 16:47:10 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:47:10 user nova-compute[70243]:     <system>
Jul 24 16:47:10 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:47:10 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:47:10 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:47:10 user nova-compute[70243]:       <entry name="serial">5d83c04d-f127-4d6f-a84f-da05d23a143a</entry>
Jul 24 16:47:10 user nova-compute[70243]:       <entry name="uuid">5d83c04d-f127-4d6f-a84f-da05d23a143a</entry>
Jul 24 16:47:10 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:47:10 user nova-compute[70243]:     </system>
Jul 24 16:47:10 user nova-compute[70243]:   </sysinfo>
Jul 24 16:47:10 user nova-compute[70243]:   <os>
Jul 24 16:47:10 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:47:10 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:47:10 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:47:10 user nova-compute[70243]:   </os>
Jul 24 16:47:10 user nova-compute[70243]:   <features>
Jul 24 16:47:10 user nova-compute[70243]:     <acpi/>
Jul 24 16:47:10 user nova-compute[70243]:     <apic/>
Jul 24 16:47:10 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:47:10 user nova-compute[70243]:   </features>
Jul 24 16:47:10 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:47:10 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:47:10 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:47:10 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:47:10 user nova-compute[70243]:   </clock>
Jul 24 16:47:10 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:47:10 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:47:10 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:47:10 user nova-compute[70243]:   </cpu>
Jul 24 16:47:10 user nova-compute[70243]:   <devices>
Jul 24 16:47:10 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:47:10 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:47:10 user nova-compute[70243]:       <source dev="/dev/sdc"/>
Jul 24 16:47:10 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:47:10 user nova-compute[70243]:       <serial>49dd023a-6528-4735-bcdf-a5ca33c750fd</serial>
Jul 24 16:47:10 user nova-compute[70243]:     </disk>
Jul 24 16:47:10 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:47:10 user nova-compute[70243]:       <mac address="fa:16:3e:51:10:29"/>
Jul 24 16:47:10 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:47:10 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:47:10 user nova-compute[70243]:       <target dev="tap0d6be806-d1"/>
Jul 24 16:47:10 user nova-compute[70243]:     </interface>
Jul 24 16:47:10 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:47:10 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/5d83c04d-f127-4d6f-a84f-da05d23a143a/console.log" append="off"/>
Jul 24 16:47:10 user nova-compute[70243]:     </serial>
Jul 24 16:47:10 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:47:10 user nova-compute[70243]:     <video>
Jul 24 16:47:10 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:47:10 user nova-compute[70243]:     </video>
Jul 24 16:47:10 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:47:10 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:47:10 user nova-compute[70243]:     </rng>
Jul 24 16:47:10 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:47:10 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:47:10 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:47:10 user nova-compute[70243]:     </memballoon>
Jul 24 16:47:10 user nova-compute[70243]:   </devices>
Jul 24 16:47:10 user nova-compute[70243]: </domain>
Jul 24 16:47:10 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:46:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1882068067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1882068067',id=42,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06cf84dc406343afa81260614acc8fdd',ramdisk_id='',reservation_id='r-6x9eun1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:46:56Z,user_data=None,user_id='ae306b319e8c4e61b0a73933dc5c330c',uuid=5d83c04d-f127-4d6f-a84f-da05d23a143a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "address": "fa:16:3e:51:10:29", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6be806-d1", "ovs_interfaceid": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converting VIF {"id": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "address": "fa:16:3e:51:10:29", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6be806-d1", "ovs_interfaceid": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:10:29,bridge_name='br-int',has_traffic_filtering=True,id=0d6be806-d11c-4ff3-b8d2-52339ba59177,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d6be806-d1') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG os_vif [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:10:29,bridge_name='br-int',has_traffic_filtering=True,id=0d6be806-d11c-4ff3-b8d2-52339ba59177,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d6be806-d1') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d6be806-d1, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0d6be806-d1, col_values=(('external_ids', {'iface-id': '0d6be806-d11c-4ff3-b8d2-52339ba59177', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:10:29', 'vm-uuid': '5d83c04d-f127-4d6f-a84f-da05d23a143a'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:10 user nova-compute[70243]: INFO os_vif [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:10:29,bridge_name='br-int',has_traffic_filtering=True,id=0d6be806-d11c-4ff3-b8d2-52339ba59177,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d6be806-d1')
Jul 24 16:47:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] No VIF found with MAC fa:16:3e:51:10:29, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:47:10 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:47:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:11 user nova-compute[70243]: DEBUG nova.compute.manager [req-a63d3e4d-7b85-4200-adc8-3ca444b8a8d7 req-c05214f5-3c19-4d76-8ee1-9bec5932e7a7 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received event network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:47:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a63d3e4d-7b85-4200-adc8-3ca444b8a8d7 req-c05214f5-3c19-4d76-8ee1-9bec5932e7a7 service nova] Acquiring lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:47:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a63d3e4d-7b85-4200-adc8-3ca444b8a8d7 req-c05214f5-3c19-4d76-8ee1-9bec5932e7a7 service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:47:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a63d3e4d-7b85-4200-adc8-3ca444b8a8d7 req-c05214f5-3c19-4d76-8ee1-9bec5932e7a7 service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:47:11 user nova-compute[70243]: DEBUG nova.compute.manager [req-a63d3e4d-7b85-4200-adc8-3ca444b8a8d7 req-c05214f5-3c19-4d76-8ee1-9bec5932e7a7 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] No waiting events found dispatching network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:47:11 user nova-compute[70243]: WARNING nova.compute.manager [req-a63d3e4d-7b85-4200-adc8-3ca444b8a8d7 req-c05214f5-3c19-4d76-8ee1-9bec5932e7a7 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received unexpected event network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 for instance with vm_state building and task_state spawning.
Jul 24 16:47:13 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217233.569712, 5d83c04d-f127-4d6f-a84f-da05d23a143a => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:47:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] VM Resumed (Lifecycle Event)
Jul 24 16:47:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:47:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:47:13 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Instance spawned successfully.
Jul 24 16:47:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:47:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:47:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:47:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:47:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:47:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:47:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:47:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:47:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:47:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:47:13 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217233.5733829, 5d83c04d-f127-4d6f-a84f-da05d23a143a => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:47:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] VM Started (Lifecycle Event)
Jul 24 16:47:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:47:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:47:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:47:13 user nova-compute[70243]: INFO nova.compute.manager [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Took 4.90 seconds to spawn the instance on the hypervisor.
Jul 24 16:47:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:47:13 user nova-compute[70243]: INFO nova.compute.manager [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Took 18.16 seconds to build instance.
Jul 24 16:47:13 user nova-compute[70243]: DEBUG nova.compute.manager [req-6eee7ba9-09f8-4029-96e1-b0797a56ad1b req-4c181b50-bc1b-40ca-aad6-2c83aacf548d service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received event network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:47:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6eee7ba9-09f8-4029-96e1-b0797a56ad1b req-4c181b50-bc1b-40ca-aad6-2c83aacf548d service nova] Acquiring lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:47:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6eee7ba9-09f8-4029-96e1-b0797a56ad1b req-4c181b50-bc1b-40ca-aad6-2c83aacf548d service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:47:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6eee7ba9-09f8-4029-96e1-b0797a56ad1b req-4c181b50-bc1b-40ca-aad6-2c83aacf548d service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:47:13 user nova-compute[70243]: DEBUG nova.compute.manager [req-6eee7ba9-09f8-4029-96e1-b0797a56ad1b req-4c181b50-bc1b-40ca-aad6-2c83aacf548d service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] No waiting events found dispatching network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:47:13 user nova-compute[70243]: WARNING nova.compute.manager [req-6eee7ba9-09f8-4029-96e1-b0797a56ad1b req-4c181b50-bc1b-40ca-aad6-2c83aacf548d service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received unexpected event network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 for instance with vm_state active and task_state None.
Jul 24 16:47:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e2d417e0-a6c3-4324-a380-8022a235bbe3 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.259s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:47:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "34af24e7-8c92-4b45-8d85-c3b328ec313b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:47:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "34af24e7-8c92-4b45-8d85-c3b328ec313b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:47:18 user nova-compute[70243]: INFO nova.compute.manager [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Detaching volume ec07531f-7134-490f-b297-baf38d072af7
Jul 24 16:47:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "34af24e7-8c92-4b45-8d85-c3b328ec313b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:47:18 user nova-compute[70243]: INFO nova.virt.block_device [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Attempting to driver detach volume ec07531f-7134-490f-b297-baf38d072af7 from mountpoint /dev/vdb
Jul 24 16:47:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Attempting to detach device vdb from instance 34af24e7-8c92-4b45-8d85-c3b328ec313b from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:47:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:47:18 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:47:18 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:47:18 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:47:18 user nova-compute[70243]:   <serial>ec07531f-7134-490f-b297-baf38d072af7</serial>
Jul 24 16:47:18 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:47:18 user nova-compute[70243]: </disk>
Jul 24 16:47:18 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:47:18 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Successfully detached device vdb from instance 34af24e7-8c92-4b45-8d85-c3b328ec313b from the persistent domain config.
Jul 24 16:47:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 34af24e7-8c92-4b45-8d85-c3b328ec313b from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:47:18 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:47:18 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:47:18 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:47:18 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:47:18 user nova-compute[70243]:   <serial>ec07531f-7134-490f-b297-baf38d072af7</serial>
Jul 24 16:47:18 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:47:18 user nova-compute[70243]: </disk>
Jul 24 16:47:18 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690217239.2757058, 34af24e7-8c92-4b45-8d85-c3b328ec313b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 34af24e7-8c92-4b45-8d85-c3b328ec313b {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:47:19 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Successfully detached device vdb from instance 34af24e7-8c92-4b45-8d85-c3b328ec313b from the live domain config.
Jul 24 16:47:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Rtqczokh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:47:19 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:47:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6572727-0833-4c54-9da9-fbdd0163d9b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:47:19 user nova-compute[70243]: No targets found.
Jul 24 16:47:19 user nova-compute[70243]: iSNS:
Jul 24 16:47:19 user nova-compute[70243]: No targets found.
Jul 24 16:47:19 user nova-compute[70243]: STATIC:
Jul 24 16:47:19 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7
Jul 24 16:47:19 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:47:19 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:47:19 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3
Jul 24 16:47:19 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:47:19 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:47:19 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd
Jul 24 16:47:19 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:47:19 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:47:19 user nova-compute[70243]: FIRMWARE:
Jul 24 16:47:19 user nova-compute[70243]: No targets found.
Jul 24 16:47:19 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:47:19 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:47:19 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f123a9-b389-40d8-8d44-ddb59e5669a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc91dac-b8e1-4b61-876b-6e8d1a9e8840]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:47:19 user nova-compute[70243]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 (non-flash)
Jul 24 16:47:19 user nova-compute[70243]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)
Jul 24 16:47:19 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:47:19 user nova-compute[70243]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 (non-flash)
Jul 24 16:47:19 user nova-compute[70243]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)
Jul 24 16:47:19 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91ec1a83a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7'): ({'sdb'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Removing single pathed devices sdb {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3080d76f-bacf-4b98-ad8b-7fb48dbb6a85]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6267c652-1e1a-47e4-b4dd-7395cece6b7c]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Flushing IO for device /dev/sdb {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[29918aaa-17bd-4695-a1a1-cc46ce87ecd3]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[adff014a-61ed-4cd5-bab5-fcf69b43cf32]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa08d31d-cb7c-4cc1-853f-bcef62893392]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f664d47-6317-4d38-a828-f57197876539]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7, portal: 172.16.0.220,3260]
Jul 24 16:47:19 user nova-compute[70243]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7, portal: 172.16.0.220,3260] successful.
Jul 24 16:47:19 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a42a097-afed-447f-a6cc-0ff41d6d0110]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] <== disconnect_volume: return (318ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:47:19 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:47:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:20 user nova-compute[70243]: DEBUG nova.objects.instance [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lazy-loading 'flavor' on Instance uuid 34af24e7-8c92-4b45-8d85-c3b328ec313b {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:47:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4b67322a-4451-4a0d-9e7a-8d679abb5032 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "34af24e7-8c92-4b45-8d85-c3b328ec313b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.029s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:47:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "34af24e7-8c92-4b45-8d85-c3b328ec313b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.673s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:47:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "34af24e7-8c92-4b45-8d85-c3b328ec313b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:47:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "34af24e7-8c92-4b45-8d85-c3b328ec313b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:47:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "34af24e7-8c92-4b45-8d85-c3b328ec313b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:47:20 user nova-compute[70243]: INFO nova.compute.manager [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Terminating instance
Jul 24 16:47:20 user nova-compute[70243]: DEBUG nova.compute.manager [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:47:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-3ce964a3-dbba-42fc-ae91-479cd7e0e65f req-684404a5-341d-4043-87ac-bde8a4e8611d service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Received event network-vif-unplugged-9616d294-53f6-4722-9cde-15f82a6646cd {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:47:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3ce964a3-dbba-42fc-ae91-479cd7e0e65f req-684404a5-341d-4043-87ac-bde8a4e8611d service nova] Acquiring lock "34af24e7-8c92-4b45-8d85-c3b328ec313b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:47:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3ce964a3-dbba-42fc-ae91-479cd7e0e65f req-684404a5-341d-4043-87ac-bde8a4e8611d service nova] Lock "34af24e7-8c92-4b45-8d85-c3b328ec313b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:47:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3ce964a3-dbba-42fc-ae91-479cd7e0e65f req-684404a5-341d-4043-87ac-bde8a4e8611d service nova] Lock "34af24e7-8c92-4b45-8d85-c3b328ec313b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:47:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-3ce964a3-dbba-42fc-ae91-479cd7e0e65f req-684404a5-341d-4043-87ac-bde8a4e8611d service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] No waiting events found dispatching network-vif-unplugged-9616d294-53f6-4722-9cde-15f82a6646cd {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:47:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-3ce964a3-dbba-42fc-ae91-479cd7e0e65f req-684404a5-341d-4043-87ac-bde8a4e8611d service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Received event network-vif-unplugged-9616d294-53f6-4722-9cde-15f82a6646cd for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:47:21 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Instance destroyed successfully.
Jul 24 16:47:21 user nova-compute[70243]: DEBUG nova.objects.instance [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lazy-loading 'resources' on Instance uuid 34af24e7-8c92-4b45-8d85-c3b328ec313b {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1601848313',display_name='tempest-VolumesSnapshotTestJSON-instance-1601848313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1601848313',id=40,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+Qyhdm0bGM/gDAGWfnMY960Aid7S9XiC7I6MWhjTOKXTA12NQ+DbTqSt8CoLmgFTUe3BrYQWoMHdg8+JRphuiFhoFkSDr1DaaZiOfHyBCyh1cku2DlekCd6fT+bQkEVA==',key_name='tempest-keypair-1023766368',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:45:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2fc785066034979ade3e9ef1f3ca27c',ramdisk_id='',reservation_id='r-tnaem3dv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1620979851',owner_user_name='tempest-VolumesSnapshotTestJSON-1620979851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:45:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97ec28618df24ff19401d02c0ca3c1a2',uuid=34af24e7-8c92-4b45-8d85-c3b328ec313b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9616d294-53f6-4722-9cde-15f82a6646cd", "address": "fa:16:3e:c5:3a:62", "network": {"id": "e788aa0b-b842-4cad-a50d-605499bef92a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-86978474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fc785066034979ade3e9ef1f3ca27c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616d294-53", "ovs_interfaceid": "9616d294-53f6-4722-9cde-15f82a6646cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Converting VIF {"id": "9616d294-53f6-4722-9cde-15f82a6646cd", "address": "fa:16:3e:c5:3a:62", "network": {"id": "e788aa0b-b842-4cad-a50d-605499bef92a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-86978474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fc785066034979ade3e9ef1f3ca27c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616d294-53", "ovs_interfaceid": "9616d294-53f6-4722-9cde-15f82a6646cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:3a:62,bridge_name='br-int',has_traffic_filtering=True,id=9616d294-53f6-4722-9cde-15f82a6646cd,network=Network(e788aa0b-b842-4cad-a50d-605499bef92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9616d294-53') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG os_vif [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:3a:62,bridge_name='br-int',has_traffic_filtering=True,id=9616d294-53f6-4722-9cde-15f82a6646cd,network=Network(e788aa0b-b842-4cad-a50d-605499bef92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9616d294-53') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9616d294-53, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:47:21 user nova-compute[70243]: INFO os_vif [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:3a:62,bridge_name='br-int',has_traffic_filtering=True,id=9616d294-53f6-4722-9cde-15f82a6646cd,network=Network(e788aa0b-b842-4cad-a50d-605499bef92a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9616d294-53')
Jul 24 16:47:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Rtqczokh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:47:21 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:47:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee668f0-1315-42ec-aff8-90fe92b3f6d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:47:21 user nova-compute[70243]: No targets found.
Jul 24 16:47:21 user nova-compute[70243]: iSNS:
Jul 24 16:47:21 user nova-compute[70243]: No targets found.
Jul 24 16:47:21 user nova-compute[70243]: STATIC:
Jul 24 16:47:21 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3
Jul 24 16:47:21 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:47:21 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:47:21 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd
Jul 24 16:47:21 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:47:21 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:47:21 user nova-compute[70243]: FIRMWARE:
Jul 24 16:47:21 user nova-compute[70243]: No targets found.
Jul 24 16:47:21 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:47:21 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:47:21 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec07531f-7134-490f-b297-baf38d072af7', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dda317-924d-4777-829a-bf0f38572bd5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1015f675-7230-4479-9899-468da2ed5c33]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:47:21 user nova-compute[70243]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)
Jul 24 16:47:21 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:47:21 user nova-compute[70243]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)
Jul 24 16:47:21 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91fb43c280>, {}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Disconnecting from: [] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] <== disconnect_volume: return (73ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:47:21 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Deleting instance files /opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b_del
Jul 24 16:47:21 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Deletion of /opt/stack/data/nova/instances/34af24e7-8c92-4b45-8d85-c3b328ec313b_del complete
Jul 24 16:47:21 user nova-compute[70243]: INFO nova.compute.manager [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 24 16:47:21 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:47:21 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:47:22 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:47:22 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Took 0.87 seconds to deallocate network for instance.
Jul 24 16:47:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-d2481855-1a99-4712-9bf3-8549dd60e729 req-53697010-e8cf-4d8b-aee9-60a72acff020 service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Received event network-vif-deleted-9616d294-53f6-4722-9cde-15f82a6646cd {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:47:22 user nova-compute[70243]: INFO nova.compute.manager [req-d2481855-1a99-4712-9bf3-8549dd60e729 req-53697010-e8cf-4d8b-aee9-60a72acff020 service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Neutron deleted interface 9616d294-53f6-4722-9cde-15f82a6646cd; detaching it from the instance and deleting it from the info cache
Jul 24 16:47:22 user nova-compute[70243]: DEBUG nova.network.neutron [req-d2481855-1a99-4712-9bf3-8549dd60e729 req-53697010-e8cf-4d8b-aee9-60a72acff020 service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:47:22 user nova-compute[70243]: WARNING nova.volume.cinder [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Attachment 846e61c6-7b49-435f-bddd-822481985207 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 846e61c6-7b49-435f-bddd-822481985207. (HTTP 404) (Request-ID: req-98a42700-d932-4458-9be2-d6eb19b8c08f)
Jul 24 16:47:22 user nova-compute[70243]: INFO nova.compute.manager [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Took 0.04 seconds to detach 1 volumes for instance.
Jul 24 16:47:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-d2481855-1a99-4712-9bf3-8549dd60e729 req-53697010-e8cf-4d8b-aee9-60a72acff020 service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Detach interface failed, port_id=9616d294-53f6-4722-9cde-15f82a6646cd, reason: Instance 34af24e7-8c92-4b45-8d85-c3b328ec313b could not be found. {{(pid=70243) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 16:47:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:47:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:47:22 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:47:22 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:47:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:47:22 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Deleted allocations for instance 34af24e7-8c92-4b45-8d85-c3b328ec313b
Jul 24 16:47:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3965fb33-e2f4-4ef5-81ec-dc63077da636 tempest-VolumesSnapshotTestJSON-1620979851 tempest-VolumesSnapshotTestJSON-1620979851-project-member] Lock "34af24e7-8c92-4b45-8d85-c3b328ec313b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.384s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:47:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-bbfb5fd0-bfaf-4907-930a-ee62d146bc96 req-75889093-5191-4bd2-8cf0-3ba9a3e94960 service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Received event network-vif-plugged-9616d294-53f6-4722-9cde-15f82a6646cd {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:47:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-bbfb5fd0-bfaf-4907-930a-ee62d146bc96 req-75889093-5191-4bd2-8cf0-3ba9a3e94960 service nova] Acquiring lock "34af24e7-8c92-4b45-8d85-c3b328ec313b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:47:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-bbfb5fd0-bfaf-4907-930a-ee62d146bc96 req-75889093-5191-4bd2-8cf0-3ba9a3e94960 service nova] Lock "34af24e7-8c92-4b45-8d85-c3b328ec313b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:47:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-bbfb5fd0-bfaf-4907-930a-ee62d146bc96 req-75889093-5191-4bd2-8cf0-3ba9a3e94960 service nova] Lock "34af24e7-8c92-4b45-8d85-c3b328ec313b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:47:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-bbfb5fd0-bfaf-4907-930a-ee62d146bc96 req-75889093-5191-4bd2-8cf0-3ba9a3e94960 service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] No waiting events found dispatching network-vif-plugged-9616d294-53f6-4722-9cde-15f82a6646cd {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:47:22 user nova-compute[70243]: WARNING nova.compute.manager [req-bbfb5fd0-bfaf-4907-930a-ee62d146bc96 req-75889093-5191-4bd2-8cf0-3ba9a3e94960 service nova] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Received unexpected event network-vif-plugged-9616d294-53f6-4722-9cde-15f82a6646cd for instance with vm_state deleted and task_state None.
Jul 24 16:47:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Acquiring lock "2947b710-0e36-4949-96dc-ce455b0bc040" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:47:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "2947b710-0e36-4949-96dc-ce455b0bc040" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:47:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Acquiring lock "2947b710-0e36-4949-96dc-ce455b0bc040-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:47:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "2947b710-0e36-4949-96dc-ce455b0bc040-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:47:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "2947b710-0e36-4949-96dc-ce455b0bc040-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:47:25 user nova-compute[70243]: INFO nova.compute.manager [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Terminating instance
Jul 24 16:47:25 user nova-compute[70243]: DEBUG nova.compute.manager [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:47:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-b44556ba-e7ad-421c-8307-0932aa268845 req-d4ad89ee-ff6f-488a-aa31-058af8491dd8 service nova] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Received event network-vif-unplugged-507e83bb-2cc6-404c-8b20-c52674fc43e0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:47:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b44556ba-e7ad-421c-8307-0932aa268845 req-d4ad89ee-ff6f-488a-aa31-058af8491dd8 service nova] Acquiring lock "2947b710-0e36-4949-96dc-ce455b0bc040-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:47:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b44556ba-e7ad-421c-8307-0932aa268845 req-d4ad89ee-ff6f-488a-aa31-058af8491dd8 service nova] Lock "2947b710-0e36-4949-96dc-ce455b0bc040-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:47:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b44556ba-e7ad-421c-8307-0932aa268845 req-d4ad89ee-ff6f-488a-aa31-058af8491dd8 service nova] Lock "2947b710-0e36-4949-96dc-ce455b0bc040-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:47:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-b44556ba-e7ad-421c-8307-0932aa268845 req-d4ad89ee-ff6f-488a-aa31-058af8491dd8 service nova] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] No waiting events found dispatching network-vif-unplugged-507e83bb-2cc6-404c-8b20-c52674fc43e0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:47:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-b44556ba-e7ad-421c-8307-0932aa268845 req-d4ad89ee-ff6f-488a-aa31-058af8491dd8 service nova] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Received event network-vif-unplugged-507e83bb-2cc6-404c-8b20-c52674fc43e0 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:47:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:26 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Instance destroyed successfully.
Jul 24 16:47:26 user nova-compute[70243]: DEBUG nova.objects.instance [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lazy-loading 'resources' on Instance uuid 2947b710-0e36-4949-96dc-ce455b0bc040 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:47:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1377989575',display_name='tempest-ServersNegativeTestJSON-server-1377989575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1377989575',id=41,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:45:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4884b7eb022949d298aa11ee84a03ec9',ramdisk_id='',reservation_id='r-8n8fj3fy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-851329711',owner_user_name='tempest-ServersNegativeTestJSON-851329711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:45:42Z,user_data=None,user_id='cd85dab5b3c84255b3d784cfeed397c3',uuid=2947b710-0e36-4949-96dc-ce455b0bc040,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "507e83bb-2cc6-404c-8b20-c52674fc43e0", "address": "fa:16:3e:74:dd:16", "network": {"id": "99653fe8-b4ff-4412-a691-fe3efeaebfb4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-172568374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4884b7eb022949d298aa11ee84a03ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507e83bb-2c", "ovs_interfaceid": "507e83bb-2cc6-404c-8b20-c52674fc43e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:47:26 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Converting VIF {"id": "507e83bb-2cc6-404c-8b20-c52674fc43e0", "address": "fa:16:3e:74:dd:16", "network": {"id": "99653fe8-b4ff-4412-a691-fe3efeaebfb4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-172568374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4884b7eb022949d298aa11ee84a03ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap507e83bb-2c", "ovs_interfaceid": "507e83bb-2cc6-404c-8b20-c52674fc43e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:47:26 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:dd:16,bridge_name='br-int',has_traffic_filtering=True,id=507e83bb-2cc6-404c-8b20-c52674fc43e0,network=Network(99653fe8-b4ff-4412-a691-fe3efeaebfb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap507e83bb-2c') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:47:26 user nova-compute[70243]: DEBUG os_vif [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:dd:16,bridge_name='br-int',has_traffic_filtering=True,id=507e83bb-2cc6-404c-8b20-c52674fc43e0,network=Network(99653fe8-b4ff-4412-a691-fe3efeaebfb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap507e83bb-2c') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:47:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap507e83bb-2c, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:47:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:47:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:26 user nova-compute[70243]: INFO os_vif [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:dd:16,bridge_name='br-int',has_traffic_filtering=True,id=507e83bb-2cc6-404c-8b20-c52674fc43e0,network=Network(99653fe8-b4ff-4412-a691-fe3efeaebfb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap507e83bb-2c')
Jul 24 16:47:26 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Deleting instance files /opt/stack/data/nova/instances/2947b710-0e36-4949-96dc-ce455b0bc040_del
Jul 24 16:47:26 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Deletion of /opt/stack/data/nova/instances/2947b710-0e36-4949-96dc-ce455b0bc040_del complete
Jul 24 16:47:26 user nova-compute[70243]: INFO nova.compute.manager [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Took 0.70 seconds to destroy the instance on the hypervisor.
Jul 24 16:47:26 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:47:26 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:47:26 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:47:27 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:47:27 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Took 0.57 seconds to deallocate network for instance.
Jul 24 16:47:27 user nova-compute[70243]: DEBUG nova.compute.manager [req-2c0b3bba-e53f-4d19-b193-f6f1f7ddffe8 req-7a3d6547-c2d7-4f80-9879-af3422e96a7f service nova] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Received event network-vif-deleted-507e83bb-2cc6-404c-8b20-c52674fc43e0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:47:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:47:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:47:27 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:47:27 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:47:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:47:27 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Deleted allocations for instance 2947b710-0e36-4949-96dc-ce455b0bc040
Jul 24 16:47:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8b62eb40-6c0f-49b7-8231-b872b62a8ed8 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "2947b710-0e36-4949-96dc-ce455b0bc040" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.665s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:47:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-f7fc7fa8-f7c8-4a21-be6c-f5de554ae859 req-65846212-c3e3-44a5-9083-17b46b65a850 service nova] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Received event network-vif-plugged-507e83bb-2cc6-404c-8b20-c52674fc43e0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:47:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f7fc7fa8-f7c8-4a21-be6c-f5de554ae859 req-65846212-c3e3-44a5-9083-17b46b65a850 service nova] Acquiring lock "2947b710-0e36-4949-96dc-ce455b0bc040-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:47:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f7fc7fa8-f7c8-4a21-be6c-f5de554ae859 req-65846212-c3e3-44a5-9083-17b46b65a850 service nova] Lock "2947b710-0e36-4949-96dc-ce455b0bc040-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:47:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f7fc7fa8-f7c8-4a21-be6c-f5de554ae859 req-65846212-c3e3-44a5-9083-17b46b65a850 service nova] Lock "2947b710-0e36-4949-96dc-ce455b0bc040-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:47:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-f7fc7fa8-f7c8-4a21-be6c-f5de554ae859 req-65846212-c3e3-44a5-9083-17b46b65a850 service nova] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] No waiting events found dispatching network-vif-plugged-507e83bb-2cc6-404c-8b20-c52674fc43e0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:47:28 user nova-compute[70243]: WARNING nova.compute.manager [req-f7fc7fa8-f7c8-4a21-be6c-f5de554ae859 req-65846212-c3e3-44a5-9083-17b46b65a850 service nova] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Received unexpected event network-vif-plugged-507e83bb-2cc6-404c-8b20-c52674fc43e0 for instance with vm_state deleted and task_state None.
Jul 24 16:47:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:36 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690217241.2211947, 34af24e7-8c92-4b45-8d85-c3b328ec313b => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:47:36 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] VM Stopped (Lifecycle Event)
Jul 24 16:47:36 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c682ecb3-169d-42ba-b6fe-6e3666e1b28a None None] [instance: 34af24e7-8c92-4b45-8d85-c3b328ec313b] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:47:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:41 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690217246.3293626, 2947b710-0e36-4949-96dc-ce455b0bc040 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:47:41 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] VM Stopped (Lifecycle Event)
Jul 24 16:47:41 user nova-compute[70243]: DEBUG nova.compute.manager [None req-1b5e0228-6e69-4a93-aab5-871caa289f76 None None] [instance: 2947b710-0e36-4949-96dc-ce455b0bc040] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:47:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:46 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:47:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:47:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:00 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:48:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:02 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:48:06 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:48:06 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:48:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-8c896761-df6a-4f4a-87dd-c5ea30641a89" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:48:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-8c896761-df6a-4f4a-87dd-c5ea30641a89" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:48:06 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:48:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:48:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:48:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:48:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:48:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:48:06 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Updating instance_info_cache with network_info: [{"id": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "address": "fa:16:3e:a5:da:73", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa5a7d4-ef", "ovs_interfaceid": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:48:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-8c896761-df6a-4f4a-87dd-c5ea30641a89" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:48:06 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:48:07 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:48:07 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:48:07 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:48:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:48:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:48:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:48:07 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:48:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:48:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:48:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:48:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:48:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:48:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:48:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:48:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:48:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:48:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:48:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:48:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:48:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:48:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:48:08 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:48:08 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:48:08 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8419MB free_disk=24.053234100341797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:48:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:48:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:48:08 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 100c6ba5-de96-4c2a-ae0c-9d3a9199948c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:48:08 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8c896761-df6a-4f4a-87dd-c5ea30641a89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:48:08 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 98a87000-0c6d-456e-af2e-4a987968cec5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:48:08 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance ae152306-9bc0-47a4-b438-2dde63652863 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:48:08 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5d83c04d-f127-4d6f-a84f-da05d23a143a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:48:08 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:48:08 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:48:08 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:48:08 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:48:09 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:48:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.309s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:48:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:10 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:48:10 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:48:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:48:11 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:48:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:12 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:48:16 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:48:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:46 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:48:46 user nova-compute[70243]: INFO nova.compute.manager [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Rescuing
Jul 24 16:48:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "refresh_cache-5d83c04d-f127-4d6f-a84f-da05d23a143a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:48:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquired lock "refresh_cache-5d83c04d-f127-4d6f-a84f-da05d23a143a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:48:46 user nova-compute[70243]: DEBUG nova.network.neutron [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:48:47 user nova-compute[70243]: DEBUG nova.network.neutron [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Updating instance_info_cache with network_info: [{"id": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "address": "fa:16:3e:51:10:29", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6be806-d1", "ovs_interfaceid": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:48:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Releasing lock "refresh_cache-5d83c04d-f127-4d6f-a84f-da05d23a143a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:48:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:47 user nova-compute[70243]: DEBUG nova.compute.manager [req-35e9bbab-f73b-4c05-83d4-b10ebd50aff8 req-4db28877-7230-4fe8-9ecf-a7fb2a41d621 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received event network-vif-unplugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:48:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-35e9bbab-f73b-4c05-83d4-b10ebd50aff8 req-4db28877-7230-4fe8-9ecf-a7fb2a41d621 service nova] Acquiring lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:48:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-35e9bbab-f73b-4c05-83d4-b10ebd50aff8 req-4db28877-7230-4fe8-9ecf-a7fb2a41d621 service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:48:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-35e9bbab-f73b-4c05-83d4-b10ebd50aff8 req-4db28877-7230-4fe8-9ecf-a7fb2a41d621 service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:48:47 user nova-compute[70243]: DEBUG nova.compute.manager [req-35e9bbab-f73b-4c05-83d4-b10ebd50aff8 req-4db28877-7230-4fe8-9ecf-a7fb2a41d621 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] No waiting events found dispatching network-vif-unplugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:48:47 user nova-compute[70243]: WARNING nova.compute.manager [req-35e9bbab-f73b-4c05-83d4-b10ebd50aff8 req-4db28877-7230-4fe8-9ecf-a7fb2a41d621 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received unexpected event network-vif-unplugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 for instance with vm_state active and task_state rescuing.
Jul 24 16:48:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:48 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Instance destroyed successfully.
Jul 24 16:48:48 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Attempting a stable device rescue
Jul 24 16:48:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=70243) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 24 16:48:48 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Instance directory exists: not creating {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 24 16:48:48 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Creating image(s)
Jul 24 16:48:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d83c04d-f127-4d6f-a84f-da05d23a143a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:48:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "/opt/stack/data/nova/instances/5d83c04d-f127-4d6f-a84f-da05d23a143a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:48:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "/opt/stack/data/nova/instances/5d83c04d-f127-4d6f-a84f-da05d23a143a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:48:48 user nova-compute[70243]: DEBUG nova.objects.instance [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5d83c04d-f127-4d6f-a84f-da05d23a143a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:48:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "e07dafd856675ca74d6bdcd61d86090d4f91cf4c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:48:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "e07dafd856675ca74d6bdcd61d86090d4f91cf4c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e07dafd856675ca74d6bdcd61d86090d4f91cf4c.part --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e07dafd856675ca74d6bdcd61d86090d4f91cf4c.part --force-share --output=json" returned: 0 in 0.144s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.virt.images [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] eb892634-ee21-4518-a727-06dce6e8b522 was qcow2, converting to raw {{(pid=70243) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.privsep.utils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70243) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e07dafd856675ca74d6bdcd61d86090d4f91cf4c.part /opt/stack/data/nova/instances/_base/e07dafd856675ca74d6bdcd61d86090d4f91cf4c.converted {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e07dafd856675ca74d6bdcd61d86090d4f91cf4c.part /opt/stack/data/nova/instances/_base/e07dafd856675ca74d6bdcd61d86090d4f91cf4c.converted" returned: 0 in 0.230s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e07dafd856675ca74d6bdcd61d86090d4f91cf4c.converted --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e07dafd856675ca74d6bdcd61d86090d4f91cf4c.converted --force-share --output=json" returned: 0 in 0.150s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "e07dafd856675ca74d6bdcd61d86090d4f91cf4c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.485s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "e07dafd856675ca74d6bdcd61d86090d4f91cf4c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "e07dafd856675ca74d6bdcd61d86090d4f91cf4c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e07dafd856675ca74d6bdcd61d86090d4f91cf4c --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.compute.manager [req-cb3b20fa-51a2-4b60-9609-f0934fe968d7 req-e0cba666-fa40-4cd3-b102-05fa5e2ea458 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received event network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cb3b20fa-51a2-4b60-9609-f0934fe968d7 req-e0cba666-fa40-4cd3-b102-05fa5e2ea458 service nova] Acquiring lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cb3b20fa-51a2-4b60-9609-f0934fe968d7 req-e0cba666-fa40-4cd3-b102-05fa5e2ea458 service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cb3b20fa-51a2-4b60-9609-f0934fe968d7 req-e0cba666-fa40-4cd3-b102-05fa5e2ea458 service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.compute.manager [req-cb3b20fa-51a2-4b60-9609-f0934fe968d7 req-e0cba666-fa40-4cd3-b102-05fa5e2ea458 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] No waiting events found dispatching network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:48:49 user nova-compute[70243]: WARNING nova.compute.manager [req-cb3b20fa-51a2-4b60-9609-f0934fe968d7 req-e0cba666-fa40-4cd3-b102-05fa5e2ea458 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received unexpected event network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 for instance with vm_state active and task_state rescuing.
Jul 24 16:48:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e07dafd856675ca74d6bdcd61d86090d4f91cf4c --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e07dafd856675ca74d6bdcd61d86090d4f91cf4c,backing_fmt=raw /opt/stack/data/nova/instances/5d83c04d-f127-4d6f-a84f-da05d23a143a/disk.rescue {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e07dafd856675ca74d6bdcd61d86090d4f91cf4c,backing_fmt=raw /opt/stack/data/nova/instances/5d83c04d-f127-4d6f-a84f-da05d23a143a/disk.rescue" returned: 0 in 0.049s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "e07dafd856675ca74d6bdcd61d86090d4f91cf4c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.objects.instance [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'migration_context' on Instance uuid 5d83c04d-f127-4d6f-a84f-da05d23a143a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Start _get_guest_xml network_info=[{"id": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "address": "fa:16:3e:51:10:29", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "vif_mac": "fa:16:3e:51:10:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6be806-d1", "ovs_interfaceid": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'eb892634-ee21-4518-a727-06dce6e8b522', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IPUWLDwr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '5d83c04d-f127-4d6f-a84f-da05d23a143a', 'attached_at': '', 'detached_at': '', 'volume_id': '49dd023a-6528-4735-bcdf-a5ca33c750fd', 'serial': '49dd023a-6528-4735-bcdf-a5ca33c750fd'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'c893e854-1d4f-4ebb-bc07-df4903cd2888', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.objects.instance [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'resources' on Instance uuid 5d83c04d-f127-4d6f-a84f-da05d23a143a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.objects.instance [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'numa_topology' on Instance uuid 5d83c04d-f127-4d6f-a84f-da05d23a143a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:48:49 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:48:49 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.objects.instance [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5d83c04d-f127-4d6f-a84f-da05d23a143a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:48:49 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IPUWLDwr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:48:50 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:48:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:48:50 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:48:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:48:50 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:48:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[005a884b-039f-4f41-b39f-a407c079baf7]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = IPUWLDwr\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 24 16:48:50 user nova-compute[70243]: node.name = iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd
Jul 24 16:48:50 user nova-compute[70243]: node.tpgt = -1
Jul 24 16:48:50 user nova-compute[70243]: node.startup = automatic
Jul 24 16:48:50 user nova-compute[70243]: node.leading_login = No
Jul 24 16:48:50 user nova-compute[70243]: iface.iscsi_ifacename = default
Jul 24 16:48:50 user nova-compute[70243]: iface.net_ifacename = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.ipaddress = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.prefix_len = 0
Jul 24 16:48:50 user nova-compute[70243]: iface.hwaddress = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.transport_name = tcp
Jul 24 16:48:50 user nova-compute[70243]: iface.initiatorname = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.state = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.vlan_id = 0
Jul 24 16:48:50 user nova-compute[70243]: iface.vlan_priority = 0
Jul 24 16:48:50 user nova-compute[70243]: iface.vlan_state = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.iface_num = 0
Jul 24 16:48:50 user nova-compute[70243]: iface.mtu = 0
Jul 24 16:48:50 user nova-compute[70243]: iface.port = 0
Jul 24 16:48:50 user nova-compute[70243]: iface.bootproto = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.subnet_mask = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.gateway = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.dhcp_alt_client_id_state = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.dhcp_alt_client_id = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.dhcp_dns = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.dhcp_learn_iqn = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.dhcp_req_vendor_id_state = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.dhcp_vendor_id_state = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.dhcp_vendor_id = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.dhcp_slp_da = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.fragmentation = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.gratuitous_arp = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.incoming_forwarding = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.tos_state = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.tos = 0
Jul 24 16:48:50 user nova-compute[70243]: iface.ttl = 0
Jul 24 16:48:50 user nova-compute[70243]: iface.delayed_ack = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.tcp_nagle = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.tcp_wsf_state = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.tcp_wsf = 0
Jul 24 16:48:50 user nova-compute[70243]: iface.tcp_timer_scale = 0
Jul 24 16:48:50 user nova-compute[70243]: iface.tcp_timestamp = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.redirect = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.def_task_mgmt_timeout = 0
Jul 24 16:48:50 user nova-compute[70243]: iface.header_digest = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.data_digest = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.immediate_data = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.initial_r2t = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.data_seq_inorder = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.data_pdu_inorder = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.erl = 0
Jul 24 16:48:50 user nova-compute[70243]: iface.max_receive_data_len = 0
Jul 24 16:48:50 user nova-compute[70243]: iface.first_burst_len = 0
Jul 24 16:48:50 user nova-compute[70243]: iface.max_outstanding_r2t = 0
Jul 24 16:48:50 user nova-compute[70243]: iface.max_burst_len = 0
Jul 24 16:48:50 user nova-compute[70243]: iface.chap_auth = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.bidi_chap = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.strict_login_compliance = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.discovery_auth = <empty>
Jul 24 16:48:50 user nova-compute[70243]: iface.discovery_logout = <empty>
Jul 24 16:48:50 user nova-compute[70243]: node.discovery_address = <empty>
Jul 24 16:48:50 user nova-compute[70243]: node.discovery_port = 0
Jul 24 16:48:50 user nova-compute[70243]: node.discovery_type = static
Jul 24 16:48:50 user nova-compute[70243]: node.session.initial_cmdsn = 0
Jul 24 16:48:50 user nova-compute[70243]: node.session.initial_login_retry_max = 8
Jul 24 16:48:50 user nova-compute[70243]: node.session.xmit_thread_priority = -20
Jul 24 16:48:50 user nova-compute[70243]: node.session.cmds_max = 128
Jul 24 16:48:50 user nova-compute[70243]: node.session.queue_depth = 32
Jul 24 16:48:50 user nova-compute[70243]: node.session.nr_sessions = 1
Jul 24 16:48:50 user nova-compute[70243]: node.session.auth.authmethod = CHAP
Jul 24 16:48:50 user nova-compute[70243]: node.session.auth.username = IPUWLDwr
Jul 24 16:48:50 user nova-compute[70243]: node.session.auth.password = ***
Jul 24 16:48:50 user nova-compute[70243]: node.session.auth.username_in = <empty>
Jul 24 16:48:50 user nova-compute[70243]: node.session.auth.password_in = <empty>
Jul 24 16:48:50 user nova-compute[70243]: node.session.auth.chap_algs = MD5
Jul 24 16:48:50 user nova-compute[70243]: node.session.timeo.replacement_timeout = 120
Jul 24 16:48:50 user nova-compute[70243]: node.session.err_timeo.abort_timeout = 15
Jul 24 16:48:50 user nova-compute[70243]: node.session.err_timeo.lu_reset_timeout = 30
Jul 24 16:48:50 user nova-compute[70243]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 24 16:48:50 user nova-compute[70243]: node.session.err_timeo.host_reset_timeout = 60
Jul 24 16:48:50 user nova-compute[70243]: node.session.iscsi.FastAbort = Yes
Jul 24 16:48:50 user nova-compute[70243]: node.session.iscsi.InitialR2T = No
Jul 24 16:48:50 user nova-compute[70243]: node.session.iscsi.ImmediateData = Yes
Jul 24 16:48:50 user nova-compute[70243]: node.session.iscsi.FirstBurstLength = 262144
Jul 24 16:48:50 user nova-compute[70243]: node.session.iscsi.MaxBurstLength = 16776192
Jul 24 16:48:50 user nova-compute[70243]: node.session.iscsi.DefaultTime2Retain = 0
Jul 24 16:48:50 user nova-compute[70243]: node.session.iscsi.DefaultTime2Wait = 2
Jul 24 16:48:50 user nova-compute[70243]: node.session.iscsi.MaxConnections = 1
Jul 24 16:48:50 user nova-compute[70243]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 24 16:48:50 user nova-compute[70243]: node.session.iscsi.ERL = 0
Jul 24 16:48:50 user nova-compute[70243]: node.session.scan = manual
Jul 24 16:48:50 user nova-compute[70243]: node.session.reopen_max = 0
Jul 24 16:48:50 user nova-compute[70243]: node.conn[0].address = 172.16.0.220
Jul 24 16:48:50 user nova-compute[70243]: node.conn[0].port = 3260
Jul 24 16:48:50 user nova-compute[70243]: node.conn[0].startup = manual
Jul 24 16:48:50 user nova-compute[70243]: node.conn[0].tcp.window_size = 524288
Jul 24 16:48:50 user nova-compute[70243]: node.conn[0].tcp.type_of_service = 0
Jul 24 16:48:50 user nova-compute[70243]: node.conn[0].timeo.logout_timeout = 15
Jul 24 16:48:50 user nova-compute[70243]: node.conn[0].timeo.login_timeout = 15
Jul 24 16:48:50 user nova-compute[70243]: node.conn[0].timeo.auth_timeout = 45
Jul 24 16:48:50 user nova-compute[70243]: node.conn[0].timeo.noop_out_interval = 5
Jul 24 16:48:50 user nova-compute[70243]: node.conn[0].timeo.noop_out_timeout = 5
Jul 24 16:48:50 user nova-compute[70243]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 24 16:48:50 user nova-compute[70243]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 24 16:48:50 user nova-compute[70243]: node.conn[0].iscsi.HeaderDigest = None
Jul 24 16:48:50 user nova-compute[70243]: node.conn[0].iscsi.DataDigest = None
Jul 24 16:48:50 user nova-compute[70243]: node.conn[0].iscsi.IFMarker = No
Jul 24 16:48:50 user nova-compute[70243]: node.conn[0].iscsi.OFMarker = No
Jul 24 16:48:50 user nova-compute[70243]: # END RECORD
Jul 24 16:48:50 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9502d2-ba2c-41a2-9c4b-02dbd81539b0]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[060fbed4-6092-4661-ab46-66f1540c2fa4]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IPUWLDwr {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IPUWLDwr" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4633c97d-3453-46a9-83e8-f632b043e528]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IPUWLDwr'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f0e3f4-81d4-4ba7-8905-0b461c5466df]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[05017d20-8491-41c4-98a0-43ea862f5465]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:48:50 user nova-compute[70243]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)
Jul 24 16:48:50 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:48:50 user nova-compute[70243]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)
Jul 24 16:48:50 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.136s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] HCTL ('34', '0', '0', 0) found on session 50 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33f9131-2038-4ccf-97a8-229821a44638]: (4, ('0 0 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Searching for a device in session 50 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IPUWLDwr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.159s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] <== connect_volume: return (160ms) {'type': 'block', 'scsi_wwn': '26636313135383666', 'path': '/dev/sdc'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636313135383666', 'path': '/dev/sdc'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:46:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1882068067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1882068067',id=42,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:47:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06cf84dc406343afa81260614acc8fdd',ramdisk_id='',reservation_id='r-6x9eun1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:47:14Z,user_data=None,user_id='ae306b319e8c4e61b0a73933dc5c330c',uuid=5d83c04d-f127-4d6f-a84f-da05d23a143a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "address": "fa:16:3e:51:10:29", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "vif_mac": "fa:16:3e:51:10:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6be806-d1", "ovs_interfaceid": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converting VIF {"id": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "address": "fa:16:3e:51:10:29", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "vif_mac": "fa:16:3e:51:10:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6be806-d1", "ovs_interfaceid": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:10:29,bridge_name='br-int',has_traffic_filtering=True,id=0d6be806-d11c-4ff3-b8d2-52339ba59177,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d6be806-d1') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG nova.objects.instance [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d83c04d-f127-4d6f-a84f-da05d23a143a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:48:50 user nova-compute[70243]:   <uuid>5d83c04d-f127-4d6f-a84f-da05d23a143a</uuid>
Jul 24 16:48:50 user nova-compute[70243]:   <name>instance-0000002a</name>
Jul 24 16:48:50 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:48:50 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:48:50 user nova-compute[70243]:   <metadata>
Jul 24 16:48:50 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:48:50 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:48:50 user nova-compute[70243]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1882068067</nova:name>
Jul 24 16:48:50 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:48:49</nova:creationTime>
Jul 24 16:48:50 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:48:50 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:48:50 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:48:50 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:48:50 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:48:50 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:48:50 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:48:50 user nova-compute[70243]:       <nova:owner>
Jul 24 16:48:50 user nova-compute[70243]:         <nova:user uuid="ae306b319e8c4e61b0a73933dc5c330c">tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member</nova:user>
Jul 24 16:48:50 user nova-compute[70243]:         <nova:project uuid="06cf84dc406343afa81260614acc8fdd">tempest-ServerBootFromVolumeStableRescueTest-1579673828</nova:project>
Jul 24 16:48:50 user nova-compute[70243]:       </nova:owner>
Jul 24 16:48:50 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:48:50 user nova-compute[70243]:       <nova:ports>
Jul 24 16:48:50 user nova-compute[70243]:         <nova:port uuid="0d6be806-d11c-4ff3-b8d2-52339ba59177">
Jul 24 16:48:50 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 24 16:48:50 user nova-compute[70243]:         </nova:port>
Jul 24 16:48:50 user nova-compute[70243]:       </nova:ports>
Jul 24 16:48:50 user nova-compute[70243]:     </nova:instance>
Jul 24 16:48:50 user nova-compute[70243]:   </metadata>
Jul 24 16:48:50 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:48:50 user nova-compute[70243]:     <system>
Jul 24 16:48:50 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:48:50 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:48:50 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:48:50 user nova-compute[70243]:       <entry name="serial">5d83c04d-f127-4d6f-a84f-da05d23a143a</entry>
Jul 24 16:48:50 user nova-compute[70243]:       <entry name="uuid">5d83c04d-f127-4d6f-a84f-da05d23a143a</entry>
Jul 24 16:48:50 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:48:50 user nova-compute[70243]:     </system>
Jul 24 16:48:50 user nova-compute[70243]:   </sysinfo>
Jul 24 16:48:50 user nova-compute[70243]:   <os>
Jul 24 16:48:50 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:48:50 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:48:50 user nova-compute[70243]:   </os>
Jul 24 16:48:50 user nova-compute[70243]:   <features>
Jul 24 16:48:50 user nova-compute[70243]:     <acpi/>
Jul 24 16:48:50 user nova-compute[70243]:     <apic/>
Jul 24 16:48:50 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:48:50 user nova-compute[70243]:   </features>
Jul 24 16:48:50 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:48:50 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:48:50 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:48:50 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:48:50 user nova-compute[70243]:   </clock>
Jul 24 16:48:50 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:48:50 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:48:50 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:48:50 user nova-compute[70243]:   </cpu>
Jul 24 16:48:50 user nova-compute[70243]:   <devices>
Jul 24 16:48:50 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:48:50 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:48:50 user nova-compute[70243]:       <source dev="/dev/sdc"/>
Jul 24 16:48:50 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:48:50 user nova-compute[70243]:       <serial>49dd023a-6528-4735-bcdf-a5ca33c750fd</serial>
Jul 24 16:48:50 user nova-compute[70243]:     </disk>
Jul 24 16:48:50 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:48:50 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:48:50 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/5d83c04d-f127-4d6f-a84f-da05d23a143a/disk.rescue"/>
Jul 24 16:48:50 user nova-compute[70243]:       <target dev="vdb" bus="virtio"/>
Jul 24 16:48:50 user nova-compute[70243]:       <boot order="1"/>
Jul 24 16:48:50 user nova-compute[70243]:     </disk>
Jul 24 16:48:50 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:48:50 user nova-compute[70243]:       <mac address="fa:16:3e:51:10:29"/>
Jul 24 16:48:50 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:48:50 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:48:50 user nova-compute[70243]:       <target dev="tap0d6be806-d1"/>
Jul 24 16:48:50 user nova-compute[70243]:     </interface>
Jul 24 16:48:50 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:48:50 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/5d83c04d-f127-4d6f-a84f-da05d23a143a/console.log" append="off"/>
Jul 24 16:48:50 user nova-compute[70243]:     </serial>
Jul 24 16:48:50 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:48:50 user nova-compute[70243]:     <video>
Jul 24 16:48:50 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:48:50 user nova-compute[70243]:     </video>
Jul 24 16:48:50 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:48:50 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:48:50 user nova-compute[70243]:     </rng>
Jul 24 16:48:50 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:48:50 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:48:50 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:48:50 user nova-compute[70243]:     </memballoon>
Jul 24 16:48:50 user nova-compute[70243]:   </devices>
Jul 24 16:48:50 user nova-compute[70243]: </domain>
Jul 24 16:48:50 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:48:50 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Instance destroyed successfully.
Jul 24 16:48:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:48:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] No VIF found with MAC fa:16:3e:51:10:29, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:48:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:51 user nova-compute[70243]: DEBUG nova.compute.manager [req-928cb359-43d0-4d56-b82a-35aa7fc09021 req-507d0708-6917-4f15-af89-eb668712e2a8 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received event network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:48:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-928cb359-43d0-4d56-b82a-35aa7fc09021 req-507d0708-6917-4f15-af89-eb668712e2a8 service nova] Acquiring lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:48:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-928cb359-43d0-4d56-b82a-35aa7fc09021 req-507d0708-6917-4f15-af89-eb668712e2a8 service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:48:51 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-928cb359-43d0-4d56-b82a-35aa7fc09021 req-507d0708-6917-4f15-af89-eb668712e2a8 service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:48:51 user nova-compute[70243]: DEBUG nova.compute.manager [req-928cb359-43d0-4d56-b82a-35aa7fc09021 req-507d0708-6917-4f15-af89-eb668712e2a8 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] No waiting events found dispatching network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:48:51 user nova-compute[70243]: WARNING nova.compute.manager [req-928cb359-43d0-4d56-b82a-35aa7fc09021 req-507d0708-6917-4f15-af89-eb668712e2a8 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received unexpected event network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 for instance with vm_state active and task_state rescuing.
Jul 24 16:48:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Removed pending event for 5d83c04d-f127-4d6f-a84f-da05d23a143a due to event {{(pid=70243) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 16:48:53 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217333.7566068, 5d83c04d-f127-4d6f-a84f-da05d23a143a => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:48:53 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] VM Resumed (Lifecycle Event)
Jul 24 16:48:53 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b8e381a5-8ba9-4b1f-8a2c-94ec8a5c516c tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:48:53 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:48:53 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:48:53 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 24 16:48:53 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217333.7582834, 5d83c04d-f127-4d6f-a84f-da05d23a143a => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:48:53 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] VM Started (Lifecycle Event)
Jul 24 16:48:53 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:48:53 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:48:53 user nova-compute[70243]: DEBUG nova.compute.manager [req-5b5563bd-06e0-420b-b6e0-825a622002b3 req-586e0f0d-8369-4c9b-8919-e3ee7bceaa46 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received event network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:48:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5b5563bd-06e0-420b-b6e0-825a622002b3 req-586e0f0d-8369-4c9b-8919-e3ee7bceaa46 service nova] Acquiring lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:48:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5b5563bd-06e0-420b-b6e0-825a622002b3 req-586e0f0d-8369-4c9b-8919-e3ee7bceaa46 service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:48:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5b5563bd-06e0-420b-b6e0-825a622002b3 req-586e0f0d-8369-4c9b-8919-e3ee7bceaa46 service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:48:53 user nova-compute[70243]: DEBUG nova.compute.manager [req-5b5563bd-06e0-420b-b6e0-825a622002b3 req-586e0f0d-8369-4c9b-8919-e3ee7bceaa46 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] No waiting events found dispatching network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:48:53 user nova-compute[70243]: WARNING nova.compute.manager [req-5b5563bd-06e0-420b-b6e0-825a622002b3 req-586e0f0d-8369-4c9b-8919-e3ee7bceaa46 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received unexpected event network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 for instance with vm_state active and task_state rescuing.
Jul 24 16:48:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:48:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:49:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:49:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:49:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:49:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:02 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:49:03 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:49:06 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:49:06 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:49:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-98a87000-0c6d-456e-af2e-4a987968cec5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:49:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-98a87000-0c6d-456e-af2e-4a987968cec5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:49:06 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:49:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:06 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Updating instance_info_cache with network_info: [{"id": "c99192e2-c6e1-457d-959a-af1fc5c081ea", "address": "fa:16:3e:c4:97:6b", "network": {"id": "99653fe8-b4ff-4412-a691-fe3efeaebfb4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-172568374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4884b7eb022949d298aa11ee84a03ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99192e2-c6", "ovs_interfaceid": "c99192e2-c6e1-457d-959a-af1fc5c081ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:49:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-98a87000-0c6d-456e-af2e-4a987968cec5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:49:06 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:49:07 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:49:08 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:49:08 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:49:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:49:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:49:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:49:08 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:49:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:49:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:49:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:49:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:49:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:49:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:49:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:49:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:49:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d83c04d-f127-4d6f-a84f-da05d23a143a/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d83c04d-f127-4d6f-a84f-da05d23a143a/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:49:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d83c04d-f127-4d6f-a84f-da05d23a143a/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d83c04d-f127-4d6f-a84f-da05d23a143a/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:49:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:10 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:49:10 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:49:10 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8409MB free_disk=23.95555877685547GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:49:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:49:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:49:10 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 100c6ba5-de96-4c2a-ae0c-9d3a9199948c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:49:10 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8c896761-df6a-4f4a-87dd-c5ea30641a89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:49:10 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 98a87000-0c6d-456e-af2e-4a987968cec5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:49:10 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance ae152306-9bc0-47a4-b438-2dde63652863 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:49:10 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5d83c04d-f127-4d6f-a84f-da05d23a143a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:49:10 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:49:10 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:49:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:10 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:49:10 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:49:10 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:49:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:49:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:11 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:49:11 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:49:11 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:49:11 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:49:12 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:49:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:16 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:24 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:49:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70243) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 16:49:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:29 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:49:29 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Cleaning up deleted instances {{(pid=70243) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 16:49:29 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] There are 0 instances to clean {{(pid=70243) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 16:49:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquiring lock "5543fd2b-5470-4508-a9ca-4f13c738532b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:49:32 user nova-compute[70243]: INFO nova.compute.claims [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Claim successful on node user
Jul 24 16:49:32 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.286s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG nova.network.neutron [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:49:32 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:49:32 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:49:32 user nova-compute[70243]: INFO nova.virt.block_device [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Booting with volume 12a59ae2-09fb-47be-8b07-f736a7622785 at /dev/vda
Jul 24 16:49:32 user nova-compute[70243]: DEBUG nova.policy [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e466829ccbb444097fb673e6510ba0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d6d7f3ea6e34c48b48f5ee828e6340b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG os_brick.utils [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b69acd-3f65-4b53-891b-ce154a866287]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[42033d80-17d8-41c7-8130-140a0ee8def0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaa6888-01df-4457-952c-f9cc1ffcd5d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd120181-d884-429a-8ff5-60995750bf59]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:49:32 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:49:32 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[88893b09-c038-4ae3-859d-138836231ad6]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG os_brick.utils [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:49:32 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Updating existing volume attachment record: 8071df5a-72aa-4626-aab9-289f9fd60e25 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:49:33 user nova-compute[70243]: DEBUG nova.network.neutron [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Successfully created port: 951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:49:33 user nova-compute[70243]: DEBUG nova.network.neutron [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Successfully updated port: 951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:49:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquiring lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:49:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquired lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:49:34 user nova-compute[70243]: DEBUG nova.network.neutron [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:49:34 user nova-compute[70243]: DEBUG nova.compute.manager [req-a7cea641-08b6-48bd-a040-00b6841c528f req-f75274e2-388e-423a-a34c-2b3033b0615e service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Received event network-changed-951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:49:34 user nova-compute[70243]: DEBUG nova.compute.manager [req-a7cea641-08b6-48bd-a040-00b6841c528f req-f75274e2-388e-423a-a34c-2b3033b0615e service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Refreshing instance network info cache due to event network-changed-951ed9cf-5121-492f-b159-0b4932e771fb. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:49:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a7cea641-08b6-48bd-a040-00b6841c528f req-f75274e2-388e-423a-a34c-2b3033b0615e service nova] Acquiring lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:49:34 user nova-compute[70243]: DEBUG nova.network.neutron [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:49:34 user nova-compute[70243]: DEBUG nova.network.neutron [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Updating instance_info_cache with network_info: [{"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": "br-int", "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951ed9cf-51", "ovs_interfaceid": "951ed9cf-5121-492f-b159-0b4932e771fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:49:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Releasing lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:49:34 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Instance network_info: |[{"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": "br-int", "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951ed9cf-51", "ovs_interfaceid": "951ed9cf-5121-492f-b159-0b4932e771fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:49:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a7cea641-08b6-48bd-a040-00b6841c528f req-f75274e2-388e-423a-a34c-2b3033b0615e service nova] Acquired lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:49:34 user nova-compute[70243]: DEBUG nova.network.neutron [req-a7cea641-08b6-48bd-a040-00b6841c528f req-f75274e2-388e-423a-a34c-2b3033b0615e service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Refreshing network info cache for port 951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:49:34 user nova-compute[70243]: DEBUG nova.network.neutron [req-a7cea641-08b6-48bd-a040-00b6841c528f req-f75274e2-388e-423a-a34c-2b3033b0615e service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Updated VIF entry in instance network info cache for port 951ed9cf-5121-492f-b159-0b4932e771fb. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:49:34 user nova-compute[70243]: DEBUG nova.network.neutron [req-a7cea641-08b6-48bd-a040-00b6841c528f req-f75274e2-388e-423a-a34c-2b3033b0615e service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Updating instance_info_cache with network_info: [{"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": "br-int", "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951ed9cf-51", "ovs_interfaceid": "951ed9cf-5121-492f-b159-0b4932e771fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:49:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a7cea641-08b6-48bd-a040-00b6841c528f req-f75274e2-388e-423a-a34c-2b3033b0615e service nova] Releasing lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:49:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:49:39 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Creating image(s)
Jul 24 16:49:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Did not create local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Ensure instance console log exists: /opt/stack/data/nova/instances/5543fd2b-5470-4508-a9ca-4f13c738532b/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Start _get_guest_xml network_info=[{"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": "br-int", "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951ed9cf-51", "ovs_interfaceid": "951ed9cf-5121-492f-b159-0b4932e771fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBgeXIYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5543fd2b-5470-4508-a9ca-4f13c738532b', 'attached_at': '', 'detached_at': '', 'volume_id': '12a59ae2-09fb-47be-8b07-f736a7622785', 'serial': '12a59ae2-09fb-47be-8b07-f736a7622785'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '8071df5a-72aa-4626-aab9-289f9fd60e25', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:49:39 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:49:39 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:49:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBgeXIYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:49:39 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:49:39 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:49:39 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd02c3a-7bbf-4c2d-8ffc-5a41486fae8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:49:39 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[666a2a33-ecb3-479c-8276-04af314bf549]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785] added
Jul 24 16:49:39 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69abd18-8267-4f03-98e7-11ed17a09778]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93b7e5b-9833-4c64-8688-e3e74e4e05fc]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBgeXIYQ {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBgeXIYQ" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6865c68f-4018-4841-ae57-a792fba290ab]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zBgeXIYQ'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b45f81e-feeb-42d2-acdd-ba2c65ac7b5d]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[24858b97-bc5e-4a76-8ada-9c0b975305aa]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:49:39 user nova-compute[70243]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)
Jul 24 16:49:39 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:49:39 user nova-compute[70243]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)
Jul 24 16:49:39 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde18d4d-c04a-4004-be81-23a9d78d20a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785, portal: 172.16.0.220,3260]
Jul 24 16:49:39 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785, portal: 172.16.0.220,3260] successful.
Jul 24 16:49:39 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2f9152-ee32-475f-bb56-44ad2842b557]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a004ac-9cff-4521-8bac-0ecce279021d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:49:39 user nova-compute[70243]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)
Jul 24 16:49:39 user nova-compute[70243]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 (non-flash)
Jul 24 16:49:39 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:49:39 user nova-compute[70243]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)
Jul 24 16:49:39 user nova-compute[70243]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 (non-flash)
Jul 24 16:49:39 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c8960e-3a82-45ca-91e7-9c66ff538563]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:49:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBgeXIYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:49:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:49:40 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26338306666306465', 'path': '/dev/sdb'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:49:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338306666306465', 'path': '/dev/sdb'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:49:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:49:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1139089850',display_name='tempest-TestShelveInstance-server-1139089850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1139089850',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPg23vwDHSqi268RX4whK/nc/65tADGebXhorftF+Dsr1j1nDUi6xPVzatN//44XA2S4FTtv2uZZw5Pu45YomaYjix5Kz3UHrcn5/NLM1nfJ7n7Y6goM0k6TcjF0dMAk+g==',key_name='tempest-TestShelveInstance-632376813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d6d7f3ea6e34c48b48f5ee828e6340b',ramdisk_id='',reservation_id='r-4smpbws2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2048728132',owner_user_name='tempest-TestShelveInstance-2048728132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:49:33Z,user_data=None,user_id='7e466829ccbb444097fb673e6510ba0f',uuid=5543fd2b-5470-4508-a9ca-4f13c738532b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": "br-int", "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951ed9cf-51", "ovs_interfaceid": "951ed9cf-5121-492f-b159-0b4932e771fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:49:40 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Converting VIF {"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": "br-int", "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951ed9cf-51", "ovs_interfaceid": "951ed9cf-5121-492f-b159-0b4932e771fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:49:40 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:89:23,bridge_name='br-int',has_traffic_filtering=True,id=951ed9cf-5121-492f-b159-0b4932e771fb,network=Network(ab426a4e-5220-4e05-ad1c-3438e6648365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951ed9cf-51') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:49:40 user nova-compute[70243]: DEBUG nova.objects.instance [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lazy-loading 'pci_devices' on Instance uuid 5543fd2b-5470-4508-a9ca-4f13c738532b {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:49:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:49:40 user nova-compute[70243]:   <uuid>5543fd2b-5470-4508-a9ca-4f13c738532b</uuid>
Jul 24 16:49:40 user nova-compute[70243]:   <name>instance-0000002b</name>
Jul 24 16:49:40 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:49:40 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:49:40 user nova-compute[70243]:   <metadata>
Jul 24 16:49:40 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:49:40 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:49:40 user nova-compute[70243]:       <nova:name>tempest-TestShelveInstance-server-1139089850</nova:name>
Jul 24 16:49:40 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:49:39</nova:creationTime>
Jul 24 16:49:40 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:49:40 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:49:40 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:49:40 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:49:40 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:49:40 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:49:40 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:49:40 user nova-compute[70243]:       <nova:owner>
Jul 24 16:49:40 user nova-compute[70243]:         <nova:user uuid="7e466829ccbb444097fb673e6510ba0f">tempest-TestShelveInstance-2048728132-project-member</nova:user>
Jul 24 16:49:40 user nova-compute[70243]:         <nova:project uuid="3d6d7f3ea6e34c48b48f5ee828e6340b">tempest-TestShelveInstance-2048728132</nova:project>
Jul 24 16:49:40 user nova-compute[70243]:       </nova:owner>
Jul 24 16:49:40 user nova-compute[70243]:       <nova:ports>
Jul 24 16:49:40 user nova-compute[70243]:         <nova:port uuid="951ed9cf-5121-492f-b159-0b4932e771fb">
Jul 24 16:49:40 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 24 16:49:40 user nova-compute[70243]:         </nova:port>
Jul 24 16:49:40 user nova-compute[70243]:       </nova:ports>
Jul 24 16:49:40 user nova-compute[70243]:     </nova:instance>
Jul 24 16:49:40 user nova-compute[70243]:   </metadata>
Jul 24 16:49:40 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:49:40 user nova-compute[70243]:     <system>
Jul 24 16:49:40 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:49:40 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:49:40 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:49:40 user nova-compute[70243]:       <entry name="serial">5543fd2b-5470-4508-a9ca-4f13c738532b</entry>
Jul 24 16:49:40 user nova-compute[70243]:       <entry name="uuid">5543fd2b-5470-4508-a9ca-4f13c738532b</entry>
Jul 24 16:49:40 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:49:40 user nova-compute[70243]:     </system>
Jul 24 16:49:40 user nova-compute[70243]:   </sysinfo>
Jul 24 16:49:40 user nova-compute[70243]:   <os>
Jul 24 16:49:40 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:49:40 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:49:40 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:49:40 user nova-compute[70243]:   </os>
Jul 24 16:49:40 user nova-compute[70243]:   <features>
Jul 24 16:49:40 user nova-compute[70243]:     <acpi/>
Jul 24 16:49:40 user nova-compute[70243]:     <apic/>
Jul 24 16:49:40 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:49:40 user nova-compute[70243]:   </features>
Jul 24 16:49:40 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:49:40 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:49:40 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:49:40 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:49:40 user nova-compute[70243]:   </clock>
Jul 24 16:49:40 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:49:40 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:49:40 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:49:40 user nova-compute[70243]:   </cpu>
Jul 24 16:49:40 user nova-compute[70243]:   <devices>
Jul 24 16:49:40 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:49:40 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:49:40 user nova-compute[70243]:       <source dev="/dev/sdb"/>
Jul 24 16:49:40 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:49:40 user nova-compute[70243]:       <serial>12a59ae2-09fb-47be-8b07-f736a7622785</serial>
Jul 24 16:49:40 user nova-compute[70243]:     </disk>
Jul 24 16:49:40 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:49:40 user nova-compute[70243]:       <mac address="fa:16:3e:5f:89:23"/>
Jul 24 16:49:40 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:49:40 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:49:40 user nova-compute[70243]:       <target dev="tap951ed9cf-51"/>
Jul 24 16:49:40 user nova-compute[70243]:     </interface>
Jul 24 16:49:40 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:49:40 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/5543fd2b-5470-4508-a9ca-4f13c738532b/console.log" append="off"/>
Jul 24 16:49:40 user nova-compute[70243]:     </serial>
Jul 24 16:49:40 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:49:40 user nova-compute[70243]:     <video>
Jul 24 16:49:40 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:49:40 user nova-compute[70243]:     </video>
Jul 24 16:49:40 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:49:40 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:49:40 user nova-compute[70243]:     </rng>
Jul 24 16:49:40 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:49:40 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:49:40 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:49:40 user nova-compute[70243]:     </memballoon>
Jul 24 16:49:40 user nova-compute[70243]:   </devices>
Jul 24 16:49:40 user nova-compute[70243]: </domain>
Jul 24 16:49:40 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:49:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:49:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1139089850',display_name='tempest-TestShelveInstance-server-1139089850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1139089850',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPg23vwDHSqi268RX4whK/nc/65tADGebXhorftF+Dsr1j1nDUi6xPVzatN//44XA2S4FTtv2uZZw5Pu45YomaYjix5Kz3UHrcn5/NLM1nfJ7n7Y6goM0k6TcjF0dMAk+g==',key_name='tempest-TestShelveInstance-632376813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d6d7f3ea6e34c48b48f5ee828e6340b',ramdisk_id='',reservation_id='r-4smpbws2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2048728132',owner_user_name='tempest-TestShelveInstance-2048728132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:49:33Z,user_data=None,user_id='7e466829ccbb444097fb673e6510ba0f',uuid=5543fd2b-5470-4508-a9ca-4f13c738532b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": "br-int", "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951ed9cf-51", "ovs_interfaceid": "951ed9cf-5121-492f-b159-0b4932e771fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:49:40 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Converting VIF {"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": "br-int", "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951ed9cf-51", "ovs_interfaceid": "951ed9cf-5121-492f-b159-0b4932e771fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:49:40 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:89:23,bridge_name='br-int',has_traffic_filtering=True,id=951ed9cf-5121-492f-b159-0b4932e771fb,network=Network(ab426a4e-5220-4e05-ad1c-3438e6648365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951ed9cf-51') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:49:40 user nova-compute[70243]: DEBUG os_vif [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:89:23,bridge_name='br-int',has_traffic_filtering=True,id=951ed9cf-5121-492f-b159-0b4932e771fb,network=Network(ab426a4e-5220-4e05-ad1c-3438e6648365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951ed9cf-51') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:49:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:49:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:49:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap951ed9cf-51, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:49:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap951ed9cf-51, col_values=(('external_ids', {'iface-id': '951ed9cf-5121-492f-b159-0b4932e771fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:89:23', 'vm-uuid': '5543fd2b-5470-4508-a9ca-4f13c738532b'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:49:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:49:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:41 user nova-compute[70243]: INFO os_vif [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:89:23,bridge_name='br-int',has_traffic_filtering=True,id=951ed9cf-5121-492f-b159-0b4932e771fb,network=Network(ab426a4e-5220-4e05-ad1c-3438e6648365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951ed9cf-51')
Jul 24 16:49:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:49:41 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] No VIF found with MAC fa:16:3e:5f:89:23, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:49:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:42 user nova-compute[70243]: DEBUG nova.compute.manager [req-2bd075cc-9523-4aa4-98ca-dd9116f4470e req-4fe35dab-50c1-4ad1-aaa9-8423cfa5e36b service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Received event network-vif-plugged-951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:49:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2bd075cc-9523-4aa4-98ca-dd9116f4470e req-4fe35dab-50c1-4ad1-aaa9-8423cfa5e36b service nova] Acquiring lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:49:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2bd075cc-9523-4aa4-98ca-dd9116f4470e req-4fe35dab-50c1-4ad1-aaa9-8423cfa5e36b service nova] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:49:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2bd075cc-9523-4aa4-98ca-dd9116f4470e req-4fe35dab-50c1-4ad1-aaa9-8423cfa5e36b service nova] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:49:42 user nova-compute[70243]: DEBUG nova.compute.manager [req-2bd075cc-9523-4aa4-98ca-dd9116f4470e req-4fe35dab-50c1-4ad1-aaa9-8423cfa5e36b service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] No waiting events found dispatching network-vif-plugged-951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:49:42 user nova-compute[70243]: WARNING nova.compute.manager [req-2bd075cc-9523-4aa4-98ca-dd9116f4470e req-4fe35dab-50c1-4ad1-aaa9-8423cfa5e36b service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Received unexpected event network-vif-plugged-951ed9cf-5121-492f-b159-0b4932e771fb for instance with vm_state building and task_state spawning.
Jul 24 16:49:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:44 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217384.5353165, 5543fd2b-5470-4508-a9ca-4f13c738532b => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:49:44 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] VM Resumed (Lifecycle Event)
Jul 24 16:49:44 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:49:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:49:44 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Instance spawned successfully.
Jul 24 16:49:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:49:44 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:49:44 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:49:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:49:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:49:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:49:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:49:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:49:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:49:44 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:49:44 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217384.5369818, 5543fd2b-5470-4508-a9ca-4f13c738532b => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:49:44 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] VM Started (Lifecycle Event)
Jul 24 16:49:44 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:49:44 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:49:44 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:49:44 user nova-compute[70243]: INFO nova.compute.manager [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Took 5.09 seconds to spawn the instance on the hypervisor.
Jul 24 16:49:44 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:49:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-33251bb1-cd33-40cd-8ba3-00f161dd7524 req-13bae65f-d83e-4be1-89fe-8320631438a7 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Received event network-vif-plugged-951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:49:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-33251bb1-cd33-40cd-8ba3-00f161dd7524 req-13bae65f-d83e-4be1-89fe-8320631438a7 service nova] Acquiring lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:49:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-33251bb1-cd33-40cd-8ba3-00f161dd7524 req-13bae65f-d83e-4be1-89fe-8320631438a7 service nova] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:49:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-33251bb1-cd33-40cd-8ba3-00f161dd7524 req-13bae65f-d83e-4be1-89fe-8320631438a7 service nova] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:49:44 user nova-compute[70243]: DEBUG nova.compute.manager [req-33251bb1-cd33-40cd-8ba3-00f161dd7524 req-13bae65f-d83e-4be1-89fe-8320631438a7 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] No waiting events found dispatching network-vif-plugged-951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:49:44 user nova-compute[70243]: WARNING nova.compute.manager [req-33251bb1-cd33-40cd-8ba3-00f161dd7524 req-13bae65f-d83e-4be1-89fe-8320631438a7 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Received unexpected event network-vif-plugged-951ed9cf-5121-492f-b159-0b4932e771fb for instance with vm_state building and task_state spawning.
Jul 24 16:49:44 user nova-compute[70243]: INFO nova.compute.manager [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Took 12.54 seconds to build instance.
Jul 24 16:49:44 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-b0250794-7aa7-4545-aca6-61161a6d638a tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.629s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:49:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:49:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:03 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:50:04 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:50:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:06 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:50:06 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:50:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-ae152306-9bc0-47a4-b438-2dde63652863" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:50:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-ae152306-9bc0-47a4-b438-2dde63652863" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:50:06 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:50:06 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Updating instance_info_cache with network_info: [{"id": "0a2f88c3-b6c3-4dc9-9247-f14603933043", "address": "fa:16:3e:54:a5:20", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2f88c3-b6", "ovs_interfaceid": "0a2f88c3-b6c3-4dc9-9247-f14603933043", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:50:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-ae152306-9bc0-47a4-b438-2dde63652863" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:50:06 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:50:07 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:50:08 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:50:10 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:50:10 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:50:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:50:10 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:50:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:50:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:50:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:50:10 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:50:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:50:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d83c04d-f127-4d6f-a84f-da05d23a143a/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:50:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d83c04d-f127-4d6f-a84f-da05d23a143a/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:50:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d83c04d-f127-4d6f-a84f-da05d23a143a/disk.rescue --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:50:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d83c04d-f127-4d6f-a84f-da05d23a143a/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:50:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:50:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:50:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:50:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:50:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:50:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:50:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:50:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:50:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:50:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:50:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:50:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:50:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:50:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:50:11 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:50:11 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:50:11 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8261MB free_disk=23.943912506103516GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:50:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:50:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:50:12 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 100c6ba5-de96-4c2a-ae0c-9d3a9199948c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:50:12 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8c896761-df6a-4f4a-87dd-c5ea30641a89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:50:12 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 98a87000-0c6d-456e-af2e-4a987968cec5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:50:12 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance ae152306-9bc0-47a4-b438-2dde63652863 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:50:12 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5d83c04d-f127-4d6f-a84f-da05d23a143a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:50:12 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5543fd2b-5470-4508-a9ca-4f13c738532b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:50:12 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:50:12 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:50:12 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing inventories for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 16:50:12 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Updating ProviderTree inventory for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 16:50:12 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Updating inventory in ProviderTree for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 16:50:12 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing aggregate associations for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0, aggregates: None {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 16:50:12 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing trait associations for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0, traits: HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 16:50:12 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:50:12 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:50:12 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:50:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:50:14 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:50:14 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:50:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:16 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:50:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:50:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:50:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:50:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:50:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:50:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:50:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:50:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:50:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:50:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:50:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:50:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:50:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:50:37 user nova-compute[70243]: INFO nova.compute.manager [None req-3655c1e8-32f8-4257-8a7c-29f945d0c1c6 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Unrescuing
Jul 24 16:50:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3655c1e8-32f8-4257-8a7c-29f945d0c1c6 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "refresh_cache-5d83c04d-f127-4d6f-a84f-da05d23a143a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:50:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3655c1e8-32f8-4257-8a7c-29f945d0c1c6 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquired lock "refresh_cache-5d83c04d-f127-4d6f-a84f-da05d23a143a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:50:37 user nova-compute[70243]: DEBUG nova.network.neutron [None req-3655c1e8-32f8-4257-8a7c-29f945d0c1c6 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:50:38 user nova-compute[70243]: DEBUG nova.network.neutron [None req-3655c1e8-32f8-4257-8a7c-29f945d0c1c6 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Updating instance_info_cache with network_info: [{"id": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "address": "fa:16:3e:51:10:29", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6be806-d1", "ovs_interfaceid": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:50:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3655c1e8-32f8-4257-8a7c-29f945d0c1c6 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Releasing lock "refresh_cache-5d83c04d-f127-4d6f-a84f-da05d23a143a" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:50:38 user nova-compute[70243]: DEBUG nova.objects.instance [None req-3655c1e8-32f8-4257-8a7c-29f945d0c1c6 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'flavor' on Instance uuid 5d83c04d-f127-4d6f-a84f-da05d23a143a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:50:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:38 user nova-compute[70243]: DEBUG nova.compute.manager [req-f01723d0-9716-4e25-918d-f759e5a53d14 req-d7ae5569-9738-4da2-b9ea-c9d8a7f8f699 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received event network-vif-unplugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:50:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f01723d0-9716-4e25-918d-f759e5a53d14 req-d7ae5569-9738-4da2-b9ea-c9d8a7f8f699 service nova] Acquiring lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:50:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f01723d0-9716-4e25-918d-f759e5a53d14 req-d7ae5569-9738-4da2-b9ea-c9d8a7f8f699 service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:50:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f01723d0-9716-4e25-918d-f759e5a53d14 req-d7ae5569-9738-4da2-b9ea-c9d8a7f8f699 service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:50:38 user nova-compute[70243]: DEBUG nova.compute.manager [req-f01723d0-9716-4e25-918d-f759e5a53d14 req-d7ae5569-9738-4da2-b9ea-c9d8a7f8f699 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] No waiting events found dispatching network-vif-unplugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:50:38 user nova-compute[70243]: WARNING nova.compute.manager [req-f01723d0-9716-4e25-918d-f759e5a53d14 req-d7ae5569-9738-4da2-b9ea-c9d8a7f8f699 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received unexpected event network-vif-unplugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 for instance with vm_state rescued and task_state unrescuing.
Jul 24 16:50:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:39 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Instance destroyed successfully.
Jul 24 16:50:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:40 user nova-compute[70243]: DEBUG nova.compute.manager [req-32507776-d5ee-49ee-a8de-76da1fe12a1e req-ce3b908c-1278-485d-a93f-a8f47f817cc4 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received event network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:50:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-32507776-d5ee-49ee-a8de-76da1fe12a1e req-ce3b908c-1278-485d-a93f-a8f47f817cc4 service nova] Acquiring lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:50:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-32507776-d5ee-49ee-a8de-76da1fe12a1e req-ce3b908c-1278-485d-a93f-a8f47f817cc4 service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:50:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-32507776-d5ee-49ee-a8de-76da1fe12a1e req-ce3b908c-1278-485d-a93f-a8f47f817cc4 service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:50:40 user nova-compute[70243]: DEBUG nova.compute.manager [req-32507776-d5ee-49ee-a8de-76da1fe12a1e req-ce3b908c-1278-485d-a93f-a8f47f817cc4 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] No waiting events found dispatching network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:50:40 user nova-compute[70243]: WARNING nova.compute.manager [req-32507776-d5ee-49ee-a8de-76da1fe12a1e req-ce3b908c-1278-485d-a93f-a8f47f817cc4 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received unexpected event network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 for instance with vm_state rescued and task_state unrescuing.
Jul 24 16:50:40 user nova-compute[70243]: DEBUG nova.compute.manager [req-32507776-d5ee-49ee-a8de-76da1fe12a1e req-ce3b908c-1278-485d-a93f-a8f47f817cc4 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received event network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:50:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-32507776-d5ee-49ee-a8de-76da1fe12a1e req-ce3b908c-1278-485d-a93f-a8f47f817cc4 service nova] Acquiring lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:50:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-32507776-d5ee-49ee-a8de-76da1fe12a1e req-ce3b908c-1278-485d-a93f-a8f47f817cc4 service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:50:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-32507776-d5ee-49ee-a8de-76da1fe12a1e req-ce3b908c-1278-485d-a93f-a8f47f817cc4 service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:50:40 user nova-compute[70243]: DEBUG nova.compute.manager [req-32507776-d5ee-49ee-a8de-76da1fe12a1e req-ce3b908c-1278-485d-a93f-a8f47f817cc4 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] No waiting events found dispatching network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:50:40 user nova-compute[70243]: WARNING nova.compute.manager [req-32507776-d5ee-49ee-a8de-76da1fe12a1e req-ce3b908c-1278-485d-a93f-a8f47f817cc4 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received unexpected event network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 for instance with vm_state rescued and task_state unrescuing.
Jul 24 16:50:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Removed pending event for 5d83c04d-f127-4d6f-a84f-da05d23a143a due to event {{(pid=70243) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 24 16:50:42 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217442.380043, 5d83c04d-f127-4d6f-a84f-da05d23a143a => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:50:42 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] VM Resumed (Lifecycle Event)
Jul 24 16:50:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-3655c1e8-32f8-4257-8a7c-29f945d0c1c6 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:50:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:50:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:50:42 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 24 16:50:42 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217442.3810933, 5d83c04d-f127-4d6f-a84f-da05d23a143a => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:50:42 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] VM Started (Lifecycle Event)
Jul 24 16:50:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:50:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:50:42 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 24 16:50:43 user nova-compute[70243]: DEBUG nova.compute.manager [req-2d4d527d-7f63-4e37-865f-ece791e6c16f req-904f33bb-34f1-4679-b00c-5460572e3a31 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received event network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:50:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2d4d527d-7f63-4e37-865f-ece791e6c16f req-904f33bb-34f1-4679-b00c-5460572e3a31 service nova] Acquiring lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:50:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2d4d527d-7f63-4e37-865f-ece791e6c16f req-904f33bb-34f1-4679-b00c-5460572e3a31 service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:50:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2d4d527d-7f63-4e37-865f-ece791e6c16f req-904f33bb-34f1-4679-b00c-5460572e3a31 service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:50:43 user nova-compute[70243]: DEBUG nova.compute.manager [req-2d4d527d-7f63-4e37-865f-ece791e6c16f req-904f33bb-34f1-4679-b00c-5460572e3a31 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] No waiting events found dispatching network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:50:43 user nova-compute[70243]: WARNING nova.compute.manager [req-2d4d527d-7f63-4e37-865f-ece791e6c16f req-904f33bb-34f1-4679-b00c-5460572e3a31 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received unexpected event network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 for instance with vm_state active and task_state None.
Jul 24 16:50:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:46 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:50:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:03 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:51:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:06 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:51:07 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:51:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:51:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Didn't find any instances for network info cache update. {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 16:51:07 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:51:09 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:51:10 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:51:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:51:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:12 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:51:12 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:51:12 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:51:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:51:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:51:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:51:12 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:51:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:51:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:51:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:51:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:51:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:51:12 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:51:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:51:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:51:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:51:13 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:51:13 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:51:13 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:51:13 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:51:13 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:51:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:51:13 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:51:13 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:51:13 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8282MB free_disk=23.94400405883789GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:51:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:51:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:51:13 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 100c6ba5-de96-4c2a-ae0c-9d3a9199948c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:51:13 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8c896761-df6a-4f4a-87dd-c5ea30641a89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:51:13 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 98a87000-0c6d-456e-af2e-4a987968cec5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:51:13 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance ae152306-9bc0-47a4-b438-2dde63652863 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:51:13 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5d83c04d-f127-4d6f-a84f-da05d23a143a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:51:13 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5543fd2b-5470-4508-a9ca-4f13c738532b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:51:13 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:51:13 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:51:14 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:51:14 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:51:14 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:51:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.347s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:51:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:16 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-4cbe967b-5052-453e-b4e3-0bbeba4d780a req-a7bd12f9-2067-46bd-bdab-1cfbef357d09 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Received event network-changed-951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:51:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-4cbe967b-5052-453e-b4e3-0bbeba4d780a req-a7bd12f9-2067-46bd-bdab-1cfbef357d09 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Refreshing instance network info cache due to event network-changed-951ed9cf-5121-492f-b159-0b4932e771fb. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:51:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4cbe967b-5052-453e-b4e3-0bbeba4d780a req-a7bd12f9-2067-46bd-bdab-1cfbef357d09 service nova] Acquiring lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:51:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4cbe967b-5052-453e-b4e3-0bbeba4d780a req-a7bd12f9-2067-46bd-bdab-1cfbef357d09 service nova] Acquired lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:51:24 user nova-compute[70243]: DEBUG nova.network.neutron [req-4cbe967b-5052-453e-b4e3-0bbeba4d780a req-a7bd12f9-2067-46bd-bdab-1cfbef357d09 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Refreshing network info cache for port 951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:51:24 user nova-compute[70243]: DEBUG nova.network.neutron [req-4cbe967b-5052-453e-b4e3-0bbeba4d780a req-a7bd12f9-2067-46bd-bdab-1cfbef357d09 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Updated VIF entry in instance network info cache for port 951ed9cf-5121-492f-b159-0b4932e771fb. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:51:24 user nova-compute[70243]: DEBUG nova.network.neutron [req-4cbe967b-5052-453e-b4e3-0bbeba4d780a req-a7bd12f9-2067-46bd-bdab-1cfbef357d09 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Updating instance_info_cache with network_info: [{"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": "br-int", "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951ed9cf-51", "ovs_interfaceid": "951ed9cf-5121-492f-b159-0b4932e771fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:51:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4cbe967b-5052-453e-b4e3-0bbeba4d780a req-a7bd12f9-2067-46bd-bdab-1cfbef357d09 service nova] Releasing lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:51:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquiring lock "5543fd2b-5470-4508-a9ca-4f13c738532b" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:51:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:51:25 user nova-compute[70243]: INFO nova.compute.manager [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Shelve offloading
Jul 24 16:51:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:25 user nova-compute[70243]: DEBUG nova.compute.manager [req-f8648b47-2aee-4053-abc1-6c3eb5e2f26c req-f3d25192-d42d-45de-9b96-15d4dfa4cef5 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Received event network-vif-unplugged-951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:51:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f8648b47-2aee-4053-abc1-6c3eb5e2f26c req-f3d25192-d42d-45de-9b96-15d4dfa4cef5 service nova] Acquiring lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:51:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f8648b47-2aee-4053-abc1-6c3eb5e2f26c req-f3d25192-d42d-45de-9b96-15d4dfa4cef5 service nova] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:51:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f8648b47-2aee-4053-abc1-6c3eb5e2f26c req-f3d25192-d42d-45de-9b96-15d4dfa4cef5 service nova] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:51:25 user nova-compute[70243]: DEBUG nova.compute.manager [req-f8648b47-2aee-4053-abc1-6c3eb5e2f26c req-f3d25192-d42d-45de-9b96-15d4dfa4cef5 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] No waiting events found dispatching network-vif-unplugged-951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:51:25 user nova-compute[70243]: WARNING nova.compute.manager [req-f8648b47-2aee-4053-abc1-6c3eb5e2f26c req-f3d25192-d42d-45de-9b96-15d4dfa4cef5 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Received unexpected event network-vif-unplugged-951ed9cf-5121-492f-b159-0b4932e771fb for instance with vm_state active and task_state shelving.
Jul 24 16:51:25 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Instance destroyed successfully.
Jul 24 16:51:25 user nova-compute[70243]: DEBUG nova.compute.manager [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:51:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquiring lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:51:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquired lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:51:25 user nova-compute[70243]: DEBUG nova.network.neutron [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG nova.network.neutron [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Updating instance_info_cache with network_info: [{"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": "br-int", "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951ed9cf-51", "ovs_interfaceid": "951ed9cf-5121-492f-b159-0b4932e771fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Releasing lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:51:26 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Instance destroyed successfully.
Jul 24 16:51:26 user nova-compute[70243]: DEBUG nova.objects.instance [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lazy-loading 'resources' on Instance uuid 5543fd2b-5470-4508-a9ca-4f13c738532b {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:49:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1139089850',display_name='tempest-TestShelveInstance-server-1139089850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1139089850',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPg23vwDHSqi268RX4whK/nc/65tADGebXhorftF+Dsr1j1nDUi6xPVzatN//44XA2S4FTtv2uZZw5Pu45YomaYjix5Kz3UHrcn5/NLM1nfJ7n7Y6goM0k6TcjF0dMAk+g==',key_name='tempest-TestShelveInstance-632376813',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:49:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d6d7f3ea6e34c48b48f5ee828e6340b',ramdisk_id='',reservation_id='r-4smpbws2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2048728132',owner_user_name='tempest-TestShelveInstance-2048728132-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:49:45Z,user_data=None,user_id='7e466829ccbb444097fb673e6510ba0f',uuid=5543fd2b-5470-4508-a9ca-4f13c738532b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": "br-int", "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951ed9cf-51", "ovs_interfaceid": "951ed9cf-5121-492f-b159-0b4932e771fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Converting VIF {"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": "br-int", "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951ed9cf-51", "ovs_interfaceid": "951ed9cf-5121-492f-b159-0b4932e771fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:89:23,bridge_name='br-int',has_traffic_filtering=True,id=951ed9cf-5121-492f-b159-0b4932e771fb,network=Network(ab426a4e-5220-4e05-ad1c-3438e6648365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951ed9cf-51') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG os_vif [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:89:23,bridge_name='br-int',has_traffic_filtering=True,id=951ed9cf-5121-492f-b159-0b4932e771fb,network=Network(ab426a4e-5220-4e05-ad1c-3438e6648365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951ed9cf-51') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap951ed9cf-51, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:51:26 user nova-compute[70243]: INFO os_vif [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:89:23,bridge_name='br-int',has_traffic_filtering=True,id=951ed9cf-5121-492f-b159-0b4932e771fb,network=Network(ab426a4e-5220-4e05-ad1c-3438e6648365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951ed9cf-51')
Jul 24 16:51:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBgeXIYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:51:26 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:51:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f210497-42a7-4421-bf41-d7fbb7b1d0ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:51:26 user nova-compute[70243]: No targets found.
Jul 24 16:51:26 user nova-compute[70243]: iSNS:
Jul 24 16:51:26 user nova-compute[70243]: No targets found.
Jul 24 16:51:26 user nova-compute[70243]: STATIC:
Jul 24 16:51:26 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785
Jul 24 16:51:26 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:51:26 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:51:26 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3
Jul 24 16:51:26 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:51:26 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:51:26 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd
Jul 24 16:51:26 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:51:26 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:51:26 user nova-compute[70243]: FIRMWARE:
Jul 24 16:51:26 user nova-compute[70243]: No targets found.
Jul 24 16:51:26 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:51:26 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:51:26 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[15774686-613d-4e69-b0d2-b6f690dcf920]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:51:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c41104a-5953-4d26-b16a-370e7e72961b]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:51:27 user nova-compute[70243]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)
Jul 24 16:51:27 user nova-compute[70243]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 (non-flash)
Jul 24 16:51:27 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:51:27 user nova-compute[70243]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)
Jul 24 16:51:27 user nova-compute[70243]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 (non-flash)
Jul 24 16:51:27 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91ec1a8160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785'): ({'sdb'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Removing single pathed devices sdb {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[accd32f8-3d2d-4839-befe-cf7376c9f0f8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a075081-e9dd-40f5-ad3c-ce28ad05c1be]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Flushing IO for device /dev/sdb {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1a85cb-4385-4b58-a5f1-08ea9e74b42f]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa60e34b-33e6-40a1-bab8-9026a99756a7]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ded7b1-73c0-48ca-b009-b880c965779a]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6c7d36-4a03-43a7-a2f8-65bfc09e8489]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785, portal: 172.16.0.220,3260]
Jul 24 16:51:27 user nova-compute[70243]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785, portal: 172.16.0.220,3260] successful.
Jul 24 16:51:27 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[aada5da4-b467-4f7e-a974-1c091d2e082b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] <== disconnect_volume: return (295ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:51:27 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Deleting instance files /opt/stack/data/nova/instances/5543fd2b-5470-4508-a9ca-4f13c738532b_del
Jul 24 16:51:27 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Deletion of /opt/stack/data/nova/instances/5543fd2b-5470-4508-a9ca-4f13c738532b_del complete
Jul 24 16:51:27 user nova-compute[70243]: DEBUG nova.compute.manager [req-83af879c-5894-4be9-a0ba-a48060976d3a req-311b6508-4ae6-4dd4-99f5-29c408f9a37a service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Received event network-vif-plugged-951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-83af879c-5894-4be9-a0ba-a48060976d3a req-311b6508-4ae6-4dd4-99f5-29c408f9a37a service nova] Acquiring lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-83af879c-5894-4be9-a0ba-a48060976d3a req-311b6508-4ae6-4dd4-99f5-29c408f9a37a service nova] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-83af879c-5894-4be9-a0ba-a48060976d3a req-311b6508-4ae6-4dd4-99f5-29c408f9a37a service nova] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG nova.compute.manager [req-83af879c-5894-4be9-a0ba-a48060976d3a req-311b6508-4ae6-4dd4-99f5-29c408f9a37a service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] No waiting events found dispatching network-vif-plugged-951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:51:27 user nova-compute[70243]: WARNING nova.compute.manager [req-83af879c-5894-4be9-a0ba-a48060976d3a req-311b6508-4ae6-4dd4-99f5-29c408f9a37a service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Received unexpected event network-vif-plugged-951ed9cf-5121-492f-b159-0b4932e771fb for instance with vm_state active and task_state shelving.
Jul 24 16:51:27 user nova-compute[70243]: DEBUG nova.compute.manager [req-83af879c-5894-4be9-a0ba-a48060976d3a req-311b6508-4ae6-4dd4-99f5-29c408f9a37a service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Received event network-changed-951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG nova.compute.manager [req-83af879c-5894-4be9-a0ba-a48060976d3a req-311b6508-4ae6-4dd4-99f5-29c408f9a37a service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Refreshing instance network info cache due to event network-changed-951ed9cf-5121-492f-b159-0b4932e771fb. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-83af879c-5894-4be9-a0ba-a48060976d3a req-311b6508-4ae6-4dd4-99f5-29c408f9a37a service nova] Acquiring lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-83af879c-5894-4be9-a0ba-a48060976d3a req-311b6508-4ae6-4dd4-99f5-29c408f9a37a service nova] Acquired lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:51:27 user nova-compute[70243]: DEBUG nova.network.neutron [req-83af879c-5894-4be9-a0ba-a48060976d3a req-311b6508-4ae6-4dd4-99f5-29c408f9a37a service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Refreshing network info cache for port 951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:51:28 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Deleted allocations for instance 5543fd2b-5470-4508-a9ca-4f13c738532b
Jul 24 16:51:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:51:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:51:28 user nova-compute[70243]: DEBUG nova.objects.instance [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lazy-loading 'numa_topology' on Instance uuid 5543fd2b-5470-4508-a9ca-4f13c738532b {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:51:28 user nova-compute[70243]: DEBUG nova.network.neutron [req-83af879c-5894-4be9-a0ba-a48060976d3a req-311b6508-4ae6-4dd4-99f5-29c408f9a37a service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Updated VIF entry in instance network info cache for port 951ed9cf-5121-492f-b159-0b4932e771fb. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:51:28 user nova-compute[70243]: DEBUG nova.network.neutron [req-83af879c-5894-4be9-a0ba-a48060976d3a req-311b6508-4ae6-4dd4-99f5-29c408f9a37a service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Updating instance_info_cache with network_info: [{"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": null, "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap951ed9cf-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:51:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-83af879c-5894-4be9-a0ba-a48060976d3a req-311b6508-4ae6-4dd4-99f5-29c408f9a37a service nova] Releasing lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:51:28 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:51:28 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:51:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:51:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-387d0706-4f4a-42ae-9d0f-39ddbdefbe99 tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.484s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:51:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:40 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690217485.7581308, 5543fd2b-5470-4508-a9ca-4f13c738532b => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:51:40 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] VM Stopped (Lifecycle Event)
Jul 24 16:51:40 user nova-compute[70243]: DEBUG nova.compute.manager [None req-fee32885-cb4d-4c9e-b30b-5f158be6e3f1 None None] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:51:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:46 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:51:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:51:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:52:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:52:05 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:52:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:52:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:52:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:52:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:52:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:52:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:52:07 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:52:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:52:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 16:52:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-100c6ba5-de96-4c2a-ae0c-9d3a9199948c" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:52:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-100c6ba5-de96-4c2a-ae0c-9d3a9199948c" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:52:07 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:52:07 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lazy-loading 'info_cache' on Instance uuid 100c6ba5-de96-4c2a-ae0c-9d3a9199948c {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:52:07 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Updating instance_info_cache with network_info: [{"id": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "address": "fa:16:3e:03:1c:93", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ce0c89-39", "ovs_interfaceid": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:52:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-100c6ba5-de96-4c2a-ae0c-9d3a9199948c" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:52:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:52:07 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:52:08 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:52:11 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:52:11 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:52:11 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:52:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:52:13 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:52:14 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:52:14 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:52:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:52:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:52:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:52:14 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:52:14 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:52:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:52:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:52:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:52:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:52:14 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:52:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:52:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:52:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:52:14 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:52:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:52:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:52:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:52:15 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:52:15 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:52:15 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:52:15 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8414MB free_disk=23.94296646118164GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:52:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:52:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:52:15 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 100c6ba5-de96-4c2a-ae0c-9d3a9199948c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:52:15 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8c896761-df6a-4f4a-87dd-c5ea30641a89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:52:15 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 98a87000-0c6d-456e-af2e-4a987968cec5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:52:15 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance ae152306-9bc0-47a4-b438-2dde63652863 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:52:15 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5d83c04d-f127-4d6f-a84f-da05d23a143a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:52:15 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:52:15 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:52:15 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:52:16 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:52:16 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:52:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:52:16 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:52:17 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:52:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:52:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:52:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:52:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:52:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:52:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:52:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:52:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "5d83c04d-f127-4d6f-a84f-da05d23a143a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:52:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:52:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:52:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:52:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:52:28 user nova-compute[70243]: INFO nova.compute.manager [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Terminating instance
Jul 24 16:52:28 user nova-compute[70243]: DEBUG nova.compute.manager [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:52:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:52:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:52:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-3321a933-9dcf-4fec-9a9e-890cb68c4cc7 req-4c43c0da-6a03-4167-bea4-4dc667b1266c service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received event network-vif-unplugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:52:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3321a933-9dcf-4fec-9a9e-890cb68c4cc7 req-4c43c0da-6a03-4167-bea4-4dc667b1266c service nova] Acquiring lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:52:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3321a933-9dcf-4fec-9a9e-890cb68c4cc7 req-4c43c0da-6a03-4167-bea4-4dc667b1266c service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:52:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3321a933-9dcf-4fec-9a9e-890cb68c4cc7 req-4c43c0da-6a03-4167-bea4-4dc667b1266c service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:52:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-3321a933-9dcf-4fec-9a9e-890cb68c4cc7 req-4c43c0da-6a03-4167-bea4-4dc667b1266c service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] No waiting events found dispatching network-vif-unplugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:52:28 user nova-compute[70243]: DEBUG nova.compute.manager [req-3321a933-9dcf-4fec-9a9e-890cb68c4cc7 req-4c43c0da-6a03-4167-bea4-4dc667b1266c service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received event network-vif-unplugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:52:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:52:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:52:29 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Instance destroyed successfully.
Jul 24 16:52:29 user nova-compute[70243]: DEBUG nova.objects.instance [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'resources' on Instance uuid 5d83c04d-f127-4d6f-a84f-da05d23a143a {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:46:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1882068067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1882068067',id=42,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:48:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06cf84dc406343afa81260614acc8fdd',ramdisk_id='',reservation_id='r-6x9eun1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:50:42Z,user_data=None,user_id='ae306b319e8c4e61b0a73933dc5c330c',uuid=5d83c04d-f127-4d6f-a84f-da05d23a143a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "address": "fa:16:3e:51:10:29", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6be806-d1", "ovs_interfaceid": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converting VIF {"id": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "address": "fa:16:3e:51:10:29", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6be806-d1", "ovs_interfaceid": "0d6be806-d11c-4ff3-b8d2-52339ba59177", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:10:29,bridge_name='br-int',has_traffic_filtering=True,id=0d6be806-d11c-4ff3-b8d2-52339ba59177,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d6be806-d1') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG os_vif [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:10:29,bridge_name='br-int',has_traffic_filtering=True,id=0d6be806-d11c-4ff3-b8d2-52339ba59177,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d6be806-d1') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d6be806-d1, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:52:29 user nova-compute[70243]: INFO os_vif [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:10:29,bridge_name='br-int',has_traffic_filtering=True,id=0d6be806-d11c-4ff3-b8d2-52339ba59177,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d6be806-d1')
Jul 24 16:52:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IPUWLDwr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:52:29 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:52:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[968ece71-38b7-42c6-81a4-e62a1f244f11]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:52:29 user nova-compute[70243]: No targets found.
Jul 24 16:52:29 user nova-compute[70243]: iSNS:
Jul 24 16:52:29 user nova-compute[70243]: No targets found.
Jul 24 16:52:29 user nova-compute[70243]: STATIC:
Jul 24 16:52:29 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3
Jul 24 16:52:29 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:52:29 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:52:29 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd
Jul 24 16:52:29 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:52:29 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:52:29 user nova-compute[70243]: FIRMWARE:
Jul 24 16:52:29 user nova-compute[70243]: No targets found.
Jul 24 16:52:29 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:52:29 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:52:29 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a7e06b-94ed-4e3e-aa45-60288d99cfc2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a315e4c-337c-42ba-9234-72539402f734]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:52:29 user nova-compute[70243]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)
Jul 24 16:52:29 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:52:29 user nova-compute[70243]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd (non-flash)
Jul 24 16:52:29 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc1928c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd'): ({'sdc'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Removing single pathed devices sdc {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f9e784-7c85-44c3-ac89-cf7c3e6df5d9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7a6941-ee93-4474-a0e7-a197a3bb343b]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Flushing IO for device /dev/sdc {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0656ef29-b16c-4397-a343-eea9d4755a43]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae26cdd3-63ba-49f6-9eb7-c4272eed29a0]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] SCSI volumes sdc have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26636313135383666', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9ab2b750', '/dev/disk/by-id/scsi-1SCST_BIO9ab2b750-f611586fc2066a2e') {{(pid=81266) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a08127d-1d9f-486e-922c-bed9cb629d61]: (4, None) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9029f863-495c-4953-aa8b-b4102064830b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81b38ef-e674-4592-b8aa-5bde3430ae9b]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd, portal: 172.16.0.220,3260]
Jul 24 16:52:29 user nova-compute[70243]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd, portal: 172.16.0.220,3260] successful.
Jul 24 16:52:29 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dd023a-6528-4735-bcdf-a5ca33c750fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fa97a9-cb7c-4a64-bd47-8d0d47142d7a]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] <== disconnect_volume: return (312ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:52:29 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Deleting instance files /opt/stack/data/nova/instances/5d83c04d-f127-4d6f-a84f-da05d23a143a_del
Jul 24 16:52:29 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Deletion of /opt/stack/data/nova/instances/5d83c04d-f127-4d6f-a84f-da05d23a143a_del complete
Jul 24 16:52:29 user nova-compute[70243]: INFO nova.compute.manager [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Took 1.18 seconds to destroy the instance on the hypervisor.
Jul 24 16:52:29 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:52:29 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:52:30 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:52:30 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Took 0.55 seconds to deallocate network for instance.
Jul 24 16:52:30 user nova-compute[70243]: DEBUG nova.compute.manager [req-461fee38-acc2-4c18-81bf-6736046e54c3 req-5745b958-07c4-4f7a-bf98-c5686dd17edb service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received event network-vif-deleted-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:52:30 user nova-compute[70243]: DEBUG nova.compute.manager [req-ac8afb2c-7d68-4b44-8e64-2f6a44d4a68a req-888e8a2e-c081-40c6-b145-55720c126317 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received event network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:52:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ac8afb2c-7d68-4b44-8e64-2f6a44d4a68a req-888e8a2e-c081-40c6-b145-55720c126317 service nova] Acquiring lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:52:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ac8afb2c-7d68-4b44-8e64-2f6a44d4a68a req-888e8a2e-c081-40c6-b145-55720c126317 service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:52:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ac8afb2c-7d68-4b44-8e64-2f6a44d4a68a req-888e8a2e-c081-40c6-b145-55720c126317 service nova] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:52:30 user nova-compute[70243]: DEBUG nova.compute.manager [req-ac8afb2c-7d68-4b44-8e64-2f6a44d4a68a req-888e8a2e-c081-40c6-b145-55720c126317 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] No waiting events found dispatching network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:52:30 user nova-compute[70243]: WARNING nova.compute.manager [req-ac8afb2c-7d68-4b44-8e64-2f6a44d4a68a req-888e8a2e-c081-40c6-b145-55720c126317 service nova] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Received unexpected event network-vif-plugged-0d6be806-d11c-4ff3-b8d2-52339ba59177 for instance with vm_state active and task_state deleting.
Jul 24 16:52:30 user nova-compute[70243]: INFO nova.compute.manager [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Took 0.72 seconds to detach 1 volumes for instance.
Jul 24 16:52:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:52:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:52:31 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:52:31 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:52:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:52:31 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Deleted allocations for instance 5d83c04d-f127-4d6f-a84f-da05d23a143a
Jul 24 16:52:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-033b0f43-393f-446a-90da-65bc3b0ff85d tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "5d83c04d-f127-4d6f-a84f-da05d23a143a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.869s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:52:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Acquiring lock "98a87000-0c6d-456e-af2e-4a987968cec5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:52:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "98a87000-0c6d-456e-af2e-4a987968cec5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:52:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Acquiring lock "98a87000-0c6d-456e-af2e-4a987968cec5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:52:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "98a87000-0c6d-456e-af2e-4a987968cec5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:52:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "98a87000-0c6d-456e-af2e-4a987968cec5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:52:33 user nova-compute[70243]: INFO nova.compute.manager [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Terminating instance
Jul 24 16:52:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:52:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:52:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:52:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:52:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:52:33 user nova-compute[70243]: DEBUG nova.compute.manager [req-f07bddea-50ba-419f-9b51-e6191a63ef43 req-c6c25497-41e4-4314-b3c4-ede01dfed466 service nova] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Received event network-vif-unplugged-c99192e2-c6e1-457d-959a-af1fc5c081ea {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:52:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f07bddea-50ba-419f-9b51-e6191a63ef43 req-c6c25497-41e4-4314-b3c4-ede01dfed466 service nova] Acquiring lock "98a87000-0c6d-456e-af2e-4a987968cec5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:52:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f07bddea-50ba-419f-9b51-e6191a63ef43 req-c6c25497-41e4-4314-b3c4-ede01dfed466 service nova] Lock "98a87000-0c6d-456e-af2e-4a987968cec5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:52:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f07bddea-50ba-419f-9b51-e6191a63ef43 req-c6c25497-41e4-4314-b3c4-ede01dfed466 service nova] Lock "98a87000-0c6d-456e-af2e-4a987968cec5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:52:33 user nova-compute[70243]: DEBUG nova.compute.manager [req-f07bddea-50ba-419f-9b51-e6191a63ef43 req-c6c25497-41e4-4314-b3c4-ede01dfed466 service nova] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] No waiting events found dispatching network-vif-unplugged-c99192e2-c6e1-457d-959a-af1fc5c081ea {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:52:33 user nova-compute[70243]: DEBUG nova.compute.manager [req-f07bddea-50ba-419f-9b51-e6191a63ef43 req-c6c25497-41e4-4314-b3c4-ede01dfed466 service nova] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Received event network-vif-unplugged-c99192e2-c6e1-457d-959a-af1fc5c081ea for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:52:34 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Instance destroyed successfully.
Jul 24 16:52:34 user nova-compute[70243]: DEBUG nova.objects.instance [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lazy-loading 'resources' on Instance uuid 98a87000-0c6d-456e-af2e-4a987968cec5 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:52:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:43:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1881039386',display_name='tempest-ServersNegativeTestJSON-server-1881039386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1881039386',id=38,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:43:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4884b7eb022949d298aa11ee84a03ec9',ramdisk_id='',reservation_id='r-jodi91ja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-851329711',owner_user_name='tempest-ServersNegativeTestJSON-851329711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:43:52Z,user_data=None,user_id='cd85dab5b3c84255b3d784cfeed397c3',uuid=98a87000-0c6d-456e-af2e-4a987968cec5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c99192e2-c6e1-457d-959a-af1fc5c081ea", "address": "fa:16:3e:c4:97:6b", "network": {"id": "99653fe8-b4ff-4412-a691-fe3efeaebfb4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-172568374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4884b7eb022949d298aa11ee84a03ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99192e2-c6", "ovs_interfaceid": "c99192e2-c6e1-457d-959a-af1fc5c081ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:52:34 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Converting VIF {"id": "c99192e2-c6e1-457d-959a-af1fc5c081ea", "address": "fa:16:3e:c4:97:6b", "network": {"id": "99653fe8-b4ff-4412-a691-fe3efeaebfb4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-172568374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4884b7eb022949d298aa11ee84a03ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99192e2-c6", "ovs_interfaceid": "c99192e2-c6e1-457d-959a-af1fc5c081ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:52:34 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:97:6b,bridge_name='br-int',has_traffic_filtering=True,id=c99192e2-c6e1-457d-959a-af1fc5c081ea,network=Network(99653fe8-b4ff-4412-a691-fe3efeaebfb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99192e2-c6') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:52:34 user nova-compute[70243]: DEBUG os_vif [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:97:6b,bridge_name='br-int',has_traffic_filtering=True,id=c99192e2-c6e1-457d-959a-af1fc5c081ea,network=Network(99653fe8-b4ff-4412-a691-fe3efeaebfb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99192e2-c6') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:52:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:52:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc99192e2-c6, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:52:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:52:34 user nova-compute[70243]: INFO os_vif [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:97:6b,bridge_name='br-int',has_traffic_filtering=True,id=c99192e2-c6e1-457d-959a-af1fc5c081ea,network=Network(99653fe8-b4ff-4412-a691-fe3efeaebfb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99192e2-c6')
Jul 24 16:52:34 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Deleting instance files /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5_del
Jul 24 16:52:34 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Deletion of /opt/stack/data/nova/instances/98a87000-0c6d-456e-af2e-4a987968cec5_del complete
Jul 24 16:52:34 user nova-compute[70243]: INFO nova.compute.manager [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 24 16:52:34 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:52:34 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:52:34 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:52:34 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:52:34 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Took 0.49 seconds to deallocate network for instance.
Jul 24 16:52:34 user nova-compute[70243]: DEBUG nova.compute.manager [req-b0bdf0b2-3e92-45b5-8ac7-50048ec5acaf req-86e06575-fa28-4fdc-bf36-01ae4eeec93b service nova] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Received event network-vif-deleted-c99192e2-c6e1-457d-959a-af1fc5c081ea {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:52:34 user nova-compute[70243]: INFO nova.compute.manager [req-b0bdf0b2-3e92-45b5-8ac7-50048ec5acaf req-86e06575-fa28-4fdc-bf36-01ae4eeec93b service nova] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Neutron deleted interface c99192e2-c6e1-457d-959a-af1fc5c081ea; detaching it from the instance and deleting it from the info cache
Jul 24 16:52:34 user nova-compute[70243]: DEBUG nova.network.neutron [req-b0bdf0b2-3e92-45b5-8ac7-50048ec5acaf req-86e06575-fa28-4fdc-bf36-01ae4eeec93b service nova] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:52:34 user nova-compute[70243]: DEBUG nova.compute.manager [req-b0bdf0b2-3e92-45b5-8ac7-50048ec5acaf req-86e06575-fa28-4fdc-bf36-01ae4eeec93b service nova] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Detach interface failed, port_id=c99192e2-c6e1-457d-959a-af1fc5c081ea, reason: Instance 98a87000-0c6d-456e-af2e-4a987968cec5 could not be found. {{(pid=70243) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 16:52:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:52:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:52:34 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:52:34 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:52:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:52:34 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Deleted allocations for instance 98a87000-0c6d-456e-af2e-4a987968cec5
Jul 24 16:52:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ac6c82ae-ee70-4b1f-8e1f-85fdac18db85 tempest-ServersNegativeTestJSON-851329711 tempest-ServersNegativeTestJSON-851329711-project-member] Lock "98a87000-0c6d-456e-af2e-4a987968cec5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.726s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:52:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-5c993c70-1a77-41db-af62-c9ef5fda7dae req-67b4f265-b9d1-4a43-b6e6-fae07d0bb8b9 service nova] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Received event network-vif-plugged-c99192e2-c6e1-457d-959a-af1fc5c081ea {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:52:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5c993c70-1a77-41db-af62-c9ef5fda7dae req-67b4f265-b9d1-4a43-b6e6-fae07d0bb8b9 service nova] Acquiring lock "98a87000-0c6d-456e-af2e-4a987968cec5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:52:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5c993c70-1a77-41db-af62-c9ef5fda7dae req-67b4f265-b9d1-4a43-b6e6-fae07d0bb8b9 service nova] Lock "98a87000-0c6d-456e-af2e-4a987968cec5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:52:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5c993c70-1a77-41db-af62-c9ef5fda7dae req-67b4f265-b9d1-4a43-b6e6-fae07d0bb8b9 service nova] Lock "98a87000-0c6d-456e-af2e-4a987968cec5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:52:35 user nova-compute[70243]: DEBUG nova.compute.manager [req-5c993c70-1a77-41db-af62-c9ef5fda7dae req-67b4f265-b9d1-4a43-b6e6-fae07d0bb8b9 service nova] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] No waiting events found dispatching network-vif-plugged-c99192e2-c6e1-457d-959a-af1fc5c081ea {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:52:35 user nova-compute[70243]: WARNING nova.compute.manager [req-5c993c70-1a77-41db-af62-c9ef5fda7dae req-67b4f265-b9d1-4a43-b6e6-fae07d0bb8b9 service nova] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Received unexpected event network-vif-plugged-c99192e2-c6e1-457d-959a-af1fc5c081ea for instance with vm_state deleted and task_state None.
Jul 24 16:52:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:52:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:52:44 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690217549.242169, 5d83c04d-f127-4d6f-a84f-da05d23a143a => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:52:44 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] VM Stopped (Lifecycle Event)
Jul 24 16:52:44 user nova-compute[70243]: DEBUG nova.compute.manager [None req-994acb2e-8db6-4052-aaa0-e6fc083819a1 None None] [instance: 5d83c04d-f127-4d6f-a84f-da05d23a143a] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:52:49 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690217554.1118238, 98a87000-0c6d-456e-af2e-4a987968cec5 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:52:49 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] VM Stopped (Lifecycle Event)
Jul 24 16:52:49 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ddf2692f-4cc1-4c8b-be16-ceed78cce685 None None] [instance: 98a87000-0c6d-456e-af2e-4a987968cec5] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:52:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:52:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:52:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:53:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:53:05 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:53:07 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:53:08 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:53:08 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:53:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-8c896761-df6a-4f4a-87dd-c5ea30641a89" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:53:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-8c896761-df6a-4f4a-87dd-c5ea30641a89" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:53:08 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:53:08 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Updating instance_info_cache with network_info: [{"id": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "address": "fa:16:3e:a5:da:73", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa5a7d4-ef", "ovs_interfaceid": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:53:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-8c896761-df6a-4f4a-87dd-c5ea30641a89" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:53:08 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:53:08 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:53:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:53:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:53:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:53:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:53:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:11 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:53:11 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:53:13 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:53:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:53:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:53:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:53:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:53:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:15 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:53:15 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:53:16 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:53:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:53:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:53:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:53:16 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:53:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:53:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquiring lock "5543fd2b-5470-4508-a9ca-4f13c738532b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:53:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:53:16 user nova-compute[70243]: INFO nova.compute.manager [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Unshelving
Jul 24 16:53:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:16 user nova-compute[70243]: INFO nova.virt.block_device [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Booting with volume 12a59ae2-09fb-47be-8b07-f736a7622785 at /dev/vda
Jul 24 16:53:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:16 user nova-compute[70243]: DEBUG os_brick.utils [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:53:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b984d4e-6711-4165-b214-48d2de28b5e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:53:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:16 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[117f9fce-b403-4ff6-b84c-d868c64106fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:53:16 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f7078e-748c-47da-9a71-a3daf05e7908]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b40c4d-7684-47f1-964e-60e4f81ee404]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:53:17 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:53:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0abde2d-9ffe-4758-84f4-c6f1e5311c0c]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG os_brick.utils [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Updating existing volume attachment record: c35e7683-c920-4938-976f-9c63a5352789 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:53:17 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:53:17 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:53:17 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8601MB free_disk=23.969623565673828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 100c6ba5-de96-4c2a-ae0c-9d3a9199948c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8c896761-df6a-4f4a-87dd-c5ea30641a89 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance ae152306-9bc0-47a4-b438-2dde63652863 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5543fd2b-5470-4508-a9ca-4f13c738532b has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1724}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:53:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:53:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:53:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "ae152306-9bc0-47a4-b438-2dde63652863" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:53:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "ae152306-9bc0-47a4-b438-2dde63652863" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:53:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "ae152306-9bc0-47a4-b438-2dde63652863-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:53:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "ae152306-9bc0-47a4-b438-2dde63652863-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:53:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "ae152306-9bc0-47a4-b438-2dde63652863-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:53:19 user nova-compute[70243]: INFO nova.compute.manager [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Terminating instance
Jul 24 16:53:19 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:53:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-dc5ac597-5491-4509-b200-728a2fcd5021 req-571b316b-7c2d-48e8-a3c0-f9b97cc6a218 service nova] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Received event network-vif-unplugged-0a2f88c3-b6c3-4dc9-9247-f14603933043 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:53:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dc5ac597-5491-4509-b200-728a2fcd5021 req-571b316b-7c2d-48e8-a3c0-f9b97cc6a218 service nova] Acquiring lock "ae152306-9bc0-47a4-b438-2dde63652863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:53:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dc5ac597-5491-4509-b200-728a2fcd5021 req-571b316b-7c2d-48e8-a3c0-f9b97cc6a218 service nova] Lock "ae152306-9bc0-47a4-b438-2dde63652863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:53:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-dc5ac597-5491-4509-b200-728a2fcd5021 req-571b316b-7c2d-48e8-a3c0-f9b97cc6a218 service nova] Lock "ae152306-9bc0-47a4-b438-2dde63652863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:53:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-dc5ac597-5491-4509-b200-728a2fcd5021 req-571b316b-7c2d-48e8-a3c0-f9b97cc6a218 service nova] [instance: ae152306-9bc0-47a4-b438-2dde63652863] No waiting events found dispatching network-vif-unplugged-0a2f88c3-b6c3-4dc9-9247-f14603933043 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:53:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-dc5ac597-5491-4509-b200-728a2fcd5021 req-571b316b-7c2d-48e8-a3c0-f9b97cc6a218 service nova] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Received event network-vif-unplugged-0a2f88c3-b6c3-4dc9-9247-f14603933043 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:53:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:19 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Instance destroyed successfully.
Jul 24 16:53:19 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'resources' on Instance uuid ae152306-9bc0-47a4-b438-2dde63652863 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:53:20 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:43:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-82290159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-82290159',id=39,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:44:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06cf84dc406343afa81260614acc8fdd',ramdisk_id='',reservation_id='r-uxfpsxy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:45:54Z,user_data=None,user_id='ae306b319e8c4e61b0a73933dc5c330c',uuid=ae152306-9bc0-47a4-b438-2dde63652863,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a2f88c3-b6c3-4dc9-9247-f14603933043", "address": "fa:16:3e:54:a5:20", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2f88c3-b6", "ovs_interfaceid": "0a2f88c3-b6c3-4dc9-9247-f14603933043", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:53:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converting VIF {"id": "0a2f88c3-b6c3-4dc9-9247-f14603933043", "address": "fa:16:3e:54:a5:20", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a2f88c3-b6", "ovs_interfaceid": "0a2f88c3-b6c3-4dc9-9247-f14603933043", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:53:20 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:a5:20,bridge_name='br-int',has_traffic_filtering=True,id=0a2f88c3-b6c3-4dc9-9247-f14603933043,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a2f88c3-b6') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:53:20 user nova-compute[70243]: DEBUG os_vif [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:a5:20,bridge_name='br-int',has_traffic_filtering=True,id=0a2f88c3-b6c3-4dc9-9247-f14603933043,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a2f88c3-b6') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:53:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a2f88c3-b6, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:53:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:53:20 user nova-compute[70243]: INFO os_vif [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:a5:20,bridge_name='br-int',has_traffic_filtering=True,id=0a2f88c3-b6c3-4dc9-9247-f14603933043,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a2f88c3-b6')
Jul 24 16:53:20 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Deleting instance files /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863_del
Jul 24 16:53:20 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Deletion of /opt/stack/data/nova/instances/ae152306-9bc0-47a4-b438-2dde63652863_del complete
Jul 24 16:53:20 user nova-compute[70243]: INFO nova.compute.manager [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 24 16:53:20 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:53:20 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:53:20 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: ae152306-9bc0-47a4-b438-2dde63652863] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:53:20 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:53:20 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Took 0.60 seconds to deallocate network for instance.
Jul 24 16:53:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-644f5f0f-6843-4908-b8db-aded6d6ab963 req-86a7642a-f148-4259-abbe-a96c22af1c4f service nova] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Received event network-vif-deleted-0a2f88c3-b6c3-4dc9-9247-f14603933043 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:53:20 user nova-compute[70243]: INFO nova.compute.manager [req-644f5f0f-6843-4908-b8db-aded6d6ab963 req-86a7642a-f148-4259-abbe-a96c22af1c4f service nova] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Neutron deleted interface 0a2f88c3-b6c3-4dc9-9247-f14603933043; detaching it from the instance and deleting it from the info cache
Jul 24 16:53:20 user nova-compute[70243]: DEBUG nova.network.neutron [req-644f5f0f-6843-4908-b8db-aded6d6ab963 req-86a7642a-f148-4259-abbe-a96c22af1c4f service nova] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:53:20 user nova-compute[70243]: DEBUG nova.compute.manager [req-644f5f0f-6843-4908-b8db-aded6d6ab963 req-86a7642a-f148-4259-abbe-a96c22af1c4f service nova] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Detach interface failed, port_id=0a2f88c3-b6c3-4dc9-9247-f14603933043, reason: Instance ae152306-9bc0-47a4-b438-2dde63652863 could not be found. {{(pid=70243) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 16:53:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:53:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:53:20 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:53:20 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:53:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:53:21 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Deleted allocations for instance ae152306-9bc0-47a4-b438-2dde63652863
Jul 24 16:53:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c18d586a-0d8f-4bec-99f6-5de57b98c31e tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "ae152306-9bc0-47a4-b438-2dde63652863" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.861s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:53:21 user nova-compute[70243]: DEBUG nova.compute.manager [req-6ed0be6e-ce84-4887-b7e8-bc4fb1a1977d req-d9aeb87d-8da3-4ea9-a204-8f4fdedc8b20 service nova] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Received event network-vif-plugged-0a2f88c3-b6c3-4dc9-9247-f14603933043 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:53:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6ed0be6e-ce84-4887-b7e8-bc4fb1a1977d req-d9aeb87d-8da3-4ea9-a204-8f4fdedc8b20 service nova] Acquiring lock "ae152306-9bc0-47a4-b438-2dde63652863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:53:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6ed0be6e-ce84-4887-b7e8-bc4fb1a1977d req-d9aeb87d-8da3-4ea9-a204-8f4fdedc8b20 service nova] Lock "ae152306-9bc0-47a4-b438-2dde63652863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:53:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6ed0be6e-ce84-4887-b7e8-bc4fb1a1977d req-d9aeb87d-8da3-4ea9-a204-8f4fdedc8b20 service nova] Lock "ae152306-9bc0-47a4-b438-2dde63652863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:53:21 user nova-compute[70243]: DEBUG nova.compute.manager [req-6ed0be6e-ce84-4887-b7e8-bc4fb1a1977d req-d9aeb87d-8da3-4ea9-a204-8f4fdedc8b20 service nova] [instance: ae152306-9bc0-47a4-b438-2dde63652863] No waiting events found dispatching network-vif-plugged-0a2f88c3-b6c3-4dc9-9247-f14603933043 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:53:21 user nova-compute[70243]: WARNING nova.compute.manager [req-6ed0be6e-ce84-4887-b7e8-bc4fb1a1977d req-d9aeb87d-8da3-4ea9-a204-8f4fdedc8b20 service nova] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Received unexpected event network-vif-plugged-0a2f88c3-b6c3-4dc9-9247-f14603933043 for instance with vm_state deleted and task_state None.
Jul 24 16:53:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:53:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:53:23 user nova-compute[70243]: DEBUG nova.objects.instance [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lazy-loading 'pci_requests' on Instance uuid 5543fd2b-5470-4508-a9ca-4f13c738532b {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:53:23 user nova-compute[70243]: DEBUG nova.objects.instance [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lazy-loading 'numa_topology' on Instance uuid 5543fd2b-5470-4508-a9ca-4f13c738532b {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:53:23 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:53:23 user nova-compute[70243]: INFO nova.compute.claims [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Claim successful on node user
Jul 24 16:53:24 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:53:24 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:53:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:53:24 user nova-compute[70243]: INFO nova.network.neutron [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Updating port 951ed9cf-5121-492f-b159-0b4932e771fb with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 24 16:53:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquiring lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:53:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquired lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:53:25 user nova-compute[70243]: DEBUG nova.network.neutron [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:53:25 user nova-compute[70243]: DEBUG nova.compute.manager [req-3cfa70f1-f0dd-44b1-9999-adfae8bde442 req-647e0558-397a-44cc-94ae-ab6c54474854 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Received event network-changed-951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:53:25 user nova-compute[70243]: DEBUG nova.compute.manager [req-3cfa70f1-f0dd-44b1-9999-adfae8bde442 req-647e0558-397a-44cc-94ae-ab6c54474854 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Refreshing instance network info cache due to event network-changed-951ed9cf-5121-492f-b159-0b4932e771fb. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:53:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3cfa70f1-f0dd-44b1-9999-adfae8bde442 req-647e0558-397a-44cc-94ae-ab6c54474854 service nova] Acquiring lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.network.neutron [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Updating instance_info_cache with network_info: [{"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": "br-int", "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951ed9cf-51", "ovs_interfaceid": "951ed9cf-5121-492f-b159-0b4932e771fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Releasing lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:53:26 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Creating image(s)
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Did not create local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Ensure instance console log exists: /opt/stack/data/nova/instances/5543fd2b-5470-4508-a9ca-4f13c738532b/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Start _get_guest_xml network_info=[{"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": "br-int", "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951ed9cf-51", "ovs_interfaceid": "951ed9cf-5121-492f-b159-0b4932e771fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBgeXIYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5543fd2b-5470-4508-a9ca-4f13c738532b', 'attached_at': '', 'detached_at': '', 'volume_id': '12a59ae2-09fb-47be-8b07-f736a7622785', 'serial': '12a59ae2-09fb-47be-8b07-f736a7622785'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'c35e7683-c920-4938-976f-9c63a5352789', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3cfa70f1-f0dd-44b1-9999-adfae8bde442 req-647e0558-397a-44cc-94ae-ab6c54474854 service nova] Acquired lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.network.neutron [req-3cfa70f1-f0dd-44b1-9999-adfae8bde442 req-647e0558-397a-44cc-94ae-ab6c54474854 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Refreshing network info cache for port 951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:53:26 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:53:26 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.objects.instance [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5543fd2b-5470-4508-a9ca-4f13c738532b {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBgeXIYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:53:26 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:53:26 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:53:26 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fad2c2c-de4a-4827-b9f6-c7eca3b0f185]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:53:26 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d00fde-327b-45a4-968e-88be62a50aef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785] added
Jul 24 16:53:26 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fb36b4-a183-448f-b26b-cd53d31d9390]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[953fa198-3d77-4fcc-a701-69e32a2a904b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBgeXIYQ {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBgeXIYQ" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[518a26e6-07fb-405e-ac8e-f2f512d28897]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zBgeXIYQ'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b161e8a-e2cb-4b89-a672-109f13069fcd]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[377caa2e-d5f7-4bdf-becf-073e1a05b792]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:53:26 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:53:26 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01057c1-4428-42c5-8c83-8c3ccdc1a330]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785, portal: 172.16.0.220,3260]
Jul 24 16:53:26 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785, portal: 172.16.0.220,3260] successful.
Jul 24 16:53:26 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31ffc98-e0f3-4942-968b-a5baaf76c90e]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd19297f-ddec-4771-be31-a71c17c2470a]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:53:26 user nova-compute[70243]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 (non-flash)
Jul 24 16:53:26 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:53:26 user nova-compute[70243]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 (non-flash)
Jul 24 16:53:26 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8c5d8d-3643-47ea-b8cc-ffb367a9c183]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBgeXIYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.network.neutron [req-3cfa70f1-f0dd-44b1-9999-adfae8bde442 req-647e0558-397a-44cc-94ae-ab6c54474854 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Updated VIF entry in instance network info cache for port 951ed9cf-5121-492f-b159-0b4932e771fb. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG nova.network.neutron [req-3cfa70f1-f0dd-44b1-9999-adfae8bde442 req-647e0558-397a-44cc-94ae-ab6c54474854 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Updating instance_info_cache with network_info: [{"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": "br-int", "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951ed9cf-51", "ovs_interfaceid": "951ed9cf-5121-492f-b159-0b4932e771fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:53:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3cfa70f1-f0dd-44b1-9999-adfae8bde442 req-647e0558-397a-44cc-94ae-ab6c54474854 service nova] Releasing lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:53:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:53:27 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26338306666306465', 'path': '/dev/sdb'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:53:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338306666306465', 'path': '/dev/sdb'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:53:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T16:49:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1139089850',display_name='tempest-TestShelveInstance-server-1139089850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1139089850',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-632376813',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:49:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3d6d7f3ea6e34c48b48f5ee828e6340b',ramdisk_id='',reservation_id='r-4smpbws2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2048728132',owner_user_name='tempest-TestShelveInstance-2048728132-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:53:17Z,user_data=None,user_id='7e466829ccbb444097fb673e6510ba0f',uuid=5543fd2b-5470-4508-a9ca-4f13c738532b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": "br-int", "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951ed9cf-51", "ovs_interfaceid": "951ed9cf-5121-492f-b159-0b4932e771fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:53:27 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Converting VIF {"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": "br-int", "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951ed9cf-51", "ovs_interfaceid": "951ed9cf-5121-492f-b159-0b4932e771fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:53:27 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:89:23,bridge_name='br-int',has_traffic_filtering=True,id=951ed9cf-5121-492f-b159-0b4932e771fb,network=Network(ab426a4e-5220-4e05-ad1c-3438e6648365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951ed9cf-51') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:53:27 user nova-compute[70243]: DEBUG nova.objects.instance [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lazy-loading 'pci_devices' on Instance uuid 5543fd2b-5470-4508-a9ca-4f13c738532b {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:53:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:53:27 user nova-compute[70243]:   <uuid>5543fd2b-5470-4508-a9ca-4f13c738532b</uuid>
Jul 24 16:53:27 user nova-compute[70243]:   <name>instance-0000002b</name>
Jul 24 16:53:27 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:53:27 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:53:27 user nova-compute[70243]:   <metadata>
Jul 24 16:53:27 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:53:27 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:53:27 user nova-compute[70243]:       <nova:name>tempest-TestShelveInstance-server-1139089850</nova:name>
Jul 24 16:53:27 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:53:26</nova:creationTime>
Jul 24 16:53:27 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:53:27 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:53:27 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:53:27 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:53:27 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:53:27 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:53:27 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:53:27 user nova-compute[70243]:       <nova:owner>
Jul 24 16:53:27 user nova-compute[70243]:         <nova:user uuid="7e466829ccbb444097fb673e6510ba0f">tempest-TestShelveInstance-2048728132-project-member</nova:user>
Jul 24 16:53:27 user nova-compute[70243]:         <nova:project uuid="3d6d7f3ea6e34c48b48f5ee828e6340b">tempest-TestShelveInstance-2048728132</nova:project>
Jul 24 16:53:27 user nova-compute[70243]:       </nova:owner>
Jul 24 16:53:27 user nova-compute[70243]:       <nova:ports>
Jul 24 16:53:27 user nova-compute[70243]:         <nova:port uuid="951ed9cf-5121-492f-b159-0b4932e771fb">
Jul 24 16:53:27 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 24 16:53:27 user nova-compute[70243]:         </nova:port>
Jul 24 16:53:27 user nova-compute[70243]:       </nova:ports>
Jul 24 16:53:27 user nova-compute[70243]:     </nova:instance>
Jul 24 16:53:27 user nova-compute[70243]:   </metadata>
Jul 24 16:53:27 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:53:27 user nova-compute[70243]:     <system>
Jul 24 16:53:27 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:53:27 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:53:27 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:53:27 user nova-compute[70243]:       <entry name="serial">5543fd2b-5470-4508-a9ca-4f13c738532b</entry>
Jul 24 16:53:27 user nova-compute[70243]:       <entry name="uuid">5543fd2b-5470-4508-a9ca-4f13c738532b</entry>
Jul 24 16:53:27 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:53:27 user nova-compute[70243]:     </system>
Jul 24 16:53:27 user nova-compute[70243]:   </sysinfo>
Jul 24 16:53:27 user nova-compute[70243]:   <os>
Jul 24 16:53:27 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:53:27 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:53:27 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:53:27 user nova-compute[70243]:   </os>
Jul 24 16:53:27 user nova-compute[70243]:   <features>
Jul 24 16:53:27 user nova-compute[70243]:     <acpi/>
Jul 24 16:53:27 user nova-compute[70243]:     <apic/>
Jul 24 16:53:27 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:53:27 user nova-compute[70243]:   </features>
Jul 24 16:53:27 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:53:27 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:53:27 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:53:27 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:53:27 user nova-compute[70243]:   </clock>
Jul 24 16:53:27 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:53:27 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:53:27 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:53:27 user nova-compute[70243]:   </cpu>
Jul 24 16:53:27 user nova-compute[70243]:   <devices>
Jul 24 16:53:27 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:53:27 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:53:27 user nova-compute[70243]:       <source dev="/dev/sdb"/>
Jul 24 16:53:27 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:53:27 user nova-compute[70243]:       <serial>12a59ae2-09fb-47be-8b07-f736a7622785</serial>
Jul 24 16:53:27 user nova-compute[70243]:     </disk>
Jul 24 16:53:27 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:53:27 user nova-compute[70243]:       <mac address="fa:16:3e:5f:89:23"/>
Jul 24 16:53:27 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:53:27 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:53:27 user nova-compute[70243]:       <target dev="tap951ed9cf-51"/>
Jul 24 16:53:27 user nova-compute[70243]:     </interface>
Jul 24 16:53:27 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:53:27 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/5543fd2b-5470-4508-a9ca-4f13c738532b/console.log" append="off"/>
Jul 24 16:53:27 user nova-compute[70243]:     </serial>
Jul 24 16:53:27 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:53:27 user nova-compute[70243]:     <video>
Jul 24 16:53:27 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:53:27 user nova-compute[70243]:     </video>
Jul 24 16:53:27 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:53:27 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:53:27 user nova-compute[70243]:     </rng>
Jul 24 16:53:27 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:53:27 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:53:27 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:53:27 user nova-compute[70243]:     </memballoon>
Jul 24 16:53:27 user nova-compute[70243]:   </devices>
Jul 24 16:53:27 user nova-compute[70243]: </domain>
Jul 24 16:53:27 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:53:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T16:49:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1139089850',display_name='tempest-TestShelveInstance-server-1139089850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1139089850',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-632376813',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:49:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3d6d7f3ea6e34c48b48f5ee828e6340b',ramdisk_id='',reservation_id='r-4smpbws2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2048728132',owner_user_name='tempest-TestShelveInstance-2048728132-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:53:17Z,user_data=None,user_id='7e466829ccbb444097fb673e6510ba0f',uuid=5543fd2b-5470-4508-a9ca-4f13c738532b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": "br-int", "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951ed9cf-51", "ovs_interfaceid": "951ed9cf-5121-492f-b159-0b4932e771fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:53:27 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Converting VIF {"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": "br-int", "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951ed9cf-51", "ovs_interfaceid": "951ed9cf-5121-492f-b159-0b4932e771fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:53:27 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:89:23,bridge_name='br-int',has_traffic_filtering=True,id=951ed9cf-5121-492f-b159-0b4932e771fb,network=Network(ab426a4e-5220-4e05-ad1c-3438e6648365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951ed9cf-51') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:53:27 user nova-compute[70243]: DEBUG os_vif [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:89:23,bridge_name='br-int',has_traffic_filtering=True,id=951ed9cf-5121-492f-b159-0b4932e771fb,network=Network(ab426a4e-5220-4e05-ad1c-3438e6648365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951ed9cf-51') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:53:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:53:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:53:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap951ed9cf-51, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:53:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap951ed9cf-51, col_values=(('external_ids', {'iface-id': '951ed9cf-5121-492f-b159-0b4932e771fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:89:23', 'vm-uuid': '5543fd2b-5470-4508-a9ca-4f13c738532b'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:53:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:53:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:27 user nova-compute[70243]: INFO os_vif [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:89:23,bridge_name='br-int',has_traffic_filtering=True,id=951ed9cf-5121-492f-b159-0b4932e771fb,network=Network(ab426a4e-5220-4e05-ad1c-3438e6648365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951ed9cf-51')
Jul 24 16:53:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:53:27 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] No VIF found with MAC fa:16:3e:5f:89:23, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:53:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:29 user nova-compute[70243]: DEBUG nova.compute.manager [req-9fbbbc1d-46bc-428a-b39c-55eeb4113452 req-497e6cc7-1a02-4689-9d86-97f6861b4431 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Received event network-vif-plugged-951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:53:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9fbbbc1d-46bc-428a-b39c-55eeb4113452 req-497e6cc7-1a02-4689-9d86-97f6861b4431 service nova] Acquiring lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:53:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9fbbbc1d-46bc-428a-b39c-55eeb4113452 req-497e6cc7-1a02-4689-9d86-97f6861b4431 service nova] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:53:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9fbbbc1d-46bc-428a-b39c-55eeb4113452 req-497e6cc7-1a02-4689-9d86-97f6861b4431 service nova] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:53:29 user nova-compute[70243]: DEBUG nova.compute.manager [req-9fbbbc1d-46bc-428a-b39c-55eeb4113452 req-497e6cc7-1a02-4689-9d86-97f6861b4431 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] No waiting events found dispatching network-vif-plugged-951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:53:29 user nova-compute[70243]: WARNING nova.compute.manager [req-9fbbbc1d-46bc-428a-b39c-55eeb4113452 req-497e6cc7-1a02-4689-9d86-97f6861b4431 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Received unexpected event network-vif-plugged-951ed9cf-5121-492f-b159-0b4932e771fb for instance with vm_state shelved_offloaded and task_state spawning.
Jul 24 16:53:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:31 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217611.1606853, 5543fd2b-5470-4508-a9ca-4f13c738532b => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:53:31 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] VM Resumed (Lifecycle Event)
Jul 24 16:53:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:53:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:53:31 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Instance spawned successfully.
Jul 24 16:53:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:53:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:53:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:53:31 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:53:31 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217611.1632528, 5543fd2b-5470-4508-a9ca-4f13c738532b => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:53:31 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] VM Started (Lifecycle Event)
Jul 24 16:53:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-a9ca7902-2766-44b4-9746-501cf60306dc tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.535s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:53:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:53:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:53:31 user nova-compute[70243]: DEBUG nova.compute.manager [req-214e5a40-837f-41b1-86ef-eb294148693b req-01b666e4-eccf-46e6-a057-e15718b1bf94 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Received event network-vif-plugged-951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:53:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-214e5a40-837f-41b1-86ef-eb294148693b req-01b666e4-eccf-46e6-a057-e15718b1bf94 service nova] Acquiring lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:53:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-214e5a40-837f-41b1-86ef-eb294148693b req-01b666e4-eccf-46e6-a057-e15718b1bf94 service nova] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:53:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-214e5a40-837f-41b1-86ef-eb294148693b req-01b666e4-eccf-46e6-a057-e15718b1bf94 service nova] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:53:31 user nova-compute[70243]: DEBUG nova.compute.manager [req-214e5a40-837f-41b1-86ef-eb294148693b req-01b666e4-eccf-46e6-a057-e15718b1bf94 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] No waiting events found dispatching network-vif-plugged-951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:53:31 user nova-compute[70243]: WARNING nova.compute.manager [req-214e5a40-837f-41b1-86ef-eb294148693b req-01b666e4-eccf-46e6-a057-e15718b1bf94 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Received unexpected event network-vif-plugged-951ed9cf-5121-492f-b159-0b4932e771fb for instance with vm_state active and task_state None.
Jul 24 16:53:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:32 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:34 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:53:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:53:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:53:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:53:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:53:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:53:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:53:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Verify base images {{(pid=70243) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Jul 24 16:53:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=70243) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 24 16:53:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Image id 7192dcb0-7da9-4207-b62f-555f7e11e667 yields fingerprint e85f4d4d47c143c9c2ef3c6eb867a906516bd48d {{(pid=70243) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 24 16:53:34 user nova-compute[70243]: INFO nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] image 7192dcb0-7da9-4207-b62f-555f7e11e667 at (/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d): checking
Jul 24 16:53:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] image 7192dcb0-7da9-4207-b62f-555f7e11e667 at (/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d): image is in use {{(pid=70243) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Jul 24 16:53:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] 5543fd2b-5470-4508-a9ca-4f13c738532b is a valid instance name {{(pid=70243) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 24 16:53:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] 8c896761-df6a-4f4a-87dd-c5ea30641a89 is a valid instance name {{(pid=70243) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 24 16:53:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] 100c6ba5-de96-4c2a-ae0c-9d3a9199948c is a valid instance name {{(pid=70243) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 24 16:53:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] 100c6ba5-de96-4c2a-ae0c-9d3a9199948c has a disk file {{(pid=70243) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Jul 24 16:53:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:34 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 100c6ba5-de96-4c2a-ae0c-9d3a9199948c is backed by e85f4d4d47c143c9c2ef3c6eb867a906516bd48d {{(pid=70243) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Jul 24 16:53:34 user nova-compute[70243]: WARNING nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e07dafd856675ca74d6bdcd61d86090d4f91cf4c
Jul 24 16:53:34 user nova-compute[70243]: WARNING nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d1a1af388b3c9ef1d2fedea83e8b585b05e7d90a
Jul 24 16:53:34 user nova-compute[70243]: WARNING nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Unknown base file: /opt/stack/data/nova/instances/_base/dfcedca02bec0c0296ea0132613c0dad0cd08e41
Jul 24 16:53:34 user nova-compute[70243]: WARNING nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5d7ee6cf9ab4380359ba0dce28f68ec467404d38
Jul 24 16:53:34 user nova-compute[70243]: WARNING nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Unknown base file: /opt/stack/data/nova/instances/_base/dd58bbfe467ea6c97ad2003501c730cf628bb7e3
Jul 24 16:53:34 user nova-compute[70243]: WARNING nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9e39b984ab3b7b937ca13a44f7790f42e2e78d61
Jul 24 16:53:34 user nova-compute[70243]: WARNING nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9fabeff47555798f108b08e62af7f15380c69abe
Jul 24 16:53:34 user nova-compute[70243]: WARNING nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3b0852f2e2af03b1592db129e9a7c586e83d9983
Jul 24 16:53:34 user nova-compute[70243]: INFO nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Active base files: /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d
Jul 24 16:53:34 user nova-compute[70243]: INFO nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Removable base files: /opt/stack/data/nova/instances/_base/e07dafd856675ca74d6bdcd61d86090d4f91cf4c /opt/stack/data/nova/instances/_base/d1a1af388b3c9ef1d2fedea83e8b585b05e7d90a /opt/stack/data/nova/instances/_base/dfcedca02bec0c0296ea0132613c0dad0cd08e41 /opt/stack/data/nova/instances/_base/5d7ee6cf9ab4380359ba0dce28f68ec467404d38 /opt/stack/data/nova/instances/_base/dd58bbfe467ea6c97ad2003501c730cf628bb7e3 /opt/stack/data/nova/instances/_base/9e39b984ab3b7b937ca13a44f7790f42e2e78d61 /opt/stack/data/nova/instances/_base/9fabeff47555798f108b08e62af7f15380c69abe /opt/stack/data/nova/instances/_base/3b0852f2e2af03b1592db129e9a7c586e83d9983
Jul 24 16:53:34 user nova-compute[70243]: INFO nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e07dafd856675ca74d6bdcd61d86090d4f91cf4c
Jul 24 16:53:34 user nova-compute[70243]: INFO nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d1a1af388b3c9ef1d2fedea83e8b585b05e7d90a
Jul 24 16:53:34 user nova-compute[70243]: INFO nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dfcedca02bec0c0296ea0132613c0dad0cd08e41
Jul 24 16:53:34 user nova-compute[70243]: INFO nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5d7ee6cf9ab4380359ba0dce28f68ec467404d38
Jul 24 16:53:34 user nova-compute[70243]: INFO nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dd58bbfe467ea6c97ad2003501c730cf628bb7e3
Jul 24 16:53:34 user nova-compute[70243]: INFO nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9e39b984ab3b7b937ca13a44f7790f42e2e78d61
Jul 24 16:53:34 user nova-compute[70243]: INFO nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9fabeff47555798f108b08e62af7f15380c69abe
Jul 24 16:53:34 user nova-compute[70243]: INFO nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3b0852f2e2af03b1592db129e9a7c586e83d9983
Jul 24 16:53:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Verification complete {{(pid=70243) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Jul 24 16:53:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Verify swap images {{(pid=70243) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Jul 24 16:53:34 user nova-compute[70243]: DEBUG nova.virt.libvirt.imagecache [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Verify ephemeral images {{(pid=70243) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Jul 24 16:53:34 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690217599.9771957, ae152306-9bc0-47a4-b438-2dde63652863 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:53:34 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: ae152306-9bc0-47a4-b438-2dde63652863] VM Stopped (Lifecycle Event)
Jul 24 16:53:35 user nova-compute[70243]: DEBUG nova.compute.manager [None req-aad4a950-9ed2-40f9-8724-d1ad3af803d4 None None] [instance: ae152306-9bc0-47a4-b438-2dde63652863] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:53:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:46 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:53:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:53:53 user nova-compute[70243]: DEBUG nova.compute.manager [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:53:54 user nova-compute[70243]: INFO nova.compute.claims [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Claim successful on node user
Jul 24 16:53:54 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.249s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG nova.compute.manager [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG nova.compute.manager [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG nova.network.neutron [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:53:54 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:53:54 user nova-compute[70243]: DEBUG nova.compute.manager [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG nova.compute.manager [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:53:54 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Creating image(s)
Jul 24 16:53:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "/opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "/opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG nova.policy [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a4ab26ba5d94a8d89bb7b9403eda190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640508f674d34751905b6a4d9625fb1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.140s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk 1073741824" returned: 0 in 0.056s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "e85f4d4d47c143c9c2ef3c6eb867a906516bd48d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:53:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:55 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk. size=1073741824 {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 24 16:53:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:53:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:53:55 user nova-compute[70243]: DEBUG nova.virt.disk.api [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Cannot resize image /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk to a smaller size. {{(pid=70243) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 24 16:53:55 user nova-compute[70243]: DEBUG nova.objects.instance [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lazy-loading 'migration_context' on Instance uuid 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:53:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:53:55 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Ensure instance console log exists: /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:53:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:53:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:53:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:53:55 user nova-compute[70243]: DEBUG nova.network.neutron [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Successfully created port: 8f320269-e11a-4735-b792-c845cca35f8d {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:53:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.network.neutron [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Successfully updated port: 8f320269-e11a-4735-b792-c845cca35f8d {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquired lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.network.neutron [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.compute.manager [req-aaaee344-df28-4228-90c7-fa254148b8e1 req-88649840-f4d6-453c-bd59-a9d301b26cae service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Received event network-changed-8f320269-e11a-4735-b792-c845cca35f8d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.compute.manager [req-aaaee344-df28-4228-90c7-fa254148b8e1 req-88649840-f4d6-453c-bd59-a9d301b26cae service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Refreshing instance network info cache due to event network-changed-8f320269-e11a-4735-b792-c845cca35f8d. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-aaaee344-df28-4228-90c7-fa254148b8e1 req-88649840-f4d6-453c-bd59-a9d301b26cae service nova] Acquiring lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.network.neutron [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.network.neutron [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Updating instance_info_cache with network_info: [{"id": "8f320269-e11a-4735-b792-c845cca35f8d", "address": "fa:16:3e:7d:ac:88", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f320269-e1", "ovs_interfaceid": "8f320269-e11a-4735-b792-c845cca35f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Releasing lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.compute.manager [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Instance network_info: |[{"id": "8f320269-e11a-4735-b792-c845cca35f8d", "address": "fa:16:3e:7d:ac:88", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f320269-e1", "ovs_interfaceid": "8f320269-e11a-4735-b792-c845cca35f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-aaaee344-df28-4228-90c7-fa254148b8e1 req-88649840-f4d6-453c-bd59-a9d301b26cae service nova] Acquired lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.network.neutron [req-aaaee344-df28-4228-90c7-fa254148b8e1 req-88649840-f4d6-453c-bd59-a9d301b26cae service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Refreshing network info cache for port 8f320269-e11a-4735-b792-c845cca35f8d {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Start _get_guest_xml network_info=[{"id": "8f320269-e11a-4735-b792-c845cca35f8d", "address": "fa:16:3e:7d:ac:88", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f320269-e1", "ovs_interfaceid": "8f320269-e11a-4735-b792-c845cca35f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': '7192dcb0-7da9-4207-b62f-555f7e11e667'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:53:56 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:53:56 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-24T16:14:03Z,direct_url=<?>,disk_format='qcow2',id=7192dcb0-7da9-4207-b62f-555f7e11e667,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6ea761b45d5e428287fb9fa480f5d4c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-24T16:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:53:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-227271702',display_name='tempest-TestStampPattern-server-227271702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-227271702',id=44,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcjN6AXTahgDTIvI9HIaDQ+k/Dzge84NatzMa2EvJXvuccVx0gyZ59Q8J0iAC9E1btcc6mN455JjktsyIeZ/7vf3Iafpzgfuv6BK3oksbTrcO0UZlMN59+9iVCgGkzqiw==',key_name='tempest-TestStampPattern-1639173847',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='640508f674d34751905b6a4d9625fb1f',ramdisk_id='',reservation_id='r-8f3ykg6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1363630507',owner_user_name='tempest-TestStampPattern-1363630507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:53:54Z,user_data=None,user_id='4a4ab26ba5d94a8d89bb7b9403eda190',uuid=4e1e09ef-9c6f-4032-8a90-6dfb2583df81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f320269-e11a-4735-b792-c845cca35f8d", "address": "fa:16:3e:7d:ac:88", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f320269-e1", "ovs_interfaceid": "8f320269-e11a-4735-b792-c845cca35f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Converting VIF {"id": "8f320269-e11a-4735-b792-c845cca35f8d", "address": "fa:16:3e:7d:ac:88", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f320269-e1", "ovs_interfaceid": "8f320269-e11a-4735-b792-c845cca35f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:ac:88,bridge_name='br-int',has_traffic_filtering=True,id=8f320269-e11a-4735-b792-c845cca35f8d,network=Network(8ec80dde-9337-44d3-a3a7-c8b6e55e561f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f320269-e1') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.objects.instance [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:53:56 user nova-compute[70243]:   <uuid>4e1e09ef-9c6f-4032-8a90-6dfb2583df81</uuid>
Jul 24 16:53:56 user nova-compute[70243]:   <name>instance-0000002c</name>
Jul 24 16:53:56 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:53:56 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:53:56 user nova-compute[70243]:   <metadata>
Jul 24 16:53:56 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:53:56 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:53:56 user nova-compute[70243]:       <nova:name>tempest-TestStampPattern-server-227271702</nova:name>
Jul 24 16:53:56 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:53:56</nova:creationTime>
Jul 24 16:53:56 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:53:56 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:53:56 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:53:56 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:53:56 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:53:56 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:53:56 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:53:56 user nova-compute[70243]:       <nova:owner>
Jul 24 16:53:56 user nova-compute[70243]:         <nova:user uuid="4a4ab26ba5d94a8d89bb7b9403eda190">tempest-TestStampPattern-1363630507-project-member</nova:user>
Jul 24 16:53:56 user nova-compute[70243]:         <nova:project uuid="640508f674d34751905b6a4d9625fb1f">tempest-TestStampPattern-1363630507</nova:project>
Jul 24 16:53:56 user nova-compute[70243]:       </nova:owner>
Jul 24 16:53:56 user nova-compute[70243]:       <nova:root type="image" uuid="7192dcb0-7da9-4207-b62f-555f7e11e667"/>
Jul 24 16:53:56 user nova-compute[70243]:       <nova:ports>
Jul 24 16:53:56 user nova-compute[70243]:         <nova:port uuid="8f320269-e11a-4735-b792-c845cca35f8d">
Jul 24 16:53:56 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 16:53:56 user nova-compute[70243]:         </nova:port>
Jul 24 16:53:56 user nova-compute[70243]:       </nova:ports>
Jul 24 16:53:56 user nova-compute[70243]:     </nova:instance>
Jul 24 16:53:56 user nova-compute[70243]:   </metadata>
Jul 24 16:53:56 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:53:56 user nova-compute[70243]:     <system>
Jul 24 16:53:56 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:53:56 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:53:56 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:53:56 user nova-compute[70243]:       <entry name="serial">4e1e09ef-9c6f-4032-8a90-6dfb2583df81</entry>
Jul 24 16:53:56 user nova-compute[70243]:       <entry name="uuid">4e1e09ef-9c6f-4032-8a90-6dfb2583df81</entry>
Jul 24 16:53:56 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:53:56 user nova-compute[70243]:     </system>
Jul 24 16:53:56 user nova-compute[70243]:   </sysinfo>
Jul 24 16:53:56 user nova-compute[70243]:   <os>
Jul 24 16:53:56 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:53:56 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:53:56 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:53:56 user nova-compute[70243]:   </os>
Jul 24 16:53:56 user nova-compute[70243]:   <features>
Jul 24 16:53:56 user nova-compute[70243]:     <acpi/>
Jul 24 16:53:56 user nova-compute[70243]:     <apic/>
Jul 24 16:53:56 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:53:56 user nova-compute[70243]:   </features>
Jul 24 16:53:56 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:53:56 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:53:56 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:53:56 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:53:56 user nova-compute[70243]:   </clock>
Jul 24 16:53:56 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:53:56 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:53:56 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:53:56 user nova-compute[70243]:   </cpu>
Jul 24 16:53:56 user nova-compute[70243]:   <devices>
Jul 24 16:53:56 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:53:56 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:53:56 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk"/>
Jul 24 16:53:56 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:53:56 user nova-compute[70243]:     </disk>
Jul 24 16:53:56 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:53:56 user nova-compute[70243]:       <mac address="fa:16:3e:7d:ac:88"/>
Jul 24 16:53:56 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:53:56 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:53:56 user nova-compute[70243]:       <target dev="tap8f320269-e1"/>
Jul 24 16:53:56 user nova-compute[70243]:     </interface>
Jul 24 16:53:56 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:53:56 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/console.log" append="off"/>
Jul 24 16:53:56 user nova-compute[70243]:     </serial>
Jul 24 16:53:56 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:53:56 user nova-compute[70243]:     <video>
Jul 24 16:53:56 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:53:56 user nova-compute[70243]:     </video>
Jul 24 16:53:56 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:53:56 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:53:56 user nova-compute[70243]:     </rng>
Jul 24 16:53:56 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:53:56 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:53:56 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:53:56 user nova-compute[70243]:     </memballoon>
Jul 24 16:53:56 user nova-compute[70243]:   </devices>
Jul 24 16:53:56 user nova-compute[70243]: </domain>
Jul 24 16:53:56 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:53:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-227271702',display_name='tempest-TestStampPattern-server-227271702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-227271702',id=44,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcjN6AXTahgDTIvI9HIaDQ+k/Dzge84NatzMa2EvJXvuccVx0gyZ59Q8J0iAC9E1btcc6mN455JjktsyIeZ/7vf3Iafpzgfuv6BK3oksbTrcO0UZlMN59+9iVCgGkzqiw==',key_name='tempest-TestStampPattern-1639173847',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='640508f674d34751905b6a4d9625fb1f',ramdisk_id='',reservation_id='r-8f3ykg6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1363630507',owner_user_name='tempest-TestStampPattern-1363630507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:53:54Z,user_data=None,user_id='4a4ab26ba5d94a8d89bb7b9403eda190',uuid=4e1e09ef-9c6f-4032-8a90-6dfb2583df81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f320269-e11a-4735-b792-c845cca35f8d", "address": "fa:16:3e:7d:ac:88", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f320269-e1", "ovs_interfaceid": "8f320269-e11a-4735-b792-c845cca35f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Converting VIF {"id": "8f320269-e11a-4735-b792-c845cca35f8d", "address": "fa:16:3e:7d:ac:88", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f320269-e1", "ovs_interfaceid": "8f320269-e11a-4735-b792-c845cca35f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:ac:88,bridge_name='br-int',has_traffic_filtering=True,id=8f320269-e11a-4735-b792-c845cca35f8d,network=Network(8ec80dde-9337-44d3-a3a7-c8b6e55e561f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f320269-e1') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG os_vif [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:ac:88,bridge_name='br-int',has_traffic_filtering=True,id=8f320269-e11a-4735-b792-c845cca35f8d,network=Network(8ec80dde-9337-44d3-a3a7-c8b6e55e561f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f320269-e1') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f320269-e1, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f320269-e1, col_values=(('external_ids', {'iface-id': '8f320269-e11a-4735-b792-c845cca35f8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:ac:88', 'vm-uuid': '4e1e09ef-9c6f-4032-8a90-6dfb2583df81'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:56 user nova-compute[70243]: INFO os_vif [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:ac:88,bridge_name='br-int',has_traffic_filtering=True,id=8f320269-e11a-4735-b792-c845cca35f8d,network=Network(8ec80dde-9337-44d3-a3a7-c8b6e55e561f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f320269-e1')
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] No VIF found with MAC fa:16:3e:7d:ac:88, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.network.neutron [req-aaaee344-df28-4228-90c7-fa254148b8e1 req-88649840-f4d6-453c-bd59-a9d301b26cae service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Updated VIF entry in instance network info cache for port 8f320269-e11a-4735-b792-c845cca35f8d. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG nova.network.neutron [req-aaaee344-df28-4228-90c7-fa254148b8e1 req-88649840-f4d6-453c-bd59-a9d301b26cae service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Updating instance_info_cache with network_info: [{"id": "8f320269-e11a-4735-b792-c845cca35f8d", "address": "fa:16:3e:7d:ac:88", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f320269-e1", "ovs_interfaceid": "8f320269-e11a-4735-b792-c845cca35f8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:53:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-aaaee344-df28-4228-90c7-fa254148b8e1 req-88649840-f4d6-453c-bd59-a9d301b26cae service nova] Releasing lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:53:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-195be60d-d317-4cd2-a558-479e8db96c5d req-eb00ab11-c80d-4e9c-82be-88aa1a63b52b service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Received event network-vif-plugged-8f320269-e11a-4735-b792-c845cca35f8d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:53:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-195be60d-d317-4cd2-a558-479e8db96c5d req-eb00ab11-c80d-4e9c-82be-88aa1a63b52b service nova] Acquiring lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:53:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-195be60d-d317-4cd2-a558-479e8db96c5d req-eb00ab11-c80d-4e9c-82be-88aa1a63b52b service nova] Lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:53:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-195be60d-d317-4cd2-a558-479e8db96c5d req-eb00ab11-c80d-4e9c-82be-88aa1a63b52b service nova] Lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:53:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-195be60d-d317-4cd2-a558-479e8db96c5d req-eb00ab11-c80d-4e9c-82be-88aa1a63b52b service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] No waiting events found dispatching network-vif-plugged-8f320269-e11a-4735-b792-c845cca35f8d {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:53:58 user nova-compute[70243]: WARNING nova.compute.manager [req-195be60d-d317-4cd2-a558-479e8db96c5d req-eb00ab11-c80d-4e9c-82be-88aa1a63b52b service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Received unexpected event network-vif-plugged-8f320269-e11a-4735-b792-c845cca35f8d for instance with vm_state building and task_state spawning.
Jul 24 16:53:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:53:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:00 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217640.1279614, 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:54:00 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] VM Resumed (Lifecycle Event)
Jul 24 16:54:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:54:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:54:00 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Instance spawned successfully.
Jul 24 16:54:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:54:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:54:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:54:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:54:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:54:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:54:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:54:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:54:00 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:54:00 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:54:00 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217640.1298018, 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:54:00 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] VM Started (Lifecycle Event)
Jul 24 16:54:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:54:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:54:00 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:54:00 user nova-compute[70243]: DEBUG nova.compute.manager [req-edc7f91b-d66a-48d8-a5e9-0e470db2f7fb req-fdd37974-dd0e-4406-af4f-c4690028e0e1 service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Received event network-vif-plugged-8f320269-e11a-4735-b792-c845cca35f8d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:54:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-edc7f91b-d66a-48d8-a5e9-0e470db2f7fb req-fdd37974-dd0e-4406-af4f-c4690028e0e1 service nova] Acquiring lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:54:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-edc7f91b-d66a-48d8-a5e9-0e470db2f7fb req-fdd37974-dd0e-4406-af4f-c4690028e0e1 service nova] Lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:54:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-edc7f91b-d66a-48d8-a5e9-0e470db2f7fb req-fdd37974-dd0e-4406-af4f-c4690028e0e1 service nova] Lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:54:00 user nova-compute[70243]: DEBUG nova.compute.manager [req-edc7f91b-d66a-48d8-a5e9-0e470db2f7fb req-fdd37974-dd0e-4406-af4f-c4690028e0e1 service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] No waiting events found dispatching network-vif-plugged-8f320269-e11a-4735-b792-c845cca35f8d {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:54:00 user nova-compute[70243]: WARNING nova.compute.manager [req-edc7f91b-d66a-48d8-a5e9-0e470db2f7fb req-fdd37974-dd0e-4406-af4f-c4690028e0e1 service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Received unexpected event network-vif-plugged-8f320269-e11a-4735-b792-c845cca35f8d for instance with vm_state building and task_state spawning.
Jul 24 16:54:00 user nova-compute[70243]: INFO nova.compute.manager [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Took 5.70 seconds to spawn the instance on the hypervisor.
Jul 24 16:54:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:54:00 user nova-compute[70243]: INFO nova.compute.manager [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Took 6.29 seconds to build instance.
Jul 24 16:54:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-aec9af34-fcaf-4834-8cb8-8e479c3301fa tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.377s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:54:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:05 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:54:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:08 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:54:08 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:54:08 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Didn't find any instances for network info cache update. {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 16:54:08 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:54:08 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:54:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "8c896761-df6a-4f4a-87dd-c5ea30641a89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:54:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:54:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:54:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:54:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:54:09 user nova-compute[70243]: INFO nova.compute.manager [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Terminating instance
Jul 24 16:54:09 user nova-compute[70243]: DEBUG nova.compute.manager [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:54:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG nova.compute.manager [req-d8bab3f0-4ee5-41b2-becc-0de5a7ea7f4d req-501511e5-f67c-4b0c-8eea-e735005b903b service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received event network-vif-unplugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d8bab3f0-4ee5-41b2-becc-0de5a7ea7f4d req-501511e5-f67c-4b0c-8eea-e735005b903b service nova] Acquiring lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d8bab3f0-4ee5-41b2-becc-0de5a7ea7f4d req-501511e5-f67c-4b0c-8eea-e735005b903b service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d8bab3f0-4ee5-41b2-becc-0de5a7ea7f4d req-501511e5-f67c-4b0c-8eea-e735005b903b service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG nova.compute.manager [req-d8bab3f0-4ee5-41b2-becc-0de5a7ea7f4d req-501511e5-f67c-4b0c-8eea-e735005b903b service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] No waiting events found dispatching network-vif-unplugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG nova.compute.manager [req-d8bab3f0-4ee5-41b2-becc-0de5a7ea7f4d req-501511e5-f67c-4b0c-8eea-e735005b903b service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received event network-vif-unplugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:10 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Instance destroyed successfully.
Jul 24 16:54:10 user nova-compute[70243]: DEBUG nova.objects.instance [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'resources' on Instance uuid 8c896761-df6a-4f4a-87dd-c5ea30641a89 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:38:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-166447096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-166447096',id=35,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:40:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06cf84dc406343afa81260614acc8fdd',ramdisk_id='',reservation_id='r-8wvymxtp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:42:11Z,user_data=None,user_id='ae306b319e8c4e61b0a73933dc5c330c',uuid=8c896761-df6a-4f4a-87dd-c5ea30641a89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "address": "fa:16:3e:a5:da:73", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa5a7d4-ef", "ovs_interfaceid": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converting VIF {"id": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "address": "fa:16:3e:a5:da:73", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa5a7d4-ef", "ovs_interfaceid": "daa5a7d4-efaf-41c4-8cd2-1a26326f9257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:da:73,bridge_name='br-int',has_traffic_filtering=True,id=daa5a7d4-efaf-41c4-8cd2-1a26326f9257,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa5a7d4-ef') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG os_vif [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:da:73,bridge_name='br-int',has_traffic_filtering=True,id=daa5a7d4-efaf-41c4-8cd2-1a26326f9257,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa5a7d4-ef') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdaa5a7d4-ef, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:10 user nova-compute[70243]: INFO os_vif [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:da:73,bridge_name='br-int',has_traffic_filtering=True,id=daa5a7d4-efaf-41c4-8cd2-1a26326f9257,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa5a7d4-ef')
Jul 24 16:54:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xaQUdlyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:54:10 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:54:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[08306e49-ea84-46b5-9e82-a9c6cde14e04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:54:10 user nova-compute[70243]: No targets found.
Jul 24 16:54:10 user nova-compute[70243]: iSNS:
Jul 24 16:54:10 user nova-compute[70243]: No targets found.
Jul 24 16:54:10 user nova-compute[70243]: STATIC:
Jul 24 16:54:10 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785
Jul 24 16:54:10 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:54:10 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:54:10 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3
Jul 24 16:54:10 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:54:10 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:54:10 user nova-compute[70243]: FIRMWARE:
Jul 24 16:54:10 user nova-compute[70243]: No targets found.
Jul 24 16:54:10 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:54:10 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:54:10 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd468f38-0813-46c2-9a5b-88345e2d1260]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[585fa4ea-8fab-4a2e-b686-d4cdb9939c1d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:54:10 user nova-compute[70243]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 (non-flash)
Jul 24 16:54:10 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 (non-flash)
Jul 24 16:54:10 user nova-compute[70243]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 (non-flash)
Jul 24 16:54:10 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc13e830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3'): ({'sdd'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Removing single pathed devices sdd {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d74767-a094-4be5-8aaa-1efbe21b21b9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18434f0-db05-4372-8fe7-6d18a6f729e4]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Flushing IO for device /dev/sdd {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7b3dcc-614d-4cbb-91f4-85ed999ac57d]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7677a20-1dde-457d-bba4-1579f472e51e]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] SCSI volumes sdd have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7116ba-587c-4929-a1e7-3603e286ebbf]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0f2b08-8214-4ccd-a30f-bce992d4c427]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3, portal: 172.16.0.220,3260]
Jul 24 16:54:10 user nova-compute[70243]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3, portal: 172.16.0.220,3260] successful.
Jul 24 16:54:10 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80abe3a6-777b-4600-ab3a-b4ce4e58edc3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fda066-5d4c-4e4a-8025-fc596b8ae415]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] <== disconnect_volume: return (318ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:54:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:54:10 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Deleting instance files /opt/stack/data/nova/instances/8c896761-df6a-4f4a-87dd-c5ea30641a89_del
Jul 24 16:54:10 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Deletion of /opt/stack/data/nova/instances/8c896761-df6a-4f4a-87dd-c5ea30641a89_del complete
Jul 24 16:54:11 user nova-compute[70243]: INFO nova.compute.manager [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Took 1.19 seconds to destroy the instance on the hypervisor.
Jul 24 16:54:11 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:54:11 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:54:11 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:54:11 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:54:11 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Took 0.94 seconds to deallocate network for instance.
Jul 24 16:54:12 user nova-compute[70243]: DEBUG nova.compute.manager [req-f373149c-28d2-4bca-b89e-8b3825ec48d9 req-af40ab36-a306-4219-b9a2-579d05c452da service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received event network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:54:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f373149c-28d2-4bca-b89e-8b3825ec48d9 req-af40ab36-a306-4219-b9a2-579d05c452da service nova] Acquiring lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:54:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f373149c-28d2-4bca-b89e-8b3825ec48d9 req-af40ab36-a306-4219-b9a2-579d05c452da service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:54:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f373149c-28d2-4bca-b89e-8b3825ec48d9 req-af40ab36-a306-4219-b9a2-579d05c452da service nova] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:54:12 user nova-compute[70243]: DEBUG nova.compute.manager [req-f373149c-28d2-4bca-b89e-8b3825ec48d9 req-af40ab36-a306-4219-b9a2-579d05c452da service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] No waiting events found dispatching network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:54:12 user nova-compute[70243]: WARNING nova.compute.manager [req-f373149c-28d2-4bca-b89e-8b3825ec48d9 req-af40ab36-a306-4219-b9a2-579d05c452da service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received unexpected event network-vif-plugged-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 for instance with vm_state active and task_state deleting.
Jul 24 16:54:12 user nova-compute[70243]: DEBUG nova.compute.manager [req-f373149c-28d2-4bca-b89e-8b3825ec48d9 req-af40ab36-a306-4219-b9a2-579d05c452da service nova] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Received event network-vif-deleted-daa5a7d4-efaf-41c4-8cd2-1a26326f9257 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:54:12 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:54:12 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:54:12 user nova-compute[70243]: INFO nova.compute.manager [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Took 0.75 seconds to detach 1 volumes for instance.
Jul 24 16:54:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:54:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:54:13 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:54:13 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:54:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:54:13 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Deleted allocations for instance 8c896761-df6a-4f4a-87dd-c5ea30641a89
Jul 24 16:54:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-4e7e0f64-5252-4f0e-9e13-8ad14218392b tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "8c896761-df6a-4f4a-87dd-c5ea30641a89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.417s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:54:13 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:54:13 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:54:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:17 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:54:17 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:54:17 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:54:17 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:54:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:54:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:54:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:54:17 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:54:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:54:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:54:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:54:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:54:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:54:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:54:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:54:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:54:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:54:18 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:54:18 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:54:18 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8392MB free_disk=24.063880920410156GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:54:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:54:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:54:18 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 100c6ba5-de96-4c2a-ae0c-9d3a9199948c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:54:18 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 5543fd2b-5470-4508-a9ca-4f13c738532b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:54:18 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:54:18 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:54:18 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:54:18 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:54:18 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:54:18 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:54:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:54:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:25 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:54:25 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70243) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 16:54:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:25 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690217650.576042, 8c896761-df6a-4f4a-87dd-c5ea30641a89 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:54:25 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] VM Stopped (Lifecycle Event)
Jul 24 16:54:25 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d380629e-20af-4059-b46d-f727b920a4e9 None None] [instance: 8c896761-df6a-4f4a-87dd-c5ea30641a89] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:54:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:34 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:54:34 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Cleaning up deleted instances {{(pid=70243) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 16:54:34 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] There are 0 instances to clean {{(pid=70243) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 16:54:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:54:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:54:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:54:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:54:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:54:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:54:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:55:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:55:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:55:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:55:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:55:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:55:00 user nova-compute[70243]: INFO nova.compute.manager [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Terminating instance
Jul 24 16:55:00 user nova-compute[70243]: DEBUG nova.compute.manager [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:55:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:55:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:00 user nova-compute[70243]: DEBUG nova.compute.manager [req-f6163c79-aa73-442d-89af-bce38973edfa req-9af1a0a0-8ff9-4dbe-8f79-9718099c3bc5 service nova] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Received event network-vif-unplugged-82ce0c89-3921-42d9-bfd8-d6bcab182f73 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:55:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f6163c79-aa73-442d-89af-bce38973edfa req-9af1a0a0-8ff9-4dbe-8f79-9718099c3bc5 service nova] Acquiring lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:55:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f6163c79-aa73-442d-89af-bce38973edfa req-9af1a0a0-8ff9-4dbe-8f79-9718099c3bc5 service nova] Lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:55:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f6163c79-aa73-442d-89af-bce38973edfa req-9af1a0a0-8ff9-4dbe-8f79-9718099c3bc5 service nova] Lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:55:00 user nova-compute[70243]: DEBUG nova.compute.manager [req-f6163c79-aa73-442d-89af-bce38973edfa req-9af1a0a0-8ff9-4dbe-8f79-9718099c3bc5 service nova] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] No waiting events found dispatching network-vif-unplugged-82ce0c89-3921-42d9-bfd8-d6bcab182f73 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:55:00 user nova-compute[70243]: DEBUG nova.compute.manager [req-f6163c79-aa73-442d-89af-bce38973edfa req-9af1a0a0-8ff9-4dbe-8f79-9718099c3bc5 service nova] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Received event network-vif-unplugged-82ce0c89-3921-42d9-bfd8-d6bcab182f73 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:55:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:01 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Instance destroyed successfully.
Jul 24 16:55:01 user nova-compute[70243]: DEBUG nova.objects.instance [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lazy-loading 'resources' on Instance uuid 100c6ba5-de96-4c2a-ae0c-9d3a9199948c {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:55:01 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:35:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1504165506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1504165506',id=32,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:35:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06cf84dc406343afa81260614acc8fdd',ramdisk_id='',reservation_id='r-sfo1zb8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:37:22Z,user_data=None,user_id='ae306b319e8c4e61b0a73933dc5c330c',uuid=100c6ba5-de96-4c2a-ae0c-9d3a9199948c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "address": "fa:16:3e:03:1c:93", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ce0c89-39", "ovs_interfaceid": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:55:01 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converting VIF {"id": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "address": "fa:16:3e:03:1c:93", "network": {"id": "9d6d1b2b-eb5d-4864-91b4-ded499981d68", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1475801310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06cf84dc406343afa81260614acc8fdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82ce0c89-39", "ovs_interfaceid": "82ce0c89-3921-42d9-bfd8-d6bcab182f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:55:01 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:1c:93,bridge_name='br-int',has_traffic_filtering=True,id=82ce0c89-3921-42d9-bfd8-d6bcab182f73,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ce0c89-39') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:55:01 user nova-compute[70243]: DEBUG os_vif [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:1c:93,bridge_name='br-int',has_traffic_filtering=True,id=82ce0c89-3921-42d9-bfd8-d6bcab182f73,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ce0c89-39') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:55:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82ce0c89-39, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:55:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:55:01 user nova-compute[70243]: INFO os_vif [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:1c:93,bridge_name='br-int',has_traffic_filtering=True,id=82ce0c89-3921-42d9-bfd8-d6bcab182f73,network=Network(9d6d1b2b-eb5d-4864-91b4-ded499981d68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82ce0c89-39')
Jul 24 16:55:01 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Deleting instance files /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c_del
Jul 24 16:55:01 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Deletion of /opt/stack/data/nova/instances/100c6ba5-de96-4c2a-ae0c-9d3a9199948c_del complete
Jul 24 16:55:01 user nova-compute[70243]: INFO nova.compute.manager [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 24 16:55:01 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:55:01 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:55:01 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:55:01 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:55:01 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Took 0.54 seconds to deallocate network for instance.
Jul 24 16:55:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:55:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:55:02 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:55:02 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:55:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:55:02 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Deleted allocations for instance 100c6ba5-de96-4c2a-ae0c-9d3a9199948c
Jul 24 16:55:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-243a5e59-00c1-4ee7-a022-949c6688b989 tempest-ServerBootFromVolumeStableRescueTest-1579673828 tempest-ServerBootFromVolumeStableRescueTest-1579673828-project-member] Lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.735s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:55:03 user nova-compute[70243]: DEBUG nova.compute.manager [req-837373e1-773f-4058-b7a4-303f895deada req-025c271c-05e0-42bb-8682-6027a85d598c service nova] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Received event network-vif-plugged-82ce0c89-3921-42d9-bfd8-d6bcab182f73 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:55:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-837373e1-773f-4058-b7a4-303f895deada req-025c271c-05e0-42bb-8682-6027a85d598c service nova] Acquiring lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:55:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-837373e1-773f-4058-b7a4-303f895deada req-025c271c-05e0-42bb-8682-6027a85d598c service nova] Lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:55:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-837373e1-773f-4058-b7a4-303f895deada req-025c271c-05e0-42bb-8682-6027a85d598c service nova] Lock "100c6ba5-de96-4c2a-ae0c-9d3a9199948c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:55:03 user nova-compute[70243]: DEBUG nova.compute.manager [req-837373e1-773f-4058-b7a4-303f895deada req-025c271c-05e0-42bb-8682-6027a85d598c service nova] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] No waiting events found dispatching network-vif-plugged-82ce0c89-3921-42d9-bfd8-d6bcab182f73 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:55:03 user nova-compute[70243]: WARNING nova.compute.manager [req-837373e1-773f-4058-b7a4-303f895deada req-025c271c-05e0-42bb-8682-6027a85d598c service nova] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Received unexpected event network-vif-plugged-82ce0c89-3921-42d9-bfd8-d6bcab182f73 for instance with vm_state deleted and task_state None.
Jul 24 16:55:03 user nova-compute[70243]: DEBUG nova.compute.manager [req-837373e1-773f-4058-b7a4-303f895deada req-025c271c-05e0-42bb-8682-6027a85d598c service nova] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Received event network-vif-deleted-82ce0c89-3921-42d9-bfd8-d6bcab182f73 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:55:05 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:55:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:07 user nova-compute[70243]: DEBUG nova.compute.manager [req-370166f2-374b-4ead-b8d8-ff1d5497cfa4 req-ab5b69b6-f171-4ae7-ae22-458ebf74d5db service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Received event network-changed-951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:55:07 user nova-compute[70243]: DEBUG nova.compute.manager [req-370166f2-374b-4ead-b8d8-ff1d5497cfa4 req-ab5b69b6-f171-4ae7-ae22-458ebf74d5db service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Refreshing instance network info cache due to event network-changed-951ed9cf-5121-492f-b159-0b4932e771fb. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:55:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-370166f2-374b-4ead-b8d8-ff1d5497cfa4 req-ab5b69b6-f171-4ae7-ae22-458ebf74d5db service nova] Acquiring lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:55:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-370166f2-374b-4ead-b8d8-ff1d5497cfa4 req-ab5b69b6-f171-4ae7-ae22-458ebf74d5db service nova] Acquired lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:55:07 user nova-compute[70243]: DEBUG nova.network.neutron [req-370166f2-374b-4ead-b8d8-ff1d5497cfa4 req-ab5b69b6-f171-4ae7-ae22-458ebf74d5db service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Refreshing network info cache for port 951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:55:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquiring lock "5543fd2b-5470-4508-a9ca-4f13c738532b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:55:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:55:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquiring lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:55:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:55:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:55:07 user nova-compute[70243]: INFO nova.compute.manager [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Terminating instance
Jul 24 16:55:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:55:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG nova.compute.manager [req-eb7bf093-517e-40ba-903b-7bca45f207d8 req-332d97f8-d4b2-43d4-8e1e-c0ea2de6313e service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Received event network-vif-unplugged-951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-eb7bf093-517e-40ba-903b-7bca45f207d8 req-332d97f8-d4b2-43d4-8e1e-c0ea2de6313e service nova] Acquiring lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-eb7bf093-517e-40ba-903b-7bca45f207d8 req-332d97f8-d4b2-43d4-8e1e-c0ea2de6313e service nova] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-eb7bf093-517e-40ba-903b-7bca45f207d8 req-332d97f8-d4b2-43d4-8e1e-c0ea2de6313e service nova] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG nova.compute.manager [req-eb7bf093-517e-40ba-903b-7bca45f207d8 req-332d97f8-d4b2-43d4-8e1e-c0ea2de6313e service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] No waiting events found dispatching network-vif-unplugged-951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG nova.compute.manager [req-eb7bf093-517e-40ba-903b-7bca45f207d8 req-332d97f8-d4b2-43d4-8e1e-c0ea2de6313e service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Received event network-vif-unplugged-951ed9cf-5121-492f-b159-0b4932e771fb for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG nova.network.neutron [req-370166f2-374b-4ead-b8d8-ff1d5497cfa4 req-ab5b69b6-f171-4ae7-ae22-458ebf74d5db service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Updated VIF entry in instance network info cache for port 951ed9cf-5121-492f-b159-0b4932e771fb. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG nova.network.neutron [req-370166f2-374b-4ead-b8d8-ff1d5497cfa4 req-ab5b69b6-f171-4ae7-ae22-458ebf74d5db service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Updating instance_info_cache with network_info: [{"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": "br-int", "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951ed9cf-51", "ovs_interfaceid": "951ed9cf-5121-492f-b159-0b4932e771fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-370166f2-374b-4ead-b8d8-ff1d5497cfa4 req-ab5b69b6-f171-4ae7-ae22-458ebf74d5db service nova] Releasing lock "refresh_cache-5543fd2b-5470-4508-a9ca-4f13c738532b" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:55:08 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Instance destroyed successfully.
Jul 24 16:55:08 user nova-compute[70243]: DEBUG nova.objects.instance [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lazy-loading 'resources' on Instance uuid 5543fd2b-5470-4508-a9ca-4f13c738532b {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-07-24T16:49:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1139089850',display_name='tempest-TestShelveInstance-server-1139089850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1139089850',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPg23vwDHSqi268RX4whK/nc/65tADGebXhorftF+Dsr1j1nDUi6xPVzatN//44XA2S4FTtv2uZZw5Pu45YomaYjix5Kz3UHrcn5/NLM1nfJ7n7Y6goM0k6TcjF0dMAk+g==',key_name='tempest-TestShelveInstance-632376813',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:53:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d6d7f3ea6e34c48b48f5ee828e6340b',ramdisk_id='',reservation_id='r-4smpbws2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2048728132',owner_user_name='tempest-TestShelveInstance-2048728132-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:53:31Z,user_data=None,user_id='7e466829ccbb444097fb673e6510ba0f',uuid=5543fd2b-5470-4508-a9ca-4f13c738532b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": "br-int", "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951ed9cf-51", "ovs_interfaceid": "951ed9cf-5121-492f-b159-0b4932e771fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Converting VIF {"id": "951ed9cf-5121-492f-b159-0b4932e771fb", "address": "fa:16:3e:5f:89:23", "network": {"id": "ab426a4e-5220-4e05-ad1c-3438e6648365", "bridge": "br-int", "label": "tempest-TestShelveInstance-431281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d6d7f3ea6e34c48b48f5ee828e6340b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951ed9cf-51", "ovs_interfaceid": "951ed9cf-5121-492f-b159-0b4932e771fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:89:23,bridge_name='br-int',has_traffic_filtering=True,id=951ed9cf-5121-492f-b159-0b4932e771fb,network=Network(ab426a4e-5220-4e05-ad1c-3438e6648365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951ed9cf-51') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG os_vif [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:89:23,bridge_name='br-int',has_traffic_filtering=True,id=951ed9cf-5121-492f-b159-0b4932e771fb,network=Network(ab426a4e-5220-4e05-ad1c-3438e6648365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951ed9cf-51') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap951ed9cf-51, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:55:08 user nova-compute[70243]: INFO os_vif [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:89:23,bridge_name='br-int',has_traffic_filtering=True,id=951ed9cf-5121-492f-b159-0b4932e771fb,network=Network(ab426a4e-5220-4e05-ad1c-3438e6648365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951ed9cf-51')
Jul 24 16:55:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBgeXIYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:55:08 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:55:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c370ae90-7c1a-44b0-b5c4-c728f5adc3dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:55:08 user nova-compute[70243]: No targets found.
Jul 24 16:55:08 user nova-compute[70243]: iSNS:
Jul 24 16:55:08 user nova-compute[70243]: No targets found.
Jul 24 16:55:08 user nova-compute[70243]: STATIC:
Jul 24 16:55:08 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785
Jul 24 16:55:08 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:55:08 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:55:08 user nova-compute[70243]: FIRMWARE:
Jul 24 16:55:08 user nova-compute[70243]: No targets found.
Jul 24 16:55:08 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:55:08 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:55:08 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a800f25a-70d1-4d57-a6e7-1565ba0171ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab3e6ac-4e0a-4d93-8dca-98613e695685]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 (non-flash)
Jul 24 16:55:08 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 (non-flash)
Jul 24 16:55:08 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91ec1a85e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785'): ({'sdb'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Removing single pathed devices sdb {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c6484f-5256-44b6-b4fa-cd610d37e1ec]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d74a4a-e3ec-4ef0-bdaa-6cce415128a0]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Flushing IO for device /dev/sdb {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98c5d76-89ef-4d04-a7d7-da26a7661610]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ac4c48-43a9-44a8-9958-5493da121879]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a8336220', '/dev/disk/by-id/scsi-1SCST_BIOa8336220-c80ff0de6bce4c68', '/dev/disk/by-id/scsi-26338306666306465') {{(pid=81266) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b14bd2-0c83-4e53-8075-d3fb4d4457fc]: (4, None) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3b5267-fcb0-4b07-b61c-53e7b1d78f58]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae93be39-9829-4bb1-8263-b6eb9b2ecaec]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785, portal: 172.16.0.220,3260]
Jul 24 16:55:08 user nova-compute[70243]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785, portal: 172.16.0.220,3260] successful.
Jul 24 16:55:08 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:55:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a59ae2-09fb-47be-8b07-f736a7622785 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b2ce97-d9a1-4a16-8e10-a5df67237dfd]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:55:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:55:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] <== disconnect_volume: return (302ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:55:09 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:55:09 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Deleting instance files /opt/stack/data/nova/instances/5543fd2b-5470-4508-a9ca-4f13c738532b_del
Jul 24 16:55:09 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Deletion of /opt/stack/data/nova/instances/5543fd2b-5470-4508-a9ca-4f13c738532b_del complete
Jul 24 16:55:09 user nova-compute[70243]: INFO nova.compute.manager [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Took 1.15 seconds to destroy the instance on the hypervisor.
Jul 24 16:55:09 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:55:09 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:55:09 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:55:09 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:55:09 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:55:09 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Took 0.51 seconds to deallocate network for instance.
Jul 24 16:55:10 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:55:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:55:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 16:55:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Skipping network cache update for instance because it is being deleted. {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9839}}
Jul 24 16:55:10 user nova-compute[70243]: INFO nova.compute.manager [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Took 0.72 seconds to detach 1 volumes for instance.
Jul 24 16:55:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Deleting volume: 12a59ae2-09fb-47be-8b07-f736a7622785 {{(pid=70243) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 24 16:55:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:55:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:55:10 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:55:10 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lazy-loading 'info_cache' on Instance uuid 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:55:10 user nova-compute[70243]: DEBUG nova.compute.manager [req-4bb4918b-64c0-45f9-a691-5ccf6e25f246 req-0495c174-76ff-4bc1-abdc-2e30f8d630a1 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Received event network-vif-plugged-951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:55:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4bb4918b-64c0-45f9-a691-5ccf6e25f246 req-0495c174-76ff-4bc1-abdc-2e30f8d630a1 service nova] Acquiring lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:55:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4bb4918b-64c0-45f9-a691-5ccf6e25f246 req-0495c174-76ff-4bc1-abdc-2e30f8d630a1 service nova] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:55:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-4bb4918b-64c0-45f9-a691-5ccf6e25f246 req-0495c174-76ff-4bc1-abdc-2e30f8d630a1 service nova] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:55:10 user nova-compute[70243]: DEBUG nova.compute.manager [req-4bb4918b-64c0-45f9-a691-5ccf6e25f246 req-0495c174-76ff-4bc1-abdc-2e30f8d630a1 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] No waiting events found dispatching network-vif-plugged-951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:55:10 user nova-compute[70243]: WARNING nova.compute.manager [req-4bb4918b-64c0-45f9-a691-5ccf6e25f246 req-0495c174-76ff-4bc1-abdc-2e30f8d630a1 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Received unexpected event network-vif-plugged-951ed9cf-5121-492f-b159-0b4932e771fb for instance with vm_state active and task_state deleting.
Jul 24 16:55:10 user nova-compute[70243]: DEBUG nova.compute.manager [req-4bb4918b-64c0-45f9-a691-5ccf6e25f246 req-0495c174-76ff-4bc1-abdc-2e30f8d630a1 service nova] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Received event network-vif-deleted-951ed9cf-5121-492f-b159-0b4932e771fb {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:55:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:55:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:55:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:10 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:55:10 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:55:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:55:10 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Deleted allocations for instance 5543fd2b-5470-4508-a9ca-4f13c738532b
Jul 24 16:55:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ac817e1c-c2fd-464d-b349-be4eb5611fef tempest-TestShelveInstance-2048728132 tempest-TestShelveInstance-2048728132-project-member] Lock "5543fd2b-5470-4508-a9ca-4f13c738532b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.812s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:55:10 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Updating instance_info_cache with network_info: [{"id": "8f320269-e11a-4735-b792-c845cca35f8d", "address": "fa:16:3e:7d:ac:88", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f320269-e1", "ovs_interfaceid": "8f320269-e11a-4735-b792-c845cca35f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:55:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:55:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:55:12 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:55:12 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:55:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:15 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:55:15 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:55:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Triggering sync for uuid 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 {{(pid=70243) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 16:55:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:55:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:55:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:55:16 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690217701.3267348, 100c6ba5-de96-4c2a-ae0c-9d3a9199948c => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:55:16 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] VM Stopped (Lifecycle Event)
Jul 24 16:55:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-6fd1ac77-f82d-41f8-ad29-545dbbd9110a None None] [instance: 100c6ba5-de96-4c2a-ae0c-9d3a9199948c] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:55:17 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:55:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:55:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:55:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:55:17 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:55:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:18 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:55:18 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:55:18 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8657MB free_disk=24.17870330810547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:55:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:55:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:55:18 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:55:18 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:55:18 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:55:18 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing inventories for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 16:55:18 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Updating ProviderTree inventory for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 16:55:18 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Updating inventory in ProviderTree for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 16:55:18 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing aggregate associations for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0, aggregates: None {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 16:55:18 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing trait associations for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0, traits: HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 16:55:18 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:55:18 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:55:18 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:55:18 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.441s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:55:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:55:19 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:55:19 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:55:23 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690217708.6629457, 5543fd2b-5470-4508-a9ca-4f13c738532b => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:55:23 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] VM Stopped (Lifecycle Event)
Jul 24 16:55:23 user nova-compute[70243]: DEBUG nova.compute.manager [None req-70d0f592-1a9b-4288-9eff-61ce639cb36b None None] [instance: 5543fd2b-5470-4508-a9ca-4f13c738532b] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:55:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:55:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:55:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:55:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:55:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:55:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:55:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:55:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:55:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:55:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:55:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG nova.compute.manager [req-21a20216-538c-475b-9d83-96ac9c5c595b req-5263707c-588b-46e5-a966-21417624c932 service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Received event network-changed-8f320269-e11a-4735-b792-c845cca35f8d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG nova.compute.manager [req-21a20216-538c-475b-9d83-96ac9c5c595b req-5263707c-588b-46e5-a966-21417624c932 service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Refreshing instance network info cache due to event network-changed-8f320269-e11a-4735-b792-c845cca35f8d. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-21a20216-538c-475b-9d83-96ac9c5c595b req-5263707c-588b-46e5-a966-21417624c932 service nova] Acquiring lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-21a20216-538c-475b-9d83-96ac9c5c595b req-5263707c-588b-46e5-a966-21417624c932 service nova] Acquired lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG nova.network.neutron [req-21a20216-538c-475b-9d83-96ac9c5c595b req-5263707c-588b-46e5-a966-21417624c932 service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Refreshing network info cache for port 8f320269-e11a-4735-b792-c845cca35f8d {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG nova.objects.instance [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lazy-loading 'flavor' on Instance uuid 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG nova.network.neutron [req-21a20216-538c-475b-9d83-96ac9c5c595b req-5263707c-588b-46e5-a966-21417624c932 service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Updated VIF entry in instance network info cache for port 8f320269-e11a-4735-b792-c845cca35f8d. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG nova.network.neutron [req-21a20216-538c-475b-9d83-96ac9c5c595b req-5263707c-588b-46e5-a966-21417624c932 service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Updating instance_info_cache with network_info: [{"id": "8f320269-e11a-4735-b792-c845cca35f8d", "address": "fa:16:3e:7d:ac:88", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f320269-e1", "ovs_interfaceid": "8f320269-e11a-4735-b792-c845cca35f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-21a20216-538c-475b-9d83-96ac9c5c595b req-5263707c-588b-46e5-a966-21417624c932 service nova] Releasing lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:55:46 user nova-compute[70243]: INFO nova.compute.manager [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Attaching volume f2380b14-dc5e-49df-975b-dee84b8a4d73 to /dev/vdb
Jul 24 16:55:46 user nova-compute[70243]: DEBUG os_brick.utils [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[af46e024-0157-4963-8243-b9f1a6c196b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6c5641-c17e-4120-8a8f-0f0d99aebee8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e83ef65-5888-432e-8816-ea2e5397037d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d3fe06-e15f-46d2-9d13-56d7c23a0371]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:55:46 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:47 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:55:47 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:55:47 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4721f02-638f-4a2d-8797-114dd4077821]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:55:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:55:47 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:55:47 user nova-compute[70243]: DEBUG os_brick.utils [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:55:47 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Updating existing volume attachment record: 803023f4-fd51-4724-86fe-99c1e60095f1 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:55:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:55:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlYvuBSR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:55:53 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:55:53 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:55:53 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[670a0ad2-b277-429d-b1c1-e8cf0e0b2f78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:55:53 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6013b205-7259-4570-a2b5-8b302ae80810]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73] added
Jul 24 16:55:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1c2559-8b85-484a-ba11-40a31d102501]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f3f620-f57e-4f2c-a644-47a4ea96a9b8]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dlYvuBSR {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dlYvuBSR" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45f5f2d-1c5c-497f-ba65-d64ac51d8ff8]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dlYvuBSR'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2dffce-d583-4558-a293-2c94cf263baa]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac20ee1-bd14-4eab-acac-806ab7bd5d91]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 16:55:53 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 16:55:53 user nova-compute[70243]:  {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:55:53 user nova-compute[70243]: WARNING os_brick.initiator.connectors.iscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 16:55:53 user nova-compute[70243]: 
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[756f9698-5c63-4f00-acad-a457375510aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73, portal: 172.16.0.220,3260]
Jul 24 16:55:53 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73, portal: 172.16.0.220,3260] successful.
Jul 24 16:55:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8798aa58-697a-443e-98b8-ce269068cfec]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6846b74a-9695-42a7-899a-8e17d3478bd4]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 (non-flash)
Jul 24 16:55:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 (non-flash)
Jul 24 16:55:53 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f14d8cb-d102-4700-b319-94599d61a93f]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlYvuBSR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:55:54 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23365626464663562', 'path': '/dev/sdb'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:55:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365626464663562', 'path': '/dev/sdb'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:55:54 user nova-compute[70243]: DEBUG nova.objects.instance [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lazy-loading 'flavor' on Instance uuid 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:55:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:55:54 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:55:54 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:55:54 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:55:54 user nova-compute[70243]:   <serial>f2380b14-dc5e-49df-975b-dee84b8a4d73</serial>
Jul 24 16:55:54 user nova-compute[70243]: </disk>
Jul 24 16:55:54 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:55:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:55:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:55:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] No VIF found with MAC fa:16:3e:7d:ac:88, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:55:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-28680b8b-739a-4f6a-be36-ed5811d96665 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.171s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:55:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:55:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:55:56 user nova-compute[70243]: INFO nova.compute.manager [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Detaching volume f2380b14-dc5e-49df-975b-dee84b8a4d73
Jul 24 16:55:57 user nova-compute[70243]: INFO nova.virt.block_device [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Attempting to driver detach volume f2380b14-dc5e-49df-975b-dee84b8a4d73 from mountpoint /dev/vdb
Jul 24 16:55:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Attempting to detach device vdb from instance 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:55:57 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:55:57 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:55:57 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:55:57 user nova-compute[70243]:   <serial>f2380b14-dc5e-49df-975b-dee84b8a4d73</serial>
Jul 24 16:55:57 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:55:57 user nova-compute[70243]: </disk>
Jul 24 16:55:57 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:55:57 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Successfully detached device vdb from instance 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 from the persistent domain config.
Jul 24 16:55:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:55:57 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:55:57 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:55:57 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:55:57 user nova-compute[70243]:   <serial>f2380b14-dc5e-49df-975b-dee84b8a4d73</serial>
Jul 24 16:55:57 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:55:57 user nova-compute[70243]: </disk>
Jul 24 16:55:57 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690217757.5118968, 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:55:57 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Successfully detached device vdb from instance 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 from the live domain config.
Jul 24 16:55:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlYvuBSR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:55:57 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:55:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[769c92ca-437d-44ac-924e-876c96792770]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:55:57 user nova-compute[70243]: No targets found.
Jul 24 16:55:57 user nova-compute[70243]: iSNS:
Jul 24 16:55:57 user nova-compute[70243]: No targets found.
Jul 24 16:55:57 user nova-compute[70243]: STATIC:
Jul 24 16:55:57 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73
Jul 24 16:55:57 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:55:57 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:55:57 user nova-compute[70243]: FIRMWARE:
Jul 24 16:55:57 user nova-compute[70243]: No targets found.
Jul 24 16:55:57 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:55:57 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:55:57 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d32b8c-b99b-4b0b-a9eb-cce5365cac34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[075a0c78-fd88-4db3-8eb7-d5e13c3ee0a4]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 (non-flash)
Jul 24 16:55:57 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 (non-flash)
Jul 24 16:55:57 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc4e28c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73'): ({'sdb'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Removing single pathed devices sdb {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[182469a4-e703-4b47-a889-f37793196e84]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b54904-b732-4f14-966c-4e9e30f221a5]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Flushing IO for device /dev/sdb {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[17971d4e-591f-46cb-8756-7681dd0b67b5]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc1f99d-fc1b-426c-913e-0e87797f13ec]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f8b04e-df56-49fc-bfa6-909cba7cb606]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b540c52-ec5f-4eab-b750-d00546355616]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73, portal: 172.16.0.220,3260]
Jul 24 16:55:57 user nova-compute[70243]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73, portal: 172.16.0.220,3260] successful.
Jul 24 16:55:57 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2380b14-dc5e-49df-975b-dee84b8a4d73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cb4533-08a8-44c6-9bbe-375f38c74ff0]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] <== disconnect_volume: return (287ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:55:57 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:55:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:55:58 user nova-compute[70243]: DEBUG nova.objects.instance [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lazy-loading 'flavor' on Instance uuid 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:55:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-899607a1-87d1-4ba5-a3f7-469ad33df5c6 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.694s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:55:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:06 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:56:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:10 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:56:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:11 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:56:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:12 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:56:12 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:56:12 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 16:56:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:56:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:56:12 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:56:12 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lazy-loading 'info_cache' on Instance uuid 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:56:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:13 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Updating instance_info_cache with network_info: [{"id": "8f320269-e11a-4735-b792-c845cca35f8d", "address": "fa:16:3e:7d:ac:88", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f320269-e1", "ovs_interfaceid": "8f320269-e11a-4735-b792-c845cca35f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:56:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:56:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:56:13 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:56:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:56:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:15 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:56:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:18 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:56:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:19 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:56:19 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:56:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:56:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:56:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:56:19 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:56:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:56:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:19 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:56:20 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:56:20 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:56:20 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8675MB free_disk=24.166996002197266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:56:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:56:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:56:20 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:56:20 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:56:20 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:56:20 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:56:20 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:56:20 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:56:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:56:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:21 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:56:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "46235453-4e72-4efa-a2e6-3f47c2254807" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:56:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "46235453-4e72-4efa-a2e6-3f47c2254807" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:56:32 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:56:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:56:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:56:32 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:56:32 user nova-compute[70243]: INFO nova.compute.claims [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Claim successful on node user
Jul 24 16:56:32 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:56:32 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:56:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:56:32 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:56:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:56:33 user nova-compute[70243]: DEBUG nova.network.neutron [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:56:33 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:56:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:56:33 user nova-compute[70243]: INFO nova.virt.block_device [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Booting with volume snapshot 07e18048-36a4-42bf-81f6-fe0c431a41c0 at /dev/vda
Jul 24 16:56:33 user nova-compute[70243]: DEBUG nova.policy [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f46574c91b549dda125d3d6874e26cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b57210106d441e96e821af15cb9469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:56:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:34 user nova-compute[70243]: DEBUG nova.network.neutron [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Successfully created port: bdbc7e7a-734a-4141-8126-49ab399ed8fd {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:56:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:35 user nova-compute[70243]: DEBUG nova.network.neutron [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Successfully updated port: bdbc7e7a-734a-4141-8126-49ab399ed8fd {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:56:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "refresh_cache-46235453-4e72-4efa-a2e6-3f47c2254807" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:56:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquired lock "refresh_cache-46235453-4e72-4efa-a2e6-3f47c2254807" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:56:35 user nova-compute[70243]: DEBUG nova.network.neutron [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:56:36 user nova-compute[70243]: DEBUG nova.network.neutron [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:56:36 user nova-compute[70243]: DEBUG nova.compute.manager [req-0c5b3b3d-1c85-4a70-9ad5-789f05efc6f5 req-bc609b8a-33fe-4a8a-889f-fb724d226e2d service nova] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Received event network-changed-bdbc7e7a-734a-4141-8126-49ab399ed8fd {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:56:36 user nova-compute[70243]: DEBUG nova.compute.manager [req-0c5b3b3d-1c85-4a70-9ad5-789f05efc6f5 req-bc609b8a-33fe-4a8a-889f-fb724d226e2d service nova] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Refreshing instance network info cache due to event network-changed-bdbc7e7a-734a-4141-8126-49ab399ed8fd. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:56:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0c5b3b3d-1c85-4a70-9ad5-789f05efc6f5 req-bc609b8a-33fe-4a8a-889f-fb724d226e2d service nova] Acquiring lock "refresh_cache-46235453-4e72-4efa-a2e6-3f47c2254807" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:56:36 user nova-compute[70243]: DEBUG nova.network.neutron [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Updating instance_info_cache with network_info: [{"id": "bdbc7e7a-734a-4141-8126-49ab399ed8fd", "address": "fa:16:3e:d6:e5:29", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc7e7a-73", "ovs_interfaceid": "bdbc7e7a-734a-4141-8126-49ab399ed8fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:56:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Releasing lock "refresh_cache-46235453-4e72-4efa-a2e6-3f47c2254807" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:56:36 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Instance network_info: |[{"id": "bdbc7e7a-734a-4141-8126-49ab399ed8fd", "address": "fa:16:3e:d6:e5:29", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc7e7a-73", "ovs_interfaceid": "bdbc7e7a-734a-4141-8126-49ab399ed8fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:56:36 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0c5b3b3d-1c85-4a70-9ad5-789f05efc6f5 req-bc609b8a-33fe-4a8a-889f-fb724d226e2d service nova] Acquired lock "refresh_cache-46235453-4e72-4efa-a2e6-3f47c2254807" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:56:36 user nova-compute[70243]: DEBUG nova.network.neutron [req-0c5b3b3d-1c85-4a70-9ad5-789f05efc6f5 req-bc609b8a-33fe-4a8a-889f-fb724d226e2d service nova] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Refreshing network info cache for port bdbc7e7a-734a-4141-8126-49ab399ed8fd {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:56:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:37 user nova-compute[70243]: DEBUG nova.network.neutron [req-0c5b3b3d-1c85-4a70-9ad5-789f05efc6f5 req-bc609b8a-33fe-4a8a-889f-fb724d226e2d service nova] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Updated VIF entry in instance network info cache for port bdbc7e7a-734a-4141-8126-49ab399ed8fd. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:56:37 user nova-compute[70243]: DEBUG nova.network.neutron [req-0c5b3b3d-1c85-4a70-9ad5-789f05efc6f5 req-bc609b8a-33fe-4a8a-889f-fb724d226e2d service nova] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Updating instance_info_cache with network_info: [{"id": "bdbc7e7a-734a-4141-8126-49ab399ed8fd", "address": "fa:16:3e:d6:e5:29", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc7e7a-73", "ovs_interfaceid": "bdbc7e7a-734a-4141-8126-49ab399ed8fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:56:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0c5b3b3d-1c85-4a70-9ad5-789f05efc6f5 req-bc609b8a-33fe-4a8a-889f-fb724d226e2d service nova] Releasing lock "refresh_cache-46235453-4e72-4efa-a2e6-3f47c2254807" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:56:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:38 user nova-compute[70243]: DEBUG os_brick.utils [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:56:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:56:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d505152-1228-440c-9710-6664468d7b91]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:56:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:56:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4e4bcc-e9df-48aa-8fd7-a1b761537b93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:56:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:56:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9d0189-0dfa-499d-ba6a-b92c8198f1a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:56:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[709a30e1-5115-4771-9c43-5479617ddce4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:56:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:56:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:56:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:56:38 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:56:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d20695-d2bc-4411-8a90-a5a8be287525]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:56:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:56:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:56:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:56:38 user nova-compute[70243]: DEBUG os_brick.utils [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:56:38 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Updating existing volume attachment record: ced4e74b-7962-431a-97c1-ca7f462c8302 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:56:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:56:45 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Creating image(s)
Jul 24 16:56:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Did not create local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Ensure instance console log exists: /opt/stack/data/nova/instances/46235453-4e72-4efa-a2e6-3f47c2254807/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Start _get_guest_xml network_info=[{"id": "bdbc7e7a-734a-4141-8126-49ab399ed8fd", "address": "fa:16:3e:d6:e5:29", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc7e7a-73", "ovs_interfaceid": "bdbc7e7a-734a-4141-8126-49ab399ed8fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mWhajHOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '46235453-4e72-4efa-a2e6-3f47c2254807', 'attached_at': '', 'detached_at': '', 'volume_id': '0701c13f-c1b5-486e-81b2-5198307b774d', 'serial': '0701c13f-c1b5-486e-81b2-5198307b774d'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'ced4e74b-7962-431a-97c1-ca7f462c8302', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:56:45 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:56:45 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:56:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mWhajHOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:56:45 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:56:45 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:56:45 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6560096-9ac0-421f-8b0c-3d9b7a74d4a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:56:45 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc18cbb-c489-4ad5-8fb6-6e5576e30be5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d] added
Jul 24 16:56:45 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8999e8-56ef-4e81-995d-d59332044568]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f56930-5f26-4310-b285-8140320b7729]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mWhajHOp {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mWhajHOp" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad0477b-1424-441a-87fe-dab95c4937c3]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mWhajHOp'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3a0649-7e77-468a-a17c-a6c90f93dac6]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3309b5-4ac8-42d6-958f-6d898278be20]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 16:56:45 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 16:56:45 user nova-compute[70243]:  {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:56:45 user nova-compute[70243]: WARNING os_brick.initiator.connectors.iscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 16:56:45 user nova-compute[70243]: 
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1ff642-0ee5-4d49-a22c-00462f910378]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d, portal: 172.16.0.220,3260]
Jul 24 16:56:45 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d, portal: 172.16.0.220,3260] successful.
Jul 24 16:56:45 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[598f11d9-0cfe-44f7-83bc-6af764f16a20]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[86198000-9078-4f76-9a16-b33e40d47380]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d (non-flash)
Jul 24 16:56:45 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d (non-flash)
Jul 24 16:56:45 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[271cc19d-f510-4e0f-ae5d-0b2ba52505c6]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mWhajHOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:56:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23332353031633661', 'path': '/dev/sdb'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332353031633661', 'path': '/dev/sdb'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:56:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-449738884',display_name='tempest-TestVolumeBootPattern-server-449738884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-449738884',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0b57210106d441e96e821af15cb9469',ramdisk_id='',reservation_id='r-akyjusol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-994857419',owner_user_name='tempest-TestVolumeBootPattern-994857419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:56:33Z,user_data=None,user_id='9f46574c91b549dda125d3d6874e26cc',uuid=46235453-4e72-4efa-a2e6-3f47c2254807,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdbc7e7a-734a-4141-8126-49ab399ed8fd", "address": "fa:16:3e:d6:e5:29", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc7e7a-73", "ovs_interfaceid": "bdbc7e7a-734a-4141-8126-49ab399ed8fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converting VIF {"id": "bdbc7e7a-734a-4141-8126-49ab399ed8fd", "address": "fa:16:3e:d6:e5:29", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc7e7a-73", "ovs_interfaceid": "bdbc7e7a-734a-4141-8126-49ab399ed8fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:e5:29,bridge_name='br-int',has_traffic_filtering=True,id=bdbc7e7a-734a-4141-8126-49ab399ed8fd,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdbc7e7a-73') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG nova.objects.instance [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lazy-loading 'pci_devices' on Instance uuid 46235453-4e72-4efa-a2e6-3f47c2254807 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:56:46 user nova-compute[70243]:   <uuid>46235453-4e72-4efa-a2e6-3f47c2254807</uuid>
Jul 24 16:56:46 user nova-compute[70243]:   <name>instance-0000002d</name>
Jul 24 16:56:46 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:56:46 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:56:46 user nova-compute[70243]:   <metadata>
Jul 24 16:56:46 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:56:46 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:56:46 user nova-compute[70243]:       <nova:name>tempest-TestVolumeBootPattern-server-449738884</nova:name>
Jul 24 16:56:46 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:56:45</nova:creationTime>
Jul 24 16:56:46 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:56:46 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:56:46 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:56:46 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:56:46 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:56:46 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:56:46 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:56:46 user nova-compute[70243]:       <nova:owner>
Jul 24 16:56:46 user nova-compute[70243]:         <nova:user uuid="9f46574c91b549dda125d3d6874e26cc">tempest-TestVolumeBootPattern-994857419-project-member</nova:user>
Jul 24 16:56:46 user nova-compute[70243]:         <nova:project uuid="a0b57210106d441e96e821af15cb9469">tempest-TestVolumeBootPattern-994857419</nova:project>
Jul 24 16:56:46 user nova-compute[70243]:       </nova:owner>
Jul 24 16:56:46 user nova-compute[70243]:       <nova:ports>
Jul 24 16:56:46 user nova-compute[70243]:         <nova:port uuid="bdbc7e7a-734a-4141-8126-49ab399ed8fd">
Jul 24 16:56:46 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 24 16:56:46 user nova-compute[70243]:         </nova:port>
Jul 24 16:56:46 user nova-compute[70243]:       </nova:ports>
Jul 24 16:56:46 user nova-compute[70243]:     </nova:instance>
Jul 24 16:56:46 user nova-compute[70243]:   </metadata>
Jul 24 16:56:46 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:56:46 user nova-compute[70243]:     <system>
Jul 24 16:56:46 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:56:46 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:56:46 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:56:46 user nova-compute[70243]:       <entry name="serial">46235453-4e72-4efa-a2e6-3f47c2254807</entry>
Jul 24 16:56:46 user nova-compute[70243]:       <entry name="uuid">46235453-4e72-4efa-a2e6-3f47c2254807</entry>
Jul 24 16:56:46 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:56:46 user nova-compute[70243]:     </system>
Jul 24 16:56:46 user nova-compute[70243]:   </sysinfo>
Jul 24 16:56:46 user nova-compute[70243]:   <os>
Jul 24 16:56:46 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:56:46 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:56:46 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:56:46 user nova-compute[70243]:   </os>
Jul 24 16:56:46 user nova-compute[70243]:   <features>
Jul 24 16:56:46 user nova-compute[70243]:     <acpi/>
Jul 24 16:56:46 user nova-compute[70243]:     <apic/>
Jul 24 16:56:46 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:56:46 user nova-compute[70243]:   </features>
Jul 24 16:56:46 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:56:46 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:56:46 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:56:46 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:56:46 user nova-compute[70243]:   </clock>
Jul 24 16:56:46 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:56:46 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:56:46 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:56:46 user nova-compute[70243]:   </cpu>
Jul 24 16:56:46 user nova-compute[70243]:   <devices>
Jul 24 16:56:46 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:56:46 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:56:46 user nova-compute[70243]:       <source dev="/dev/sdb"/>
Jul 24 16:56:46 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:56:46 user nova-compute[70243]:       <serial>0701c13f-c1b5-486e-81b2-5198307b774d</serial>
Jul 24 16:56:46 user nova-compute[70243]:     </disk>
Jul 24 16:56:46 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:56:46 user nova-compute[70243]:       <mac address="fa:16:3e:d6:e5:29"/>
Jul 24 16:56:46 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:56:46 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:56:46 user nova-compute[70243]:       <target dev="tapbdbc7e7a-73"/>
Jul 24 16:56:46 user nova-compute[70243]:     </interface>
Jul 24 16:56:46 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:56:46 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/46235453-4e72-4efa-a2e6-3f47c2254807/console.log" append="off"/>
Jul 24 16:56:46 user nova-compute[70243]:     </serial>
Jul 24 16:56:46 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:56:46 user nova-compute[70243]:     <video>
Jul 24 16:56:46 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:56:46 user nova-compute[70243]:     </video>
Jul 24 16:56:46 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:56:46 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:56:46 user nova-compute[70243]:     </rng>
Jul 24 16:56:46 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:56:46 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:56:46 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:56:46 user nova-compute[70243]:     </memballoon>
Jul 24 16:56:46 user nova-compute[70243]:   </devices>
Jul 24 16:56:46 user nova-compute[70243]: </domain>
Jul 24 16:56:46 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:56:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-449738884',display_name='tempest-TestVolumeBootPattern-server-449738884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-449738884',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0b57210106d441e96e821af15cb9469',ramdisk_id='',reservation_id='r-akyjusol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-994857419',owner_user_name='tempest-TestVolumeBootPattern-994857419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:56:33Z,user_data=None,user_id='9f46574c91b549dda125d3d6874e26cc',uuid=46235453-4e72-4efa-a2e6-3f47c2254807,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdbc7e7a-734a-4141-8126-49ab399ed8fd", "address": "fa:16:3e:d6:e5:29", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc7e7a-73", "ovs_interfaceid": "bdbc7e7a-734a-4141-8126-49ab399ed8fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converting VIF {"id": "bdbc7e7a-734a-4141-8126-49ab399ed8fd", "address": "fa:16:3e:d6:e5:29", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc7e7a-73", "ovs_interfaceid": "bdbc7e7a-734a-4141-8126-49ab399ed8fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:e5:29,bridge_name='br-int',has_traffic_filtering=True,id=bdbc7e7a-734a-4141-8126-49ab399ed8fd,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdbc7e7a-73') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG os_vif [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:e5:29,bridge_name='br-int',has_traffic_filtering=True,id=bdbc7e7a-734a-4141-8126-49ab399ed8fd,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdbc7e7a-73') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbdbc7e7a-73, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbdbc7e7a-73, col_values=(('external_ids', {'iface-id': 'bdbc7e7a-734a-4141-8126-49ab399ed8fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:e5:29', 'vm-uuid': '46235453-4e72-4efa-a2e6-3f47c2254807'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:46 user nova-compute[70243]: INFO os_vif [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:e5:29,bridge_name='br-int',has_traffic_filtering=True,id=bdbc7e7a-734a-4141-8126-49ab399ed8fd,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdbc7e7a-73')
Jul 24 16:56:46 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:56:46 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] No VIF found with MAC fa:16:3e:d6:e5:29, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:56:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:48 user nova-compute[70243]: DEBUG nova.compute.manager [req-168fea07-7bcf-4c38-9b12-6d6e320b6a78 req-5e230b7b-8c80-4341-ae11-b97d9c0d75e8 service nova] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Received event network-vif-plugged-bdbc7e7a-734a-4141-8126-49ab399ed8fd {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:56:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-168fea07-7bcf-4c38-9b12-6d6e320b6a78 req-5e230b7b-8c80-4341-ae11-b97d9c0d75e8 service nova] Acquiring lock "46235453-4e72-4efa-a2e6-3f47c2254807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:56:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-168fea07-7bcf-4c38-9b12-6d6e320b6a78 req-5e230b7b-8c80-4341-ae11-b97d9c0d75e8 service nova] Lock "46235453-4e72-4efa-a2e6-3f47c2254807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:56:48 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-168fea07-7bcf-4c38-9b12-6d6e320b6a78 req-5e230b7b-8c80-4341-ae11-b97d9c0d75e8 service nova] Lock "46235453-4e72-4efa-a2e6-3f47c2254807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:56:48 user nova-compute[70243]: DEBUG nova.compute.manager [req-168fea07-7bcf-4c38-9b12-6d6e320b6a78 req-5e230b7b-8c80-4341-ae11-b97d9c0d75e8 service nova] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] No waiting events found dispatching network-vif-plugged-bdbc7e7a-734a-4141-8126-49ab399ed8fd {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:56:48 user nova-compute[70243]: WARNING nova.compute.manager [req-168fea07-7bcf-4c38-9b12-6d6e320b6a78 req-5e230b7b-8c80-4341-ae11-b97d9c0d75e8 service nova] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Received unexpected event network-vif-plugged-bdbc7e7a-734a-4141-8126-49ab399ed8fd for instance with vm_state building and task_state spawning.
Jul 24 16:56:50 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217810.0271792, 46235453-4e72-4efa-a2e6-3f47c2254807 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:56:50 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] VM Resumed (Lifecycle Event)
Jul 24 16:56:50 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:56:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:56:50 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Instance spawned successfully.
Jul 24 16:56:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:56:50 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:56:50 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:56:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:56:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:56:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:56:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:56:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:56:50 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:56:50 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:56:50 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217810.0290432, 46235453-4e72-4efa-a2e6-3f47c2254807 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:56:50 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] VM Started (Lifecycle Event)
Jul 24 16:56:50 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:56:50 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:56:50 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:56:50 user nova-compute[70243]: INFO nova.compute.manager [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Took 4.98 seconds to spawn the instance on the hypervisor.
Jul 24 16:56:50 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:56:50 user nova-compute[70243]: INFO nova.compute.manager [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Took 17.56 seconds to build instance.
Jul 24 16:56:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-f1fda38b-954b-427a-8ee4-ce456cde1194 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "46235453-4e72-4efa-a2e6-3f47c2254807" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.655s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:56:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:50 user nova-compute[70243]: DEBUG nova.compute.manager [req-cd17d602-0ad6-487c-98b7-aef4b8ea5654 req-18dea8f8-dc98-45a5-a5fb-bdf5e91089a3 service nova] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Received event network-vif-plugged-bdbc7e7a-734a-4141-8126-49ab399ed8fd {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:56:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cd17d602-0ad6-487c-98b7-aef4b8ea5654 req-18dea8f8-dc98-45a5-a5fb-bdf5e91089a3 service nova] Acquiring lock "46235453-4e72-4efa-a2e6-3f47c2254807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:56:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cd17d602-0ad6-487c-98b7-aef4b8ea5654 req-18dea8f8-dc98-45a5-a5fb-bdf5e91089a3 service nova] Lock "46235453-4e72-4efa-a2e6-3f47c2254807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:56:50 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cd17d602-0ad6-487c-98b7-aef4b8ea5654 req-18dea8f8-dc98-45a5-a5fb-bdf5e91089a3 service nova] Lock "46235453-4e72-4efa-a2e6-3f47c2254807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:56:50 user nova-compute[70243]: DEBUG nova.compute.manager [req-cd17d602-0ad6-487c-98b7-aef4b8ea5654 req-18dea8f8-dc98-45a5-a5fb-bdf5e91089a3 service nova] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] No waiting events found dispatching network-vif-plugged-bdbc7e7a-734a-4141-8126-49ab399ed8fd {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:56:50 user nova-compute[70243]: WARNING nova.compute.manager [req-cd17d602-0ad6-487c-98b7-aef4b8ea5654 req-18dea8f8-dc98-45a5-a5fb-bdf5e91089a3 service nova] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Received unexpected event network-vif-plugged-bdbc7e7a-734a-4141-8126-49ab399ed8fd for instance with vm_state active and task_state None.
Jul 24 16:56:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:52 user nova-compute[70243]: DEBUG nova.compute.manager [None req-127581e1-d6a5-49cb-8bcc-15eebf6231bc tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:56:52 user nova-compute[70243]: INFO nova.compute.manager [None req-127581e1-d6a5-49cb-8bcc-15eebf6231bc tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] instance snapshotting
Jul 24 16:56:52 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-127581e1-d6a5-49cb-8bcc-15eebf6231bc tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Beginning live snapshot process
Jul 24 16:56:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-127581e1-d6a5-49cb-8bcc-15eebf6231bc tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json -f qcow2 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-127581e1-d6a5-49cb-8bcc-15eebf6231bc tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json -f qcow2" returned: 0 in 0.144s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:56:52 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-127581e1-d6a5-49cb-8bcc-15eebf6231bc tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json -f qcow2 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-127581e1-d6a5-49cb-8bcc-15eebf6231bc tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:56:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-127581e1-d6a5-49cb-8bcc-15eebf6231bc tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-127581e1-d6a5-49cb-8bcc-15eebf6231bc tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:56:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-127581e1-d6a5-49cb-8bcc-15eebf6231bc tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqj42wpbr/13aa522a602c411bb83eca563e05a779.delta 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:53 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-127581e1-d6a5-49cb-8bcc-15eebf6231bc tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e85f4d4d47c143c9c2ef3c6eb867a906516bd48d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqj42wpbr/13aa522a602c411bb83eca563e05a779.delta 1073741824" returned: 0 in 0.049s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:56:53 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-127581e1-d6a5-49cb-8bcc-15eebf6231bc tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 24 16:56:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-127581e1-d6a5-49cb-8bcc-15eebf6231bc tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:56:54 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-127581e1-d6a5-49cb-8bcc-15eebf6231bc tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=70243) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 24 16:56:54 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-127581e1-d6a5-49cb-8bcc-15eebf6231bc tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 24 16:56:54 user nova-compute[70243]: DEBUG nova.privsep.utils [None req-127581e1-d6a5-49cb-8bcc-15eebf6231bc tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70243) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 16:56:54 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-127581e1-d6a5-49cb-8bcc-15eebf6231bc tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqj42wpbr/13aa522a602c411bb83eca563e05a779.delta /opt/stack/data/nova/instances/snapshots/tmpqj42wpbr/13aa522a602c411bb83eca563e05a779 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:56:55 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-127581e1-d6a5-49cb-8bcc-15eebf6231bc tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqj42wpbr/13aa522a602c411bb83eca563e05a779.delta /opt/stack/data/nova/instances/snapshots/tmpqj42wpbr/13aa522a602c411bb83eca563e05a779" returned: 0 in 0.401s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:56:55 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-127581e1-d6a5-49cb-8bcc-15eebf6231bc tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Snapshot extracted, beginning image upload
Jul 24 16:56:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:56:57 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-127581e1-d6a5-49cb-8bcc-15eebf6231bc tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Snapshot image upload complete
Jul 24 16:56:57 user nova-compute[70243]: INFO nova.compute.manager [None req-127581e1-d6a5-49cb-8bcc-15eebf6231bc tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Took 4.74 seconds to snapshot the instance on the hypervisor.
Jul 24 16:57:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "575883e4-410d-4a42-9271-4adae89e36e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:57:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "575883e4-410d-4a42-9271-4adae89e36e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:57:03 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:57:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:57:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:57:03 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:57:03 user nova-compute[70243]: INFO nova.compute.claims [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Claim successful on node user
Jul 24 16:57:03 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:57:03 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:57:03 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.245s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:57:03 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:57:04 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:57:04 user nova-compute[70243]: DEBUG nova.network.neutron [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:57:04 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:57:04 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:57:04 user nova-compute[70243]: DEBUG nova.policy [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a4ab26ba5d94a8d89bb7b9403eda190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '640508f674d34751905b6a4d9625fb1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:57:04 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:57:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:57:04 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Creating image(s)
Jul 24 16:57:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "/opt/stack/data/nova/instances/575883e4-410d-4a42-9271-4adae89e36e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:57:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "/opt/stack/data/nova/instances/575883e4-410d-4a42-9271-4adae89e36e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:57:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "/opt/stack/data/nova/instances/575883e4-410d-4a42-9271-4adae89e36e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.058s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:57:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "c1e0d93f33183b50892a8ab6ce6692d1638ce8d0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:57:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "c1e0d93f33183b50892a8ab6ce6692d1638ce8d0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:57:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1e0d93f33183b50892a8ab6ce6692d1638ce8d0.part --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:57:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:05 user nova-compute[70243]: DEBUG nova.network.neutron [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Successfully created port: 2311739b-e5b5-4020-ad8f-95a3d56a50ca {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:57:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1e0d93f33183b50892a8ab6ce6692d1638ce8d0.part --force-share --output=json" returned: 0 in 0.148s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:57:05 user nova-compute[70243]: DEBUG nova.virt.images [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] e8e8bcf7-54a9-47ef-b8be-96edae72c063 was qcow2, converting to raw {{(pid=70243) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 24 16:57:05 user nova-compute[70243]: DEBUG nova.privsep.utils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=70243) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 24 16:57:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c1e0d93f33183b50892a8ab6ce6692d1638ce8d0.part /opt/stack/data/nova/instances/_base/c1e0d93f33183b50892a8ab6ce6692d1638ce8d0.converted {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:57:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c1e0d93f33183b50892a8ab6ce6692d1638ce8d0.part /opt/stack/data/nova/instances/_base/c1e0d93f33183b50892a8ab6ce6692d1638ce8d0.converted" returned: 0 in 0.392s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:57:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1e0d93f33183b50892a8ab6ce6692d1638ce8d0.converted --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:57:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1e0d93f33183b50892a8ab6ce6692d1638ce8d0.converted --force-share --output=json" returned: 0 in 0.144s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:57:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "c1e0d93f33183b50892a8ab6ce6692d1638ce8d0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.748s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:57:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1e0d93f33183b50892a8ab6ce6692d1638ce8d0 --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.network.neutron [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Successfully updated port: 2311739b-e5b5-4020-ad8f-95a3d56a50ca {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "refresh_cache-575883e4-410d-4a42-9271-4adae89e36e0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquired lock "refresh_cache-575883e4-410d-4a42-9271-4adae89e36e0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.network.neutron [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1e0d93f33183b50892a8ab6ce6692d1638ce8d0 --force-share --output=json" returned: 0 in 0.134s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "c1e0d93f33183b50892a8ab6ce6692d1638ce8d0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "c1e0d93f33183b50892a8ab6ce6692d1638ce8d0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1e0d93f33183b50892a8ab6ce6692d1638ce8d0 --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.compute.manager [req-c714f954-a794-4f58-9250-c963c32419c8 req-900c60c4-82cd-4e9b-a6ae-62a40c3241c9 service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Received event network-changed-2311739b-e5b5-4020-ad8f-95a3d56a50ca {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.compute.manager [req-c714f954-a794-4f58-9250-c963c32419c8 req-900c60c4-82cd-4e9b-a6ae-62a40c3241c9 service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Refreshing instance network info cache due to event network-changed-2311739b-e5b5-4020-ad8f-95a3d56a50ca. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c714f954-a794-4f58-9250-c963c32419c8 req-900c60c4-82cd-4e9b-a6ae-62a40c3241c9 service nova] Acquiring lock "refresh_cache-575883e4-410d-4a42-9271-4adae89e36e0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.network.neutron [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1e0d93f33183b50892a8ab6ce6692d1638ce8d0 --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1e0d93f33183b50892a8ab6ce6692d1638ce8d0,backing_fmt=raw /opt/stack/data/nova/instances/575883e4-410d-4a42-9271-4adae89e36e0/disk 1073741824 {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1e0d93f33183b50892a8ab6ce6692d1638ce8d0,backing_fmt=raw /opt/stack/data/nova/instances/575883e4-410d-4a42-9271-4adae89e36e0/disk 1073741824" returned: 0 in 0.053s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "c1e0d93f33183b50892a8ab6ce6692d1638ce8d0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1e0d93f33183b50892a8ab6ce6692d1638ce8d0 --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1e0d93f33183b50892a8ab6ce6692d1638ce8d0 --force-share --output=json" returned: 0 in 0.136s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.objects.instance [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lazy-loading 'migration_context' on Instance uuid 575883e4-410d-4a42-9271-4adae89e36e0 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Created local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Ensure instance console log exists: /opt/stack/data/nova/instances/575883e4-410d-4a42-9271-4adae89e36e0/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.network.neutron [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Updating instance_info_cache with network_info: [{"id": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "address": "fa:16:3e:d8:f3:b3", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2311739b-e5", "ovs_interfaceid": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Releasing lock "refresh_cache-575883e4-410d-4a42-9271-4adae89e36e0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Instance network_info: |[{"id": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "address": "fa:16:3e:d8:f3:b3", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2311739b-e5", "ovs_interfaceid": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c714f954-a794-4f58-9250-c963c32419c8 req-900c60c4-82cd-4e9b-a6ae-62a40c3241c9 service nova] Acquired lock "refresh_cache-575883e4-410d-4a42-9271-4adae89e36e0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.network.neutron [req-c714f954-a794-4f58-9250-c963c32419c8 req-900c60c4-82cd-4e9b-a6ae-62a40c3241c9 service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Refreshing network info cache for port 2311739b-e5b5-4020-ad8f-95a3d56a50ca {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Start _get_guest_xml network_info=[{"id": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "address": "fa:16:3e:d8:f3:b3", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2311739b-e5", "ovs_interfaceid": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='aef8e2e46b04916ddb9a1cb0e2c79832',container_format='bare',created_at=2023-07-24T16:56:52Z,direct_url=<?>,disk_format='qcow2',id=e8e8bcf7-54a9-47ef-b8be-96edae72c063,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-255231796',owner='640508f674d34751905b6a4d9625fb1f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-24T16:56:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'size': 0, 'image_id': 'e8e8bcf7-54a9-47ef-b8be-96edae72c063'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:06 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:57:06 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='aef8e2e46b04916ddb9a1cb0e2c79832',container_format='bare',created_at=2023-07-24T16:56:52Z,direct_url=<?>,disk_format='qcow2',id=e8e8bcf7-54a9-47ef-b8be-96edae72c063,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-255231796',owner='640508f674d34751905b6a4d9625fb1f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-24T16:56:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:57:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-811371073',display_name='tempest-TestStampPattern-server-811371073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-811371073',id=46,image_ref='e8e8bcf7-54a9-47ef-b8be-96edae72c063',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcjN6AXTahgDTIvI9HIaDQ+k/Dzge84NatzMa2EvJXvuccVx0gyZ59Q8J0iAC9E1btcc6mN455JjktsyIeZ/7vf3Iafpzgfuv6BK3oksbTrcO0UZlMN59+9iVCgGkzqiw==',key_name='tempest-TestStampPattern-1639173847',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='640508f674d34751905b6a4d9625fb1f',ramdisk_id='',reservation_id='r-zb70omum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4e1e09ef-9c6f-4032-8a90-6dfb2583df81',image_min_disk='1',image_min_ram='0',image_owner_id='640508f674d34751905b6a4d9625fb1f',image_owner_project_name='tempest-TestStampPattern-1363630507',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1363630507-project-member',image_user_id='4a4ab26ba5d94a8d89bb7b9403eda190',network_allocated='True',owner_project_name='tempest-TestStampPattern-1363630507',owner_user_name='tempest-TestStampPattern-1363630507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:57:04Z,user_data=None,user_id='4a4ab26ba5d94a8d89bb7b9403eda190',uuid=575883e4-410d-4a42-9271-4adae89e36e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "address": "fa:16:3e:d8:f3:b3", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2311739b-e5", "ovs_interfaceid": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Converting VIF {"id": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "address": "fa:16:3e:d8:f3:b3", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2311739b-e5", "ovs_interfaceid": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:f3:b3,bridge_name='br-int',has_traffic_filtering=True,id=2311739b-e5b5-4020-ad8f-95a3d56a50ca,network=Network(8ec80dde-9337-44d3-a3a7-c8b6e55e561f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2311739b-e5') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.objects.instance [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lazy-loading 'pci_devices' on Instance uuid 575883e4-410d-4a42-9271-4adae89e36e0 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:57:06 user nova-compute[70243]:   <uuid>575883e4-410d-4a42-9271-4adae89e36e0</uuid>
Jul 24 16:57:06 user nova-compute[70243]:   <name>instance-0000002e</name>
Jul 24 16:57:06 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:57:06 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:57:06 user nova-compute[70243]:   <metadata>
Jul 24 16:57:06 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:57:06 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:57:06 user nova-compute[70243]:       <nova:name>tempest-TestStampPattern-server-811371073</nova:name>
Jul 24 16:57:06 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:57:06</nova:creationTime>
Jul 24 16:57:06 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:57:06 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:57:06 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:57:06 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:57:06 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:57:06 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:57:06 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:57:06 user nova-compute[70243]:       <nova:owner>
Jul 24 16:57:06 user nova-compute[70243]:         <nova:user uuid="4a4ab26ba5d94a8d89bb7b9403eda190">tempest-TestStampPattern-1363630507-project-member</nova:user>
Jul 24 16:57:06 user nova-compute[70243]:         <nova:project uuid="640508f674d34751905b6a4d9625fb1f">tempest-TestStampPattern-1363630507</nova:project>
Jul 24 16:57:06 user nova-compute[70243]:       </nova:owner>
Jul 24 16:57:06 user nova-compute[70243]:       <nova:root type="image" uuid="e8e8bcf7-54a9-47ef-b8be-96edae72c063"/>
Jul 24 16:57:06 user nova-compute[70243]:       <nova:ports>
Jul 24 16:57:06 user nova-compute[70243]:         <nova:port uuid="2311739b-e5b5-4020-ad8f-95a3d56a50ca">
Jul 24 16:57:06 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 24 16:57:06 user nova-compute[70243]:         </nova:port>
Jul 24 16:57:06 user nova-compute[70243]:       </nova:ports>
Jul 24 16:57:06 user nova-compute[70243]:     </nova:instance>
Jul 24 16:57:06 user nova-compute[70243]:   </metadata>
Jul 24 16:57:06 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:57:06 user nova-compute[70243]:     <system>
Jul 24 16:57:06 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:57:06 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:57:06 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:57:06 user nova-compute[70243]:       <entry name="serial">575883e4-410d-4a42-9271-4adae89e36e0</entry>
Jul 24 16:57:06 user nova-compute[70243]:       <entry name="uuid">575883e4-410d-4a42-9271-4adae89e36e0</entry>
Jul 24 16:57:06 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:57:06 user nova-compute[70243]:     </system>
Jul 24 16:57:06 user nova-compute[70243]:   </sysinfo>
Jul 24 16:57:06 user nova-compute[70243]:   <os>
Jul 24 16:57:06 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:57:06 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:57:06 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:57:06 user nova-compute[70243]:   </os>
Jul 24 16:57:06 user nova-compute[70243]:   <features>
Jul 24 16:57:06 user nova-compute[70243]:     <acpi/>
Jul 24 16:57:06 user nova-compute[70243]:     <apic/>
Jul 24 16:57:06 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:57:06 user nova-compute[70243]:   </features>
Jul 24 16:57:06 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:57:06 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:57:06 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:57:06 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:57:06 user nova-compute[70243]:   </clock>
Jul 24 16:57:06 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:57:06 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:57:06 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:57:06 user nova-compute[70243]:   </cpu>
Jul 24 16:57:06 user nova-compute[70243]:   <devices>
Jul 24 16:57:06 user nova-compute[70243]:     <disk type="file" device="disk">
Jul 24 16:57:06 user nova-compute[70243]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 24 16:57:06 user nova-compute[70243]:       <source file="/opt/stack/data/nova/instances/575883e4-410d-4a42-9271-4adae89e36e0/disk"/>
Jul 24 16:57:06 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:57:06 user nova-compute[70243]:     </disk>
Jul 24 16:57:06 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:57:06 user nova-compute[70243]:       <mac address="fa:16:3e:d8:f3:b3"/>
Jul 24 16:57:06 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:57:06 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:57:06 user nova-compute[70243]:       <target dev="tap2311739b-e5"/>
Jul 24 16:57:06 user nova-compute[70243]:     </interface>
Jul 24 16:57:06 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:57:06 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/575883e4-410d-4a42-9271-4adae89e36e0/console.log" append="off"/>
Jul 24 16:57:06 user nova-compute[70243]:     </serial>
Jul 24 16:57:06 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:57:06 user nova-compute[70243]:     <video>
Jul 24 16:57:06 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:57:06 user nova-compute[70243]:     </video>
Jul 24 16:57:06 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:57:06 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:57:06 user nova-compute[70243]:     </rng>
Jul 24 16:57:06 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:57:06 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:57:06 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:57:06 user nova-compute[70243]:     </memballoon>
Jul 24 16:57:06 user nova-compute[70243]:   </devices>
Jul 24 16:57:06 user nova-compute[70243]: </domain>
Jul 24 16:57:06 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:57:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-811371073',display_name='tempest-TestStampPattern-server-811371073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-811371073',id=46,image_ref='e8e8bcf7-54a9-47ef-b8be-96edae72c063',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcjN6AXTahgDTIvI9HIaDQ+k/Dzge84NatzMa2EvJXvuccVx0gyZ59Q8J0iAC9E1btcc6mN455JjktsyIeZ/7vf3Iafpzgfuv6BK3oksbTrcO0UZlMN59+9iVCgGkzqiw==',key_name='tempest-TestStampPattern-1639173847',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='640508f674d34751905b6a4d9625fb1f',ramdisk_id='',reservation_id='r-zb70omum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4e1e09ef-9c6f-4032-8a90-6dfb2583df81',image_min_disk='1',image_min_ram='0',image_owner_id='640508f674d34751905b6a4d9625fb1f',image_owner_project_name='tempest-TestStampPattern-1363630507',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1363630507-project-member',image_user_id='4a4ab26ba5d94a8d89bb7b9403eda190',network_allocated='True',owner_project_name='tempest-TestStampPattern-1363630507',owner_user_name='tempest-TestStampPattern-1363630507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:57:04Z,user_data=None,user_id='4a4ab26ba5d94a8d89bb7b9403eda190',uuid=575883e4-410d-4a42-9271-4adae89e36e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "address": "fa:16:3e:d8:f3:b3", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2311739b-e5", "ovs_interfaceid": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Converting VIF {"id": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "address": "fa:16:3e:d8:f3:b3", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2311739b-e5", "ovs_interfaceid": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:f3:b3,bridge_name='br-int',has_traffic_filtering=True,id=2311739b-e5b5-4020-ad8f-95a3d56a50ca,network=Network(8ec80dde-9337-44d3-a3a7-c8b6e55e561f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2311739b-e5') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG os_vif [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:f3:b3,bridge_name='br-int',has_traffic_filtering=True,id=2311739b-e5b5-4020-ad8f-95a3d56a50ca,network=Network(8ec80dde-9337-44d3-a3a7-c8b6e55e561f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2311739b-e5') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2311739b-e5, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2311739b-e5, col_values=(('external_ids', {'iface-id': '2311739b-e5b5-4020-ad8f-95a3d56a50ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:f3:b3', 'vm-uuid': '575883e4-410d-4a42-9271-4adae89e36e0'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:06 user nova-compute[70243]: INFO os_vif [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:f3:b3,bridge_name='br-int',has_traffic_filtering=True,id=2311739b-e5b5-4020-ad8f-95a3d56a50ca,network=Network(8ec80dde-9337-44d3-a3a7-c8b6e55e561f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2311739b-e5')
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:57:06 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] No VIF found with MAC fa:16:3e:d8:f3:b3, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:57:07 user nova-compute[70243]: DEBUG nova.network.neutron [req-c714f954-a794-4f58-9250-c963c32419c8 req-900c60c4-82cd-4e9b-a6ae-62a40c3241c9 service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Updated VIF entry in instance network info cache for port 2311739b-e5b5-4020-ad8f-95a3d56a50ca. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:57:07 user nova-compute[70243]: DEBUG nova.network.neutron [req-c714f954-a794-4f58-9250-c963c32419c8 req-900c60c4-82cd-4e9b-a6ae-62a40c3241c9 service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Updating instance_info_cache with network_info: [{"id": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "address": "fa:16:3e:d8:f3:b3", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2311739b-e5", "ovs_interfaceid": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:57:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c714f954-a794-4f58-9250-c963c32419c8 req-900c60c4-82cd-4e9b-a6ae-62a40c3241c9 service nova] Releasing lock "refresh_cache-575883e4-410d-4a42-9271-4adae89e36e0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:57:07 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:57:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:08 user nova-compute[70243]: DEBUG nova.compute.manager [req-3d3101ab-f0d8-4126-8fd8-871fb17633eb req-5b70658e-5911-4594-8fc5-2f5dc856eca6 service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Received event network-vif-plugged-2311739b-e5b5-4020-ad8f-95a3d56a50ca {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:57:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3d3101ab-f0d8-4126-8fd8-871fb17633eb req-5b70658e-5911-4594-8fc5-2f5dc856eca6 service nova] Acquiring lock "575883e4-410d-4a42-9271-4adae89e36e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:57:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3d3101ab-f0d8-4126-8fd8-871fb17633eb req-5b70658e-5911-4594-8fc5-2f5dc856eca6 service nova] Lock "575883e4-410d-4a42-9271-4adae89e36e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:57:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-3d3101ab-f0d8-4126-8fd8-871fb17633eb req-5b70658e-5911-4594-8fc5-2f5dc856eca6 service nova] Lock "575883e4-410d-4a42-9271-4adae89e36e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:57:08 user nova-compute[70243]: DEBUG nova.compute.manager [req-3d3101ab-f0d8-4126-8fd8-871fb17633eb req-5b70658e-5911-4594-8fc5-2f5dc856eca6 service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] No waiting events found dispatching network-vif-plugged-2311739b-e5b5-4020-ad8f-95a3d56a50ca {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:57:08 user nova-compute[70243]: WARNING nova.compute.manager [req-3d3101ab-f0d8-4126-8fd8-871fb17633eb req-5b70658e-5911-4594-8fc5-2f5dc856eca6 service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Received unexpected event network-vif-plugged-2311739b-e5b5-4020-ad8f-95a3d56a50ca for instance with vm_state building and task_state spawning.
Jul 24 16:57:10 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217830.0388339, 575883e4-410d-4a42-9271-4adae89e36e0 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:57:10 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] VM Resumed (Lifecycle Event)
Jul 24 16:57:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:57:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:57:10 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Instance spawned successfully.
Jul 24 16:57:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:57:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:57:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:57:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:57:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:57:10 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:57:10 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217830.0418482, 575883e4-410d-4a42-9271-4adae89e36e0 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:57:10 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] VM Started (Lifecycle Event)
Jul 24 16:57:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:57:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:57:10 user nova-compute[70243]: INFO nova.compute.manager [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Took 5.97 seconds to spawn the instance on the hypervisor.
Jul 24 16:57:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:57:10 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:57:10 user nova-compute[70243]: INFO nova.compute.manager [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Took 6.52 seconds to build instance.
Jul 24 16:57:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-ba9b8358-2782-4f49-8181-600e465b1ad2 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "575883e4-410d-4a42-9271-4adae89e36e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.629s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:57:10 user nova-compute[70243]: DEBUG nova.compute.manager [req-a49da8f6-77a3-4e23-8b6f-e771dbd1d954 req-dfbcad61-79c4-47b8-b15d-2d4c25d09e06 service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Received event network-vif-plugged-2311739b-e5b5-4020-ad8f-95a3d56a50ca {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:57:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a49da8f6-77a3-4e23-8b6f-e771dbd1d954 req-dfbcad61-79c4-47b8-b15d-2d4c25d09e06 service nova] Acquiring lock "575883e4-410d-4a42-9271-4adae89e36e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:57:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a49da8f6-77a3-4e23-8b6f-e771dbd1d954 req-dfbcad61-79c4-47b8-b15d-2d4c25d09e06 service nova] Lock "575883e4-410d-4a42-9271-4adae89e36e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:57:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-a49da8f6-77a3-4e23-8b6f-e771dbd1d954 req-dfbcad61-79c4-47b8-b15d-2d4c25d09e06 service nova] Lock "575883e4-410d-4a42-9271-4adae89e36e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:57:10 user nova-compute[70243]: DEBUG nova.compute.manager [req-a49da8f6-77a3-4e23-8b6f-e771dbd1d954 req-dfbcad61-79c4-47b8-b15d-2d4c25d09e06 service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] No waiting events found dispatching network-vif-plugged-2311739b-e5b5-4020-ad8f-95a3d56a50ca {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:57:10 user nova-compute[70243]: WARNING nova.compute.manager [req-a49da8f6-77a3-4e23-8b6f-e771dbd1d954 req-dfbcad61-79c4-47b8-b15d-2d4c25d09e06 service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Received unexpected event network-vif-plugged-2311739b-e5b5-4020-ad8f-95a3d56a50ca for instance with vm_state active and task_state None.
Jul 24 16:57:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:11 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:57:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:12 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:57:14 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:57:14 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:57:14 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 16:57:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:57:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:57:14 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:57:14 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lazy-loading 'info_cache' on Instance uuid 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:57:14 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Updating instance_info_cache with network_info: [{"id": "8f320269-e11a-4735-b792-c845cca35f8d", "address": "fa:16:3e:7d:ac:88", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f320269-e1", "ovs_interfaceid": "8f320269-e11a-4735-b792-c845cca35f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:57:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:57:14 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:57:15 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:57:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:57:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:16 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:17 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:57:19 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:57:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:21 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:57:21 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:57:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:57:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:57:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:57:21 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:57:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:57:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:57:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:57:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:57:21 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:57:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/575883e4-410d-4a42-9271-4adae89e36e0/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:57:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/575883e4-410d-4a42-9271-4adae89e36e0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:57:21 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/575883e4-410d-4a42-9271-4adae89e36e0/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:57:22 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/575883e4-410d-4a42-9271-4adae89e36e0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:57:22 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:57:22 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:57:22 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8458MB free_disk=24.01854705810547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:57:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:57:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:57:22 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:57:22 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 46235453-4e72-4efa-a2e6-3f47c2254807 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:57:22 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 575883e4-410d-4a42-9271-4adae89e36e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:57:22 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:57:22 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:57:22 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:57:22 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:57:22 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:57:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:57:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:26 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:31 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:36 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:57:46 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:57:51 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:57:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:58:01 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:58:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:58:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:58:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:58:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:58:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:58:06 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:58:10 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:58:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:58:13 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:58:14 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:58:14 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:58:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-46235453-4e72-4efa-a2e6-3f47c2254807" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:58:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-46235453-4e72-4efa-a2e6-3f47c2254807" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:58:14 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:58:14 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Updating instance_info_cache with network_info: [{"id": "bdbc7e7a-734a-4141-8126-49ab399ed8fd", "address": "fa:16:3e:d6:e5:29", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc7e7a-73", "ovs_interfaceid": "bdbc7e7a-734a-4141-8126-49ab399ed8fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:58:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-46235453-4e72-4efa-a2e6-3f47c2254807" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:58:14 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:58:14 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:58:16 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:58:17 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:58:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:58:19 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:58:20 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:58:21 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:58:21 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:58:22 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:58:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:58:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:58:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:58:22 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:58:22 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:58:22 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:58:22 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:58:22 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:58:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 16:58:22 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/575883e4-410d-4a42-9271-4adae89e36e0/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:58:22 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/575883e4-410d-4a42-9271-4adae89e36e0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:58:22 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/575883e4-410d-4a42-9271-4adae89e36e0/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:58:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/575883e4-410d-4a42-9271-4adae89e36e0/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:58:23 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:58:23 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:58:23 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8569MB free_disk=24.016841888427734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:58:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:58:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:58:23 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:58:23 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 46235453-4e72-4efa-a2e6-3f47c2254807 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:58:23 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 575883e4-410d-4a42-9271-4adae89e36e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:58:23 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:58:23 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:58:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "46235453-4e72-4efa-a2e6-3f47c2254807" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:58:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "46235453-4e72-4efa-a2e6-3f47c2254807" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:58:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "46235453-4e72-4efa-a2e6-3f47c2254807-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:58:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "46235453-4e72-4efa-a2e6-3f47c2254807-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:58:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "46235453-4e72-4efa-a2e6-3f47c2254807-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:58:23 user nova-compute[70243]: INFO nova.compute.manager [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Terminating instance
Jul 24 16:58:23 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:58:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:58:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:58:23 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:58:23 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:58:23 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:58:23 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:58:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:58:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-98947737-fb0a-48d3-8830-ecc1f79d6bf8 req-6ba8e452-3460-4e05-ab8f-07187b67994a service nova] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Received event network-vif-unplugged-bdbc7e7a-734a-4141-8126-49ab399ed8fd {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-98947737-fb0a-48d3-8830-ecc1f79d6bf8 req-6ba8e452-3460-4e05-ab8f-07187b67994a service nova] Acquiring lock "46235453-4e72-4efa-a2e6-3f47c2254807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-98947737-fb0a-48d3-8830-ecc1f79d6bf8 req-6ba8e452-3460-4e05-ab8f-07187b67994a service nova] Lock "46235453-4e72-4efa-a2e6-3f47c2254807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-98947737-fb0a-48d3-8830-ecc1f79d6bf8 req-6ba8e452-3460-4e05-ab8f-07187b67994a service nova] Lock "46235453-4e72-4efa-a2e6-3f47c2254807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-98947737-fb0a-48d3-8830-ecc1f79d6bf8 req-6ba8e452-3460-4e05-ab8f-07187b67994a service nova] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] No waiting events found dispatching network-vif-unplugged-bdbc7e7a-734a-4141-8126-49ab399ed8fd {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-98947737-fb0a-48d3-8830-ecc1f79d6bf8 req-6ba8e452-3460-4e05-ab8f-07187b67994a service nova] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Received event network-vif-unplugged-bdbc7e7a-734a-4141-8126-49ab399ed8fd for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:58:24 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Instance destroyed successfully.
Jul 24 16:58:24 user nova-compute[70243]: DEBUG nova.objects.instance [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lazy-loading 'resources' on Instance uuid 46235453-4e72-4efa-a2e6-3f47c2254807 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:56:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-449738884',display_name='tempest-TestVolumeBootPattern-server-449738884',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-449738884',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:56:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0b57210106d441e96e821af15cb9469',ramdisk_id='',reservation_id='r-akyjusol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-994857419',owner_user_name='tempest-TestVolumeBootPattern-994857419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:56:50Z,user_data=None,user_id='9f46574c91b549dda125d3d6874e26cc',uuid=46235453-4e72-4efa-a2e6-3f47c2254807,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdbc7e7a-734a-4141-8126-49ab399ed8fd", "address": "fa:16:3e:d6:e5:29", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc7e7a-73", "ovs_interfaceid": "bdbc7e7a-734a-4141-8126-49ab399ed8fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converting VIF {"id": "bdbc7e7a-734a-4141-8126-49ab399ed8fd", "address": "fa:16:3e:d6:e5:29", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdbc7e7a-73", "ovs_interfaceid": "bdbc7e7a-734a-4141-8126-49ab399ed8fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:e5:29,bridge_name='br-int',has_traffic_filtering=True,id=bdbc7e7a-734a-4141-8126-49ab399ed8fd,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdbc7e7a-73') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG os_vif [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:e5:29,bridge_name='br-int',has_traffic_filtering=True,id=bdbc7e7a-734a-4141-8126-49ab399ed8fd,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdbc7e7a-73') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbdbc7e7a-73, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:58:24 user nova-compute[70243]: INFO os_vif [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:e5:29,bridge_name='br-int',has_traffic_filtering=True,id=bdbc7e7a-734a-4141-8126-49ab399ed8fd,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdbc7e7a-73')
Jul 24 16:58:24 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mWhajHOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:58:24 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:58:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2b91cc-aee5-4af0-8585-db858e214736]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:58:24 user nova-compute[70243]: No targets found.
Jul 24 16:58:24 user nova-compute[70243]: iSNS:
Jul 24 16:58:24 user nova-compute[70243]: No targets found.
Jul 24 16:58:24 user nova-compute[70243]: STATIC:
Jul 24 16:58:24 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d
Jul 24 16:58:24 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:58:24 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:58:24 user nova-compute[70243]: FIRMWARE:
Jul 24 16:58:24 user nova-compute[70243]: No targets found.
Jul 24 16:58:24 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:58:24 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:58:24 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde3f8e8-1845-4727-a931-4472a16113b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04106cd-1be9-4827-959f-8e1e1827d747]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d (non-flash)
Jul 24 16:58:24 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d (non-flash)
Jul 24 16:58:24 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc6104c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d'): ({'sdb'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Removing single pathed devices sdb {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[122c75e9-0aa8-4b69-b83f-a5e9c96bc8d4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[355b85a2-c7a2-40e5-ae27-817a98569783]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Flushing IO for device /dev/sdb {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd67964-ba36-4fcb-997a-ed7e8e1d019b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea7858f-3e8f-421e-9829-23c715c5f3eb]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO9a94fbd0-32501c6abd5423f0', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9a94fbd0', '/dev/disk/by-id/scsi-23332353031633661') {{(pid=81266) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28dd7aa-6454-48d7-a687-650588b40e65]: (4, None) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d56b33-9e2a-42ae-b5c7-174e8e2aa3d2]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce911248-d7dd-4be0-b02c-097e8e4d238d]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d, portal: 172.16.0.220,3260]
Jul 24 16:58:24 user nova-compute[70243]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d, portal: 172.16.0.220,3260] successful.
Jul 24 16:58:24 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701c13f-c1b5-486e-81b2-5198307b774d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a391415d-a861-4c55-8348-7db277864b69]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] <== disconnect_volume: return (304ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:58:24 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Deleting instance files /opt/stack/data/nova/instances/46235453-4e72-4efa-a2e6-3f47c2254807_del
Jul 24 16:58:24 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Deletion of /opt/stack/data/nova/instances/46235453-4e72-4efa-a2e6-3f47c2254807_del complete
Jul 24 16:58:24 user nova-compute[70243]: INFO nova.compute.manager [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Took 1.17 seconds to destroy the instance on the hypervisor.
Jul 24 16:58:24 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:58:24 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:58:25 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:58:25 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Took 0.51 seconds to deallocate network for instance.
Jul 24 16:58:25 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:58:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-6bd8e65a-910d-4ff5-baa7-b6169749dc2d req-f4cdef71-f0c8-4323-8b08-bf6663489037 service nova] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Received event network-vif-plugged-bdbc7e7a-734a-4141-8126-49ab399ed8fd {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:58:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6bd8e65a-910d-4ff5-baa7-b6169749dc2d req-f4cdef71-f0c8-4323-8b08-bf6663489037 service nova] Acquiring lock "46235453-4e72-4efa-a2e6-3f47c2254807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:58:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6bd8e65a-910d-4ff5-baa7-b6169749dc2d req-f4cdef71-f0c8-4323-8b08-bf6663489037 service nova] Lock "46235453-4e72-4efa-a2e6-3f47c2254807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:58:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6bd8e65a-910d-4ff5-baa7-b6169749dc2d req-f4cdef71-f0c8-4323-8b08-bf6663489037 service nova] Lock "46235453-4e72-4efa-a2e6-3f47c2254807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:58:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-6bd8e65a-910d-4ff5-baa7-b6169749dc2d req-f4cdef71-f0c8-4323-8b08-bf6663489037 service nova] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] No waiting events found dispatching network-vif-plugged-bdbc7e7a-734a-4141-8126-49ab399ed8fd {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:58:26 user nova-compute[70243]: WARNING nova.compute.manager [req-6bd8e65a-910d-4ff5-baa7-b6169749dc2d req-f4cdef71-f0c8-4323-8b08-bf6663489037 service nova] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Received unexpected event network-vif-plugged-bdbc7e7a-734a-4141-8126-49ab399ed8fd for instance with vm_state active and task_state deleting.
Jul 24 16:58:26 user nova-compute[70243]: DEBUG nova.compute.manager [req-6bd8e65a-910d-4ff5-baa7-b6169749dc2d req-f4cdef71-f0c8-4323-8b08-bf6663489037 service nova] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Received event network-vif-deleted-bdbc7e7a-734a-4141-8126-49ab399ed8fd {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:58:26 user nova-compute[70243]: INFO nova.compute.manager [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Took 0.84 seconds to detach 1 volumes for instance.
Jul 24 16:58:26 user nova-compute[70243]: DEBUG nova.compute.manager [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Deleting volume: 0701c13f-c1b5-486e-81b2-5198307b774d {{(pid=70243) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 24 16:58:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:58:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:58:26 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:58:26 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:58:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:58:26 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Deleted allocations for instance 46235453-4e72-4efa-a2e6-3f47c2254807
Jul 24 16:58:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-d506f3d8-4d25-4cae-b89b-eae920bd44db tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "46235453-4e72-4efa-a2e6-3f47c2254807" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.915s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:58:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:58:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:58:39 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690217904.4344394, 46235453-4e72-4efa-a2e6-3f47c2254807 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:58:39 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] VM Stopped (Lifecycle Event)
Jul 24 16:58:39 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c980bfe2-c9e1-4a0c-b4a4-53c7abcce5c8 None None] [instance: 46235453-4e72-4efa-a2e6-3f47c2254807] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:58:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:58:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:58:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:58:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:58:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:58:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:58:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:58:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:58:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:58:55 user nova-compute[70243]: DEBUG nova.compute.manager [req-d2b336fd-ce13-4bc3-8bd9-81215d43cec8 req-bd84d791-3b81-41e4-9df9-c652b285d351 service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Received event network-changed-2311739b-e5b5-4020-ad8f-95a3d56a50ca {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:58:55 user nova-compute[70243]: DEBUG nova.compute.manager [req-d2b336fd-ce13-4bc3-8bd9-81215d43cec8 req-bd84d791-3b81-41e4-9df9-c652b285d351 service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Refreshing instance network info cache due to event network-changed-2311739b-e5b5-4020-ad8f-95a3d56a50ca. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:58:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d2b336fd-ce13-4bc3-8bd9-81215d43cec8 req-bd84d791-3b81-41e4-9df9-c652b285d351 service nova] Acquiring lock "refresh_cache-575883e4-410d-4a42-9271-4adae89e36e0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:58:55 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d2b336fd-ce13-4bc3-8bd9-81215d43cec8 req-bd84d791-3b81-41e4-9df9-c652b285d351 service nova] Acquired lock "refresh_cache-575883e4-410d-4a42-9271-4adae89e36e0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:58:55 user nova-compute[70243]: DEBUG nova.network.neutron [req-d2b336fd-ce13-4bc3-8bd9-81215d43cec8 req-bd84d791-3b81-41e4-9df9-c652b285d351 service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Refreshing network info cache for port 2311739b-e5b5-4020-ad8f-95a3d56a50ca {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:58:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "575883e4-410d-4a42-9271-4adae89e36e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:58:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "575883e4-410d-4a42-9271-4adae89e36e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:58:56 user nova-compute[70243]: DEBUG nova.objects.instance [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lazy-loading 'flavor' on Instance uuid 575883e4-410d-4a42-9271-4adae89e36e0 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:58:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "575883e4-410d-4a42-9271-4adae89e36e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:58:56 user nova-compute[70243]: DEBUG nova.network.neutron [req-d2b336fd-ce13-4bc3-8bd9-81215d43cec8 req-bd84d791-3b81-41e4-9df9-c652b285d351 service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Updated VIF entry in instance network info cache for port 2311739b-e5b5-4020-ad8f-95a3d56a50ca. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:58:56 user nova-compute[70243]: DEBUG nova.network.neutron [req-d2b336fd-ce13-4bc3-8bd9-81215d43cec8 req-bd84d791-3b81-41e4-9df9-c652b285d351 service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Updating instance_info_cache with network_info: [{"id": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "address": "fa:16:3e:d8:f3:b3", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2311739b-e5", "ovs_interfaceid": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:58:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d2b336fd-ce13-4bc3-8bd9-81215d43cec8 req-bd84d791-3b81-41e4-9df9-c652b285d351 service nova] Releasing lock "refresh_cache-575883e4-410d-4a42-9271-4adae89e36e0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:58:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "575883e4-410d-4a42-9271-4adae89e36e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:58:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "575883e4-410d-4a42-9271-4adae89e36e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:58:57 user nova-compute[70243]: INFO nova.compute.manager [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Attaching volume 04d2a14c-75fb-49f2-9e24-fa5bca84477c to /dev/vdb
Jul 24 16:58:57 user nova-compute[70243]: DEBUG os_brick.utils [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:58:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:58:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:58:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b696f7f-e3e5-45c2-a34c-af6524afcf6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:58:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:58:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:58:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93c84e9-a972-46f6-8a02-114693a1f47e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:58:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:58:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:58:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e20c5ff-d20e-4574-b140-66bf5649bc4b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:58:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[10234909-a488-4d7a-83e4-c8ff81c28a2a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:58:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:58:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:58:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:58:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:58:57 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:58:57 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:58:57 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[372f7095-6881-40af-a4da-99ae0019c1a0]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:58:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:58:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:58:57 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:58:57 user nova-compute[70243]: DEBUG os_brick.utils [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:58:57 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Updating existing volume attachment record: af23f0f7-6e03-412d-a7d9-ded15e2e79cc {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:58:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:59:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VLOsxfrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:59:03 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:59:03 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:59:03 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5089c0c7-496e-4cb1-af3e-ec0e5f5a3c71]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:59:03 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1a07cd-21f9-4b76-ab3b-c1e0fa98820c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c] added
Jul 24 16:59:03 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[75992a89-d9bc-4ecd-bb08-84298a58ccfa]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[db01007e-9aab-458c-a7b5-ac86ab85bb54]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VLOsxfrk {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VLOsxfrk" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90adf5d-34f3-48c6-b1ec-6017be15d59b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VLOsxfrk'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dec6d2-7fd5-4aa6-a3eb-26ceea459a95]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35b4503-d884-4c07-b1fe-9353245c2621]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 16:59:03 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 16:59:03 user nova-compute[70243]:  {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:59:03 user nova-compute[70243]: WARNING os_brick.initiator.connectors.iscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 16:59:03 user nova-compute[70243]: 
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e62814-0fcc-40fd-9db5-0060a0084f81]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c, portal: 172.16.0.220,3260]
Jul 24 16:59:03 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c, portal: 172.16.0.220,3260] successful.
Jul 24 16:59:03 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a402c4-046e-4707-9864-f3f64dfd8c5b]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5b2773-7b38-4009-b5d9-9c2a75edb688]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c (non-flash)
Jul 24 16:59:03 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c (non-flash)
Jul 24 16:59:03 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ba6610-cb53-447d-899d-4725cedb6c8c]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:59:03 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VLOsxfrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:59:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:59:04 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26433313762383038', 'path': '/dev/sdb'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:59:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433313762383038', 'path': '/dev/sdb'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:59:04 user nova-compute[70243]: DEBUG nova.objects.instance [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lazy-loading 'flavor' on Instance uuid 575883e4-410d-4a42-9271-4adae89e36e0 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:59:04 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] attach device xml: <disk type="block" device="disk">
Jul 24 16:59:04 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:59:04 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:59:04 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:59:04 user nova-compute[70243]:   <serial>04d2a14c-75fb-49f2-9e24-fa5bca84477c</serial>
Jul 24 16:59:04 user nova-compute[70243]: </disk>
Jul 24 16:59:04 user nova-compute[70243]:  {{(pid=70243) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 24 16:59:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:59:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] No BDM found with device name vdb, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:59:05 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] No VIF found with MAC fa:16:3e:d8:f3:b3, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:59:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-8066123d-0764-47e9-9ad2-5467cb3beec0 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "575883e4-410d-4a42-9271-4adae89e36e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.063s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:59:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "575883e4-410d-4a42-9271-4adae89e36e0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:59:06 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "575883e4-410d-4a42-9271-4adae89e36e0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:59:06 user nova-compute[70243]: INFO nova.compute.manager [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Detaching volume 04d2a14c-75fb-49f2-9e24-fa5bca84477c
Jul 24 16:59:06 user nova-compute[70243]: INFO nova.virt.block_device [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Attempting to driver detach volume 04d2a14c-75fb-49f2-9e24-fa5bca84477c from mountpoint /dev/vdb
Jul 24 16:59:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Attempting to detach device vdb from instance 575883e4-410d-4a42-9271-4adae89e36e0 from the persistent domain config. {{(pid=70243) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:59:07 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:59:07 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:59:07 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:59:07 user nova-compute[70243]:   <serial>04d2a14c-75fb-49f2-9e24-fa5bca84477c</serial>
Jul 24 16:59:07 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:59:07 user nova-compute[70243]: </disk>
Jul 24 16:59:07 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:59:07 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Successfully detached device vdb from instance 575883e4-410d-4a42-9271-4adae89e36e0 from the persistent domain config.
Jul 24 16:59:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 575883e4-410d-4a42-9271-4adae89e36e0 from the live domain config. {{(pid=70243) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.guest [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] detach device xml: <disk type="block" device="disk">
Jul 24 16:59:07 user nova-compute[70243]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:59:07 user nova-compute[70243]:   <source dev="/dev/sdb"/>
Jul 24 16:59:07 user nova-compute[70243]:   <target dev="vdb" bus="virtio"/>
Jul 24 16:59:07 user nova-compute[70243]:   <serial>04d2a14c-75fb-49f2-9e24-fa5bca84477c</serial>
Jul 24 16:59:07 user nova-compute[70243]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 24 16:59:07 user nova-compute[70243]: </disk>
Jul 24 16:59:07 user nova-compute[70243]:  {{(pid=70243) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Received event <DeviceRemovedEvent: 1690217947.4472601, 575883e4-410d-4a42-9271-4adae89e36e0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=70243) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 575883e4-410d-4a42-9271-4adae89e36e0 {{(pid=70243) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 24 16:59:07 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Successfully detached device vdb from instance 575883e4-410d-4a42-9271-4adae89e36e0 from the live domain config.
Jul 24 16:59:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VLOsxfrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:59:07 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:59:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[951d190c-dd74-4378-8d83-c20fdc44f4db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 16:59:07 user nova-compute[70243]: No targets found.
Jul 24 16:59:07 user nova-compute[70243]: iSNS:
Jul 24 16:59:07 user nova-compute[70243]: No targets found.
Jul 24 16:59:07 user nova-compute[70243]: STATIC:
Jul 24 16:59:07 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c
Jul 24 16:59:07 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 16:59:07 user nova-compute[70243]:                 Iface Name: default
Jul 24 16:59:07 user nova-compute[70243]: FIRMWARE:
Jul 24 16:59:07 user nova-compute[70243]: No targets found.
Jul 24 16:59:07 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 16:59:07 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 16:59:07 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea8ae9e-a4ec-41f3-a54d-9832c22f05c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c4bc50-679d-4595-8b18-3e5c401ed94f]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c (non-flash)
Jul 24 16:59:07 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c (non-flash)
Jul 24 16:59:07 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc4e36d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c'): ({'sdb'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Removing single pathed devices sdb {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ae6482-71cb-4791-95a0-4bd5f9f585a6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f843b0-e8f9-41a9-bf23-270b2b40f21d]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Flushing IO for device /dev/sdb {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[02421473-fec7-4011-aae2-56aea02b7433]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5b25d1-acaf-4e11-8fe8-3e15114f8732]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c28f60-544f-4903-926f-673c9fa53515]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a65fd0-1836-4706-8b05-d92ccbdf2764]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c, portal: 172.16.0.220,3260]
Jul 24 16:59:07 user nova-compute[70243]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c, portal: 172.16.0.220,3260] successful.
Jul 24 16:59:07 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04d2a14c-75fb-49f2-9e24-fa5bca84477c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4c6bcf-c897-4c52-a5a3-42557c0f5c51]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] <== disconnect_volume: return (296ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:59:07 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 16:59:08 user nova-compute[70243]: DEBUG nova.objects.instance [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lazy-loading 'flavor' on Instance uuid 575883e4-410d-4a42-9271-4adae89e36e0 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:59:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-de12385c-9c24-4ad6-9de1-61e3a5bd9aea tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "575883e4-410d-4a42-9271-4adae89e36e0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.581s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:59:09 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:59:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:13 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:59:14 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:59:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:15 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:59:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 16:59:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-575883e4-410d-4a42-9271-4adae89e36e0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:59:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-575883e4-410d-4a42-9271-4adae89e36e0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:59:15 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 16:59:15 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Updating instance_info_cache with network_info: [{"id": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "address": "fa:16:3e:d8:f3:b3", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2311739b-e5", "ovs_interfaceid": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:59:15 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-575883e4-410d-4a42-9271-4adae89e36e0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:59:15 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 16:59:18 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:59:18 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 16:59:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:59:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 16:59:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:59:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 16:59:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:20 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:59:20 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:59:20 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:59:22 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:59:24 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:59:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:59:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:59:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:59:24 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 16:59:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/575883e4-410d-4a42-9271-4adae89e36e0/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/575883e4-410d-4a42-9271-4adae89e36e0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:24 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/575883e4-410d-4a42-9271-4adae89e36e0/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:25 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/575883e4-410d-4a42-9271-4adae89e36e0/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:25 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:59:25 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:59:25 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8653MB free_disk=24.007286071777344GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 16:59:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:59:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:59:25 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:59:25 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 575883e4-410d-4a42-9271-4adae89e36e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 16:59:25 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 16:59:25 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 16:59:25 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:59:25 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:59:25 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 16:59:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:59:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:28 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:59:28 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70243) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 16:59:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "4ea416d1-fe78-41cd-9e03-e77d898151d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "4ea416d1-fe78-41cd-9e03-e77d898151d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 16:59:31 user nova-compute[70243]: INFO nova.compute.claims [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Claim successful on node user
Jul 24 16:59:31 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG nova.network.neutron [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 16:59:31 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 16:59:31 user nova-compute[70243]: DEBUG nova.compute.manager [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 16:59:31 user nova-compute[70243]: INFO nova.virt.block_device [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Booting with volume 113e5e69-7001-42c5-b86a-fcee55a4a0a9 at /dev/vda
Jul 24 16:59:31 user nova-compute[70243]: DEBUG nova.policy [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f46574c91b549dda125d3d6874e26cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b57210106d441e96e821af15cb9469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG os_brick.utils [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a0bfcb-8dba-42ee-ad8c-0cfcda2e9f16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[57294523-f145-4721-ae42-980ca0a2c2ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a89ed55-fc79-4bbb-8880-8dada448f9ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c849a6-b027-46ec-9fc7-d27958b16ee3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 16:59:31 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 16:59:31 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7931d99-5480-45c7-a3ad-cb7b1c90a6ae]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG os_brick.utils [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:59:31 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Updating existing volume attachment record: f428d917-1565-4daf-8c45-5a0d699ba4a2 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 16:59:32 user nova-compute[70243]: DEBUG nova.network.neutron [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Successfully created port: 0c381671-6073-4a8e-98df-9574aff888d0 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 16:59:33 user nova-compute[70243]: DEBUG nova.network.neutron [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Successfully updated port: 0c381671-6073-4a8e-98df-9574aff888d0 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 16:59:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "refresh_cache-4ea416d1-fe78-41cd-9e03-e77d898151d0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:59:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquired lock "refresh_cache-4ea416d1-fe78-41cd-9e03-e77d898151d0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:59:33 user nova-compute[70243]: DEBUG nova.network.neutron [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 16:59:33 user nova-compute[70243]: DEBUG nova.compute.manager [req-1507eba9-24f5-43be-9da0-0eb86e9da679 req-8a25bcad-b5d0-4dcc-8ff3-f8189f26710d service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Received event network-changed-0c381671-6073-4a8e-98df-9574aff888d0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:59:33 user nova-compute[70243]: DEBUG nova.compute.manager [req-1507eba9-24f5-43be-9da0-0eb86e9da679 req-8a25bcad-b5d0-4dcc-8ff3-f8189f26710d service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Refreshing instance network info cache due to event network-changed-0c381671-6073-4a8e-98df-9574aff888d0. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:59:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1507eba9-24f5-43be-9da0-0eb86e9da679 req-8a25bcad-b5d0-4dcc-8ff3-f8189f26710d service nova] Acquiring lock "refresh_cache-4ea416d1-fe78-41cd-9e03-e77d898151d0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:59:33 user nova-compute[70243]: DEBUG nova.network.neutron [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 16:59:33 user nova-compute[70243]: DEBUG nova.network.neutron [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Updating instance_info_cache with network_info: [{"id": "0c381671-6073-4a8e-98df-9574aff888d0", "address": "fa:16:3e:1d:ef:a5", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c381671-60", "ovs_interfaceid": "0c381671-6073-4a8e-98df-9574aff888d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:59:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Releasing lock "refresh_cache-4ea416d1-fe78-41cd-9e03-e77d898151d0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:59:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Instance network_info: |[{"id": "0c381671-6073-4a8e-98df-9574aff888d0", "address": "fa:16:3e:1d:ef:a5", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c381671-60", "ovs_interfaceid": "0c381671-6073-4a8e-98df-9574aff888d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 16:59:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1507eba9-24f5-43be-9da0-0eb86e9da679 req-8a25bcad-b5d0-4dcc-8ff3-f8189f26710d service nova] Acquired lock "refresh_cache-4ea416d1-fe78-41cd-9e03-e77d898151d0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:59:33 user nova-compute[70243]: DEBUG nova.network.neutron [req-1507eba9-24f5-43be-9da0-0eb86e9da679 req-8a25bcad-b5d0-4dcc-8ff3-f8189f26710d service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Refreshing network info cache for port 0c381671-6073-4a8e-98df-9574aff888d0 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:59:34 user nova-compute[70243]: DEBUG nova.network.neutron [req-1507eba9-24f5-43be-9da0-0eb86e9da679 req-8a25bcad-b5d0-4dcc-8ff3-f8189f26710d service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Updated VIF entry in instance network info cache for port 0c381671-6073-4a8e-98df-9574aff888d0. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:59:34 user nova-compute[70243]: DEBUG nova.network.neutron [req-1507eba9-24f5-43be-9da0-0eb86e9da679 req-8a25bcad-b5d0-4dcc-8ff3-f8189f26710d service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Updating instance_info_cache with network_info: [{"id": "0c381671-6073-4a8e-98df-9574aff888d0", "address": "fa:16:3e:1d:ef:a5", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c381671-60", "ovs_interfaceid": "0c381671-6073-4a8e-98df-9574aff888d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:59:34 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1507eba9-24f5-43be-9da0-0eb86e9da679 req-8a25bcad-b5d0-4dcc-8ff3-f8189f26710d service nova] Releasing lock "refresh_cache-4ea416d1-fe78-41cd-9e03-e77d898151d0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:59:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:36 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 16:59:36 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Cleaning up deleted instances {{(pid=70243) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 16:59:36 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] There are 0 instances to clean {{(pid=70243) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG nova.compute.manager [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 16:59:38 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Creating image(s)
Jul 24 16:59:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Did not create local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Ensure instance console log exists: /opt/stack/data/nova/instances/4ea416d1-fe78-41cd-9e03-e77d898151d0/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Start _get_guest_xml network_info=[{"id": "0c381671-6073-4a8e-98df-9574aff888d0", "address": "fa:16:3e:1d:ef:a5", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c381671-60", "ovs_interfaceid": "0c381671-6073-4a8e-98df-9574aff888d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'culLOvkW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4ea416d1-fe78-41cd-9e03-e77d898151d0', 'attached_at': '', 'detached_at': '', 'volume_id': '113e5e69-7001-42c5-b86a-fcee55a4a0a9', 'serial': '113e5e69-7001-42c5-b86a-fcee55a4a0a9'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'f428d917-1565-4daf-8c45-5a0d699ba4a2', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 16:59:38 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:59:38 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 16:59:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'culLOvkW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 16:59:38 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:59:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:59:38 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 16:59:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 16:59:38 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b9ee52-fa2c-4b88-87f9-2560fca72061]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 16:59:38 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc64effd-1fe7-4ce9-b7ce-6177f6afb12b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9] added
Jul 24 16:59:38 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c0bd6b-52ec-46e2-9c21-a8ed9fc8f037]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8532c83-330a-4a20-abe5-39c9eee14d14]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v culLOvkW {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v culLOvkW" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b593eac-c9a9-47c5-8826-d002673aa60e]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'culLOvkW'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a603d2f8-151c-48ac-9548-48e88844e260]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[738e5497-26cb-4aaa-b4b8-9801e4efa3e8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 16:59:38 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 16:59:38 user nova-compute[70243]:  {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:59:38 user nova-compute[70243]: WARNING os_brick.initiator.connectors.iscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 16:59:38 user nova-compute[70243]: 
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca92176a-c50b-4707-b5f4-7ec36b406293]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9, portal: 172.16.0.220,3260]
Jul 24 16:59:38 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9, portal: 172.16.0.220,3260] successful.
Jul 24 16:59:38 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b29b999-72bd-4e9f-ad5e-1a651401bb0a]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a620ddb-cf36-4c4d-8c81-139bc90e10ce]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 (non-flash)
Jul 24 16:59:38 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 (non-flash)
Jul 24 16:59:38 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[680f7fdf-f6dd-4f0f-9ba3-ecba793c7d96]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 16:59:38 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'culLOvkW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '26534663161623663', 'path': '/dev/sdb'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534663161623663', 'path': '/dev/sdb'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-530480187',display_name='tempest-TestVolumeBootPattern-volume-backed-server-530480187',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-530480187',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImCFTJvpYzDQS8Q/mv5t99CZwW3g6Bvtx0j/A+ne4ni2EacAjmSl83e87FwOv426F0pBCGV6NmS5WMpT+zzR5aFfQdQRnHlulY49f9frnxTgiJVMMial83BWPEmKb1QEQ==',key_name='tempest-keypair-856796068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0b57210106d441e96e821af15cb9469',ramdisk_id='',reservation_id='r-4gdlictl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-994857419',owner_user_name='tempest-TestVolumeBootPattern-994857419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:59:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f46574c91b549dda125d3d6874e26cc',uuid=4ea416d1-fe78-41cd-9e03-e77d898151d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c381671-6073-4a8e-98df-9574aff888d0", "address": "fa:16:3e:1d:ef:a5", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c381671-60", "ovs_interfaceid": "0c381671-6073-4a8e-98df-9574aff888d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converting VIF {"id": "0c381671-6073-4a8e-98df-9574aff888d0", "address": "fa:16:3e:1d:ef:a5", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c381671-60", "ovs_interfaceid": "0c381671-6073-4a8e-98df-9574aff888d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ef:a5,bridge_name='br-int',has_traffic_filtering=True,id=0c381671-6073-4a8e-98df-9574aff888d0,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c381671-60') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG nova.objects.instance [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ea416d1-fe78-41cd-9e03-e77d898151d0 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] End _get_guest_xml xml=<domain type="kvm">
Jul 24 16:59:39 user nova-compute[70243]:   <uuid>4ea416d1-fe78-41cd-9e03-e77d898151d0</uuid>
Jul 24 16:59:39 user nova-compute[70243]:   <name>instance-0000002f</name>
Jul 24 16:59:39 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 16:59:39 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 16:59:39 user nova-compute[70243]:   <metadata>
Jul 24 16:59:39 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 16:59:39 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 16:59:39 user nova-compute[70243]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-530480187</nova:name>
Jul 24 16:59:39 user nova-compute[70243]:       <nova:creationTime>2023-07-24 16:59:38</nova:creationTime>
Jul 24 16:59:39 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 16:59:39 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 16:59:39 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 16:59:39 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 16:59:39 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 16:59:39 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 16:59:39 user nova-compute[70243]:       </nova:flavor>
Jul 24 16:59:39 user nova-compute[70243]:       <nova:owner>
Jul 24 16:59:39 user nova-compute[70243]:         <nova:user uuid="9f46574c91b549dda125d3d6874e26cc">tempest-TestVolumeBootPattern-994857419-project-member</nova:user>
Jul 24 16:59:39 user nova-compute[70243]:         <nova:project uuid="a0b57210106d441e96e821af15cb9469">tempest-TestVolumeBootPattern-994857419</nova:project>
Jul 24 16:59:39 user nova-compute[70243]:       </nova:owner>
Jul 24 16:59:39 user nova-compute[70243]:       <nova:ports>
Jul 24 16:59:39 user nova-compute[70243]:         <nova:port uuid="0c381671-6073-4a8e-98df-9574aff888d0">
Jul 24 16:59:39 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 16:59:39 user nova-compute[70243]:         </nova:port>
Jul 24 16:59:39 user nova-compute[70243]:       </nova:ports>
Jul 24 16:59:39 user nova-compute[70243]:     </nova:instance>
Jul 24 16:59:39 user nova-compute[70243]:   </metadata>
Jul 24 16:59:39 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 16:59:39 user nova-compute[70243]:     <system>
Jul 24 16:59:39 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 16:59:39 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 16:59:39 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 16:59:39 user nova-compute[70243]:       <entry name="serial">4ea416d1-fe78-41cd-9e03-e77d898151d0</entry>
Jul 24 16:59:39 user nova-compute[70243]:       <entry name="uuid">4ea416d1-fe78-41cd-9e03-e77d898151d0</entry>
Jul 24 16:59:39 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 16:59:39 user nova-compute[70243]:     </system>
Jul 24 16:59:39 user nova-compute[70243]:   </sysinfo>
Jul 24 16:59:39 user nova-compute[70243]:   <os>
Jul 24 16:59:39 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 16:59:39 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 16:59:39 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 16:59:39 user nova-compute[70243]:   </os>
Jul 24 16:59:39 user nova-compute[70243]:   <features>
Jul 24 16:59:39 user nova-compute[70243]:     <acpi/>
Jul 24 16:59:39 user nova-compute[70243]:     <apic/>
Jul 24 16:59:39 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 16:59:39 user nova-compute[70243]:   </features>
Jul 24 16:59:39 user nova-compute[70243]:   <clock offset="utc">
Jul 24 16:59:39 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 16:59:39 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 16:59:39 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 16:59:39 user nova-compute[70243]:   </clock>
Jul 24 16:59:39 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 16:59:39 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 16:59:39 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 16:59:39 user nova-compute[70243]:   </cpu>
Jul 24 16:59:39 user nova-compute[70243]:   <devices>
Jul 24 16:59:39 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 16:59:39 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 16:59:39 user nova-compute[70243]:       <source dev="/dev/sdb"/>
Jul 24 16:59:39 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 16:59:39 user nova-compute[70243]:       <serial>113e5e69-7001-42c5-b86a-fcee55a4a0a9</serial>
Jul 24 16:59:39 user nova-compute[70243]:     </disk>
Jul 24 16:59:39 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 16:59:39 user nova-compute[70243]:       <mac address="fa:16:3e:1d:ef:a5"/>
Jul 24 16:59:39 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:59:39 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 16:59:39 user nova-compute[70243]:       <target dev="tap0c381671-60"/>
Jul 24 16:59:39 user nova-compute[70243]:     </interface>
Jul 24 16:59:39 user nova-compute[70243]:     <serial type="pty">
Jul 24 16:59:39 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/4ea416d1-fe78-41cd-9e03-e77d898151d0/console.log" append="off"/>
Jul 24 16:59:39 user nova-compute[70243]:     </serial>
Jul 24 16:59:39 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 16:59:39 user nova-compute[70243]:     <video>
Jul 24 16:59:39 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 16:59:39 user nova-compute[70243]:     </video>
Jul 24 16:59:39 user nova-compute[70243]:     <rng model="virtio">
Jul 24 16:59:39 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 16:59:39 user nova-compute[70243]:     </rng>
Jul 24 16:59:39 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 16:59:39 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 16:59:39 user nova-compute[70243]:       <stats period="10"/>
Jul 24 16:59:39 user nova-compute[70243]:     </memballoon>
Jul 24 16:59:39 user nova-compute[70243]:   </devices>
Jul 24 16:59:39 user nova-compute[70243]: </domain>
Jul 24 16:59:39 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-530480187',display_name='tempest-TestVolumeBootPattern-volume-backed-server-530480187',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-530480187',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImCFTJvpYzDQS8Q/mv5t99CZwW3g6Bvtx0j/A+ne4ni2EacAjmSl83e87FwOv426F0pBCGV6NmS5WMpT+zzR5aFfQdQRnHlulY49f9frnxTgiJVMMial83BWPEmKb1QEQ==',key_name='tempest-keypair-856796068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0b57210106d441e96e821af15cb9469',ramdisk_id='',reservation_id='r-4gdlictl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-994857419',owner_user_name='tempest-TestVolumeBootPattern-994857419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T16:59:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f46574c91b549dda125d3d6874e26cc',uuid=4ea416d1-fe78-41cd-9e03-e77d898151d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c381671-6073-4a8e-98df-9574aff888d0", "address": "fa:16:3e:1d:ef:a5", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c381671-60", "ovs_interfaceid": "0c381671-6073-4a8e-98df-9574aff888d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converting VIF {"id": "0c381671-6073-4a8e-98df-9574aff888d0", "address": "fa:16:3e:1d:ef:a5", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c381671-60", "ovs_interfaceid": "0c381671-6073-4a8e-98df-9574aff888d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ef:a5,bridge_name='br-int',has_traffic_filtering=True,id=0c381671-6073-4a8e-98df-9574aff888d0,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c381671-60') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG os_vif [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ef:a5,bridge_name='br-int',has_traffic_filtering=True,id=0c381671-6073-4a8e-98df-9574aff888d0,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c381671-60') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c381671-60, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0c381671-60, col_values=(('external_ids', {'iface-id': '0c381671-6073-4a8e-98df-9574aff888d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:ef:a5', 'vm-uuid': '4ea416d1-fe78-41cd-9e03-e77d898151d0'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:39 user nova-compute[70243]: INFO os_vif [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ef:a5,bridge_name='br-int',has_traffic_filtering=True,id=0c381671-6073-4a8e-98df-9574aff888d0,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c381671-60')
Jul 24 16:59:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 16:59:39 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] No VIF found with MAC fa:16:3e:1d:ef:a5, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 16:59:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:41 user nova-compute[70243]: DEBUG nova.compute.manager [req-ffb6b5d7-97e5-4b71-b7b7-87c81b88b746 req-2c2d9f22-0f7f-486c-8830-a66ecdb09c5d service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Received event network-vif-plugged-0c381671-6073-4a8e-98df-9574aff888d0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:59:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ffb6b5d7-97e5-4b71-b7b7-87c81b88b746 req-2c2d9f22-0f7f-486c-8830-a66ecdb09c5d service nova] Acquiring lock "4ea416d1-fe78-41cd-9e03-e77d898151d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:59:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ffb6b5d7-97e5-4b71-b7b7-87c81b88b746 req-2c2d9f22-0f7f-486c-8830-a66ecdb09c5d service nova] Lock "4ea416d1-fe78-41cd-9e03-e77d898151d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:59:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ffb6b5d7-97e5-4b71-b7b7-87c81b88b746 req-2c2d9f22-0f7f-486c-8830-a66ecdb09c5d service nova] Lock "4ea416d1-fe78-41cd-9e03-e77d898151d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:59:41 user nova-compute[70243]: DEBUG nova.compute.manager [req-ffb6b5d7-97e5-4b71-b7b7-87c81b88b746 req-2c2d9f22-0f7f-486c-8830-a66ecdb09c5d service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] No waiting events found dispatching network-vif-plugged-0c381671-6073-4a8e-98df-9574aff888d0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:59:41 user nova-compute[70243]: WARNING nova.compute.manager [req-ffb6b5d7-97e5-4b71-b7b7-87c81b88b746 req-2c2d9f22-0f7f-486c-8830-a66ecdb09c5d service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Received unexpected event network-vif-plugged-0c381671-6073-4a8e-98df-9574aff888d0 for instance with vm_state building and task_state spawning.
Jul 24 16:59:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:41 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:42 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217982.9133334, 4ea416d1-fe78-41cd-9e03-e77d898151d0 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:59:42 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] VM Resumed (Lifecycle Event)
Jul 24 16:59:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 16:59:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 16:59:42 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Instance spawned successfully.
Jul 24 16:59:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 16:59:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:59:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:59:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:59:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:59:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:59:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:59:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:59:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 16:59:42 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:59:42 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690217982.9150207, 4ea416d1-fe78-41cd-9e03-e77d898151d0 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 16:59:42 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] VM Started (Lifecycle Event)
Jul 24 16:59:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:59:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 16:59:43 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 16:59:43 user nova-compute[70243]: INFO nova.compute.manager [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Took 4.92 seconds to spawn the instance on the hypervisor.
Jul 24 16:59:43 user nova-compute[70243]: DEBUG nova.compute.manager [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 16:59:43 user nova-compute[70243]: INFO nova.compute.manager [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Took 11.95 seconds to build instance.
Jul 24 16:59:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-364f5568-130e-47fa-ab10-0e3fe4cd8bf8 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "4ea416d1-fe78-41cd-9e03-e77d898151d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.035s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:59:43 user nova-compute[70243]: DEBUG nova.compute.manager [req-91f55ef1-d4cb-42a0-8cf4-ed34401d192a req-de4e9011-3c9a-4517-bef2-8636dd2508de service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Received event network-vif-plugged-0c381671-6073-4a8e-98df-9574aff888d0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:59:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-91f55ef1-d4cb-42a0-8cf4-ed34401d192a req-de4e9011-3c9a-4517-bef2-8636dd2508de service nova] Acquiring lock "4ea416d1-fe78-41cd-9e03-e77d898151d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:59:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-91f55ef1-d4cb-42a0-8cf4-ed34401d192a req-de4e9011-3c9a-4517-bef2-8636dd2508de service nova] Lock "4ea416d1-fe78-41cd-9e03-e77d898151d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:59:43 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-91f55ef1-d4cb-42a0-8cf4-ed34401d192a req-de4e9011-3c9a-4517-bef2-8636dd2508de service nova] Lock "4ea416d1-fe78-41cd-9e03-e77d898151d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:59:43 user nova-compute[70243]: DEBUG nova.compute.manager [req-91f55ef1-d4cb-42a0-8cf4-ed34401d192a req-de4e9011-3c9a-4517-bef2-8636dd2508de service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] No waiting events found dispatching network-vif-plugged-0c381671-6073-4a8e-98df-9574aff888d0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:59:43 user nova-compute[70243]: WARNING nova.compute.manager [req-91f55ef1-d4cb-42a0-8cf4-ed34401d192a req-de4e9011-3c9a-4517-bef2-8636dd2508de service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Received unexpected event network-vif-plugged-0c381671-6073-4a8e-98df-9574aff888d0 for instance with vm_state active and task_state None.
Jul 24 16:59:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:59:57 user nova-compute[70243]: DEBUG nova.compute.manager [req-99a1a679-9a3e-456b-a655-38fcf1312999 req-2d4c8619-bf91-4bca-aa98-88be75a4593a service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Received event network-changed-2311739b-e5b5-4020-ad8f-95a3d56a50ca {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:59:57 user nova-compute[70243]: DEBUG nova.compute.manager [req-99a1a679-9a3e-456b-a655-38fcf1312999 req-2d4c8619-bf91-4bca-aa98-88be75a4593a service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Refreshing instance network info cache due to event network-changed-2311739b-e5b5-4020-ad8f-95a3d56a50ca. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 16:59:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-99a1a679-9a3e-456b-a655-38fcf1312999 req-2d4c8619-bf91-4bca-aa98-88be75a4593a service nova] Acquiring lock "refresh_cache-575883e4-410d-4a42-9271-4adae89e36e0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 16:59:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-99a1a679-9a3e-456b-a655-38fcf1312999 req-2d4c8619-bf91-4bca-aa98-88be75a4593a service nova] Acquired lock "refresh_cache-575883e4-410d-4a42-9271-4adae89e36e0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 16:59:57 user nova-compute[70243]: DEBUG nova.network.neutron [req-99a1a679-9a3e-456b-a655-38fcf1312999 req-2d4c8619-bf91-4bca-aa98-88be75a4593a service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Refreshing network info cache for port 2311739b-e5b5-4020-ad8f-95a3d56a50ca {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 16:59:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "575883e4-410d-4a42-9271-4adae89e36e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:59:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "575883e4-410d-4a42-9271-4adae89e36e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:59:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "575883e4-410d-4a42-9271-4adae89e36e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:59:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "575883e4-410d-4a42-9271-4adae89e36e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:59:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "575883e4-410d-4a42-9271-4adae89e36e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:59:57 user nova-compute[70243]: INFO nova.compute.manager [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Terminating instance
Jul 24 16:59:57 user nova-compute[70243]: DEBUG nova.compute.manager [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 16:59:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG nova.network.neutron [req-99a1a679-9a3e-456b-a655-38fcf1312999 req-2d4c8619-bf91-4bca-aa98-88be75a4593a service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Updated VIF entry in instance network info cache for port 2311739b-e5b5-4020-ad8f-95a3d56a50ca. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG nova.network.neutron [req-99a1a679-9a3e-456b-a655-38fcf1312999 req-2d4c8619-bf91-4bca-aa98-88be75a4593a service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Updating instance_info_cache with network_info: [{"id": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "address": "fa:16:3e:d8:f3:b3", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2311739b-e5", "ovs_interfaceid": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-99a1a679-9a3e-456b-a655-38fcf1312999 req-2d4c8619-bf91-4bca-aa98-88be75a4593a service nova] Releasing lock "refresh_cache-575883e4-410d-4a42-9271-4adae89e36e0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-f25e555e-9106-458a-abcb-f8adfe8c59a4 req-f1c4754a-3a74-402f-a397-4b4e3f7abee2 service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Received event network-vif-unplugged-2311739b-e5b5-4020-ad8f-95a3d56a50ca {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f25e555e-9106-458a-abcb-f8adfe8c59a4 req-f1c4754a-3a74-402f-a397-4b4e3f7abee2 service nova] Acquiring lock "575883e4-410d-4a42-9271-4adae89e36e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f25e555e-9106-458a-abcb-f8adfe8c59a4 req-f1c4754a-3a74-402f-a397-4b4e3f7abee2 service nova] Lock "575883e4-410d-4a42-9271-4adae89e36e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f25e555e-9106-458a-abcb-f8adfe8c59a4 req-f1c4754a-3a74-402f-a397-4b4e3f7abee2 service nova] Lock "575883e4-410d-4a42-9271-4adae89e36e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-f25e555e-9106-458a-abcb-f8adfe8c59a4 req-f1c4754a-3a74-402f-a397-4b4e3f7abee2 service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] No waiting events found dispatching network-vif-unplugged-2311739b-e5b5-4020-ad8f-95a3d56a50ca {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-f25e555e-9106-458a-abcb-f8adfe8c59a4 req-f1c4754a-3a74-402f-a397-4b4e3f7abee2 service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Received event network-vif-unplugged-2311739b-e5b5-4020-ad8f-95a3d56a50ca for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:58 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Instance destroyed successfully.
Jul 24 16:59:58 user nova-compute[70243]: DEBUG nova.objects.instance [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lazy-loading 'resources' on Instance uuid 575883e4-410d-4a42-9271-4adae89e36e0 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:57:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-811371073',display_name='tempest-TestStampPattern-server-811371073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-811371073',id=46,image_ref='e8e8bcf7-54a9-47ef-b8be-96edae72c063',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcjN6AXTahgDTIvI9HIaDQ+k/Dzge84NatzMa2EvJXvuccVx0gyZ59Q8J0iAC9E1btcc6mN455JjktsyIeZ/7vf3Iafpzgfuv6BK3oksbTrcO0UZlMN59+9iVCgGkzqiw==',key_name='tempest-TestStampPattern-1639173847',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:57:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='640508f674d34751905b6a4d9625fb1f',ramdisk_id='',reservation_id='r-zb70omum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4e1e09ef-9c6f-4032-8a90-6dfb2583df81',image_min_disk='1',image_min_ram='0',image_owner_id='640508f674d34751905b6a4d9625fb1f',image_owner_project_name='tempest-TestStampPattern-1363630507',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1363630507-project-member',image_user_id='4a4ab26ba5d94a8d89bb7b9403eda190',owner_project_name='tempest-TestStampPattern-1363630507',owner_user_name='tempest-TestStampPattern-1363630507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:57:10Z,user_data=None,user_id='4a4ab26ba5d94a8d89bb7b9403eda190',uuid=575883e4-410d-4a42-9271-4adae89e36e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "address": "fa:16:3e:d8:f3:b3", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2311739b-e5", "ovs_interfaceid": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Converting VIF {"id": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "address": "fa:16:3e:d8:f3:b3", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2311739b-e5", "ovs_interfaceid": "2311739b-e5b5-4020-ad8f-95a3d56a50ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:f3:b3,bridge_name='br-int',has_traffic_filtering=True,id=2311739b-e5b5-4020-ad8f-95a3d56a50ca,network=Network(8ec80dde-9337-44d3-a3a7-c8b6e55e561f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2311739b-e5') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG os_vif [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:f3:b3,bridge_name='br-int',has_traffic_filtering=True,id=2311739b-e5b5-4020-ad8f-95a3d56a50ca,network=Network(8ec80dde-9337-44d3-a3a7-c8b6e55e561f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2311739b-e5') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2311739b-e5, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 16:59:58 user nova-compute[70243]: INFO os_vif [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:f3:b3,bridge_name='br-int',has_traffic_filtering=True,id=2311739b-e5b5-4020-ad8f-95a3d56a50ca,network=Network(8ec80dde-9337-44d3-a3a7-c8b6e55e561f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2311739b-e5')
Jul 24 16:59:58 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Deleting instance files /opt/stack/data/nova/instances/575883e4-410d-4a42-9271-4adae89e36e0_del
Jul 24 16:59:58 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Deletion of /opt/stack/data/nova/instances/575883e4-410d-4a42-9271-4adae89e36e0_del complete
Jul 24 16:59:58 user nova-compute[70243]: INFO nova.compute.manager [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 24 16:59:58 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 16:59:58 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 16:59:59 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:59:59 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Took 0.56 seconds to deallocate network for instance.
Jul 24 16:59:59 user nova-compute[70243]: DEBUG nova.compute.manager [req-1c127e4f-3bf2-498d-9eb7-ae8f24730817 req-5efc5f83-00a1-49b9-bf66-3ac9a85699ed service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Received event network-vif-deleted-2311739b-e5b5-4020-ad8f-95a3d56a50ca {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 16:59:59 user nova-compute[70243]: INFO nova.compute.manager [req-1c127e4f-3bf2-498d-9eb7-ae8f24730817 req-5efc5f83-00a1-49b9-bf66-3ac9a85699ed service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Neutron deleted interface 2311739b-e5b5-4020-ad8f-95a3d56a50ca; detaching it from the instance and deleting it from the info cache
Jul 24 16:59:59 user nova-compute[70243]: DEBUG nova.network.neutron [req-1c127e4f-3bf2-498d-9eb7-ae8f24730817 req-5efc5f83-00a1-49b9-bf66-3ac9a85699ed service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 16:59:59 user nova-compute[70243]: DEBUG nova.compute.manager [req-1c127e4f-3bf2-498d-9eb7-ae8f24730817 req-5efc5f83-00a1-49b9-bf66-3ac9a85699ed service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Detach interface failed, port_id=2311739b-e5b5-4020-ad8f-95a3d56a50ca, reason: Instance 575883e4-410d-4a42-9271-4adae89e36e0 could not be found. {{(pid=70243) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 16:59:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 16:59:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 16:59:59 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 16:59:59 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 16:59:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 16:59:59 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Deleted allocations for instance 575883e4-410d-4a42-9271-4adae89e36e0
Jul 24 16:59:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3215e7c5-d9a8-4ccd-9386-261fc52a9816 tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "575883e4-410d-4a42-9271-4adae89e36e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.764s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:00:00 user nova-compute[70243]: DEBUG nova.compute.manager [req-63e36251-44c0-47f4-8879-8d0ee97a85dd req-76eb4f4c-6230-4b36-8d85-5a448d756544 service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Received event network-vif-plugged-2311739b-e5b5-4020-ad8f-95a3d56a50ca {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:00:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-63e36251-44c0-47f4-8879-8d0ee97a85dd req-76eb4f4c-6230-4b36-8d85-5a448d756544 service nova] Acquiring lock "575883e4-410d-4a42-9271-4adae89e36e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:00:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-63e36251-44c0-47f4-8879-8d0ee97a85dd req-76eb4f4c-6230-4b36-8d85-5a448d756544 service nova] Lock "575883e4-410d-4a42-9271-4adae89e36e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:00:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-63e36251-44c0-47f4-8879-8d0ee97a85dd req-76eb4f4c-6230-4b36-8d85-5a448d756544 service nova] Lock "575883e4-410d-4a42-9271-4adae89e36e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:00:00 user nova-compute[70243]: DEBUG nova.compute.manager [req-63e36251-44c0-47f4-8879-8d0ee97a85dd req-76eb4f4c-6230-4b36-8d85-5a448d756544 service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] No waiting events found dispatching network-vif-plugged-2311739b-e5b5-4020-ad8f-95a3d56a50ca {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:00:00 user nova-compute[70243]: WARNING nova.compute.manager [req-63e36251-44c0-47f4-8879-8d0ee97a85dd req-76eb4f4c-6230-4b36-8d85-5a448d756544 service nova] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Received unexpected event network-vif-plugged-2311739b-e5b5-4020-ad8f-95a3d56a50ca for instance with vm_state deleted and task_state None.
Jul 24 17:00:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:00:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:00:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:00:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:00:10 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:00:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:00:13 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:00:13 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690217998.6069622, 575883e4-410d-4a42-9271-4adae89e36e0 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:00:13 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] VM Stopped (Lifecycle Event)
Jul 24 17:00:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e3b232bd-bba7-4faa-9840-bdada3e4b52f None None] [instance: 575883e4-410d-4a42-9271-4adae89e36e0] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:00:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:00:16 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:00:17 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:00:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:00:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 17:00:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:00:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:00:17 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 17:00:17 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lazy-loading 'info_cache' on Instance uuid 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:00:17 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Updating instance_info_cache with network_info: [{"id": "8f320269-e11a-4735-b792-c845cca35f8d", "address": "fa:16:3e:7d:ac:88", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f320269-e1", "ovs_interfaceid": "8f320269-e11a-4735-b792-c845cca35f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:00:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:00:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 17:00:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:00:19 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:00:19 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:00:20 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:00:21 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:00:23 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:00:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:00:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:00:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:00:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:00:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:00:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:00:25 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:00:26 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:00:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:00:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:00:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:00:26 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:00:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:00:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:00:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:00:26 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:00:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:00:27 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:00:27 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:00:27 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8618MB free_disk=24.0064697265625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:00:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:00:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:00:27 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:00:27 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 4ea416d1-fe78-41cd-9e03-e77d898151d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:00:27 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:00:27 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:00:27 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing inventories for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 17:00:27 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Updating ProviderTree inventory for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 17:00:27 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Updating inventory in ProviderTree for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 17:00:27 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing aggregate associations for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0, aggregates: None {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 17:00:27 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing trait associations for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0, traits: HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 17:00:27 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:00:27 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:00:27 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:00:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:00:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:00:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:00:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:00:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:00:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:00:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:00:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:00:57 user nova-compute[70243]: DEBUG nova.compute.manager [req-f14293e0-bfb4-480c-a0d8-5545a2764172 req-9f1c67d3-cf88-4e5e-80e9-05575f022bdd service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Received event network-changed-8f320269-e11a-4735-b792-c845cca35f8d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:00:57 user nova-compute[70243]: DEBUG nova.compute.manager [req-f14293e0-bfb4-480c-a0d8-5545a2764172 req-9f1c67d3-cf88-4e5e-80e9-05575f022bdd service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Refreshing instance network info cache due to event network-changed-8f320269-e11a-4735-b792-c845cca35f8d. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:00:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f14293e0-bfb4-480c-a0d8-5545a2764172 req-9f1c67d3-cf88-4e5e-80e9-05575f022bdd service nova] Acquiring lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:00:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f14293e0-bfb4-480c-a0d8-5545a2764172 req-9f1c67d3-cf88-4e5e-80e9-05575f022bdd service nova] Acquired lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:00:57 user nova-compute[70243]: DEBUG nova.network.neutron [req-f14293e0-bfb4-480c-a0d8-5545a2764172 req-9f1c67d3-cf88-4e5e-80e9-05575f022bdd service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Refreshing network info cache for port 8f320269-e11a-4735-b792-c845cca35f8d {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:00:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:00:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:00:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:00:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:00:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:00:57 user nova-compute[70243]: INFO nova.compute.manager [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Terminating instance
Jul 24 17:00:58 user nova-compute[70243]: DEBUG nova.compute.manager [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-05498335-99b2-4dfd-a6b8-a213ca1e67fe req-4cc7a2bd-02a5-4195-810d-f45b4080c1eb service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Received event network-vif-unplugged-8f320269-e11a-4735-b792-c845cca35f8d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-05498335-99b2-4dfd-a6b8-a213ca1e67fe req-4cc7a2bd-02a5-4195-810d-f45b4080c1eb service nova] Acquiring lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-05498335-99b2-4dfd-a6b8-a213ca1e67fe req-4cc7a2bd-02a5-4195-810d-f45b4080c1eb service nova] Lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-05498335-99b2-4dfd-a6b8-a213ca1e67fe req-4cc7a2bd-02a5-4195-810d-f45b4080c1eb service nova] Lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-05498335-99b2-4dfd-a6b8-a213ca1e67fe req-4cc7a2bd-02a5-4195-810d-f45b4080c1eb service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] No waiting events found dispatching network-vif-unplugged-8f320269-e11a-4735-b792-c845cca35f8d {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-05498335-99b2-4dfd-a6b8-a213ca1e67fe req-4cc7a2bd-02a5-4195-810d-f45b4080c1eb service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Received event network-vif-unplugged-8f320269-e11a-4735-b792-c845cca35f8d for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG nova.network.neutron [req-f14293e0-bfb4-480c-a0d8-5545a2764172 req-9f1c67d3-cf88-4e5e-80e9-05575f022bdd service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Updated VIF entry in instance network info cache for port 8f320269-e11a-4735-b792-c845cca35f8d. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG nova.network.neutron [req-f14293e0-bfb4-480c-a0d8-5545a2764172 req-9f1c67d3-cf88-4e5e-80e9-05575f022bdd service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Updating instance_info_cache with network_info: [{"id": "8f320269-e11a-4735-b792-c845cca35f8d", "address": "fa:16:3e:7d:ac:88", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f320269-e1", "ovs_interfaceid": "8f320269-e11a-4735-b792-c845cca35f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f14293e0-bfb4-480c-a0d8-5545a2764172 req-9f1c67d3-cf88-4e5e-80e9-05575f022bdd service nova] Releasing lock "refresh_cache-4e1e09ef-9c6f-4032-8a90-6dfb2583df81" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:00:58 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Instance destroyed successfully.
Jul 24 17:00:58 user nova-compute[70243]: DEBUG nova.objects.instance [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lazy-loading 'resources' on Instance uuid 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:53:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-227271702',display_name='tempest-TestStampPattern-server-227271702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-227271702',id=44,image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcjN6AXTahgDTIvI9HIaDQ+k/Dzge84NatzMa2EvJXvuccVx0gyZ59Q8J0iAC9E1btcc6mN455JjktsyIeZ/7vf3Iafpzgfuv6BK3oksbTrcO0UZlMN59+9iVCgGkzqiw==',key_name='tempest-TestStampPattern-1639173847',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:54:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='640508f674d34751905b6a4d9625fb1f',ramdisk_id='',reservation_id='r-8f3ykg6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7192dcb0-7da9-4207-b62f-555f7e11e667',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1363630507',owner_user_name='tempest-TestStampPattern-1363630507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:56:57Z,user_data=None,user_id='4a4ab26ba5d94a8d89bb7b9403eda190',uuid=4e1e09ef-9c6f-4032-8a90-6dfb2583df81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f320269-e11a-4735-b792-c845cca35f8d", "address": "fa:16:3e:7d:ac:88", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f320269-e1", "ovs_interfaceid": "8f320269-e11a-4735-b792-c845cca35f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Converting VIF {"id": "8f320269-e11a-4735-b792-c845cca35f8d", "address": "fa:16:3e:7d:ac:88", "network": {"id": "8ec80dde-9337-44d3-a3a7-c8b6e55e561f", "bridge": "br-int", "label": "tempest-TestStampPattern-737623889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "640508f674d34751905b6a4d9625fb1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f320269-e1", "ovs_interfaceid": "8f320269-e11a-4735-b792-c845cca35f8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:ac:88,bridge_name='br-int',has_traffic_filtering=True,id=8f320269-e11a-4735-b792-c845cca35f8d,network=Network(8ec80dde-9337-44d3-a3a7-c8b6e55e561f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f320269-e1') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG os_vif [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:ac:88,bridge_name='br-int',has_traffic_filtering=True,id=8f320269-e11a-4735-b792-c845cca35f8d,network=Network(8ec80dde-9337-44d3-a3a7-c8b6e55e561f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f320269-e1') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f320269-e1, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:00:58 user nova-compute[70243]: INFO os_vif [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:ac:88,bridge_name='br-int',has_traffic_filtering=True,id=8f320269-e11a-4735-b792-c845cca35f8d,network=Network(8ec80dde-9337-44d3-a3a7-c8b6e55e561f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f320269-e1')
Jul 24 17:00:58 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Deleting instance files /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81_del
Jul 24 17:00:58 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Deletion of /opt/stack/data/nova/instances/4e1e09ef-9c6f-4032-8a90-6dfb2583df81_del complete
Jul 24 17:00:58 user nova-compute[70243]: INFO nova.compute.manager [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 24 17:00:58 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 17:00:58 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 17:00:59 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:00:59 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Took 0.51 seconds to deallocate network for instance.
Jul 24 17:00:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:00:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:00:59 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:00:59 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:00:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:00:59 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Deleted allocations for instance 4e1e09ef-9c6f-4032-8a90-6dfb2583df81
Jul 24 17:00:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7e856baf-5813-4b95-8525-1b87bca4a82b tempest-TestStampPattern-1363630507 tempest-TestStampPattern-1363630507-project-member] Lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.792s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:01:00 user nova-compute[70243]: DEBUG nova.compute.manager [req-d353ce12-55f8-449a-823b-384f3868dd0a req-a43f4a43-d545-465c-bfdc-a688dc115478 service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Received event network-vif-plugged-8f320269-e11a-4735-b792-c845cca35f8d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:01:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d353ce12-55f8-449a-823b-384f3868dd0a req-a43f4a43-d545-465c-bfdc-a688dc115478 service nova] Acquiring lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:01:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d353ce12-55f8-449a-823b-384f3868dd0a req-a43f4a43-d545-465c-bfdc-a688dc115478 service nova] Lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:01:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-d353ce12-55f8-449a-823b-384f3868dd0a req-a43f4a43-d545-465c-bfdc-a688dc115478 service nova] Lock "4e1e09ef-9c6f-4032-8a90-6dfb2583df81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:01:00 user nova-compute[70243]: DEBUG nova.compute.manager [req-d353ce12-55f8-449a-823b-384f3868dd0a req-a43f4a43-d545-465c-bfdc-a688dc115478 service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] No waiting events found dispatching network-vif-plugged-8f320269-e11a-4735-b792-c845cca35f8d {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:01:00 user nova-compute[70243]: WARNING nova.compute.manager [req-d353ce12-55f8-449a-823b-384f3868dd0a req-a43f4a43-d545-465c-bfdc-a688dc115478 service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Received unexpected event network-vif-plugged-8f320269-e11a-4735-b792-c845cca35f8d for instance with vm_state deleted and task_state None.
Jul 24 17:01:00 user nova-compute[70243]: DEBUG nova.compute.manager [req-d353ce12-55f8-449a-823b-384f3868dd0a req-a43f4a43-d545-465c-bfdc-a688dc115478 service nova] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Received event network-vif-deleted-8f320269-e11a-4735-b792-c845cca35f8d {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:01:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:01:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:01:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:01:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:01:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:11 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:01:13 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690218058.7503946, 4e1e09ef-9c6f-4032-8a90-6dfb2583df81 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:01:13 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] VM Stopped (Lifecycle Event)
Jul 24 17:01:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-0f9a6e6c-e69b-421a-93b4-620d90182d17 None None] [instance: 4e1e09ef-9c6f-4032-8a90-6dfb2583df81] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:01:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:14 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:01:16 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:01:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:01:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:01:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:01:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:01:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:19 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:01:19 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:01:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-4ea416d1-fe78-41cd-9e03-e77d898151d0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:01:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-4ea416d1-fe78-41cd-9e03-e77d898151d0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:01:19 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 17:01:19 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Updating instance_info_cache with network_info: [{"id": "0c381671-6073-4a8e-98df-9574aff888d0", "address": "fa:16:3e:1d:ef:a5", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c381671-60", "ovs_interfaceid": "0c381671-6073-4a8e-98df-9574aff888d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:01:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-4ea416d1-fe78-41cd-9e03-e77d898151d0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:01:19 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 17:01:19 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:01:19 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:01:20 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:01:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-7e87011b-85d9-47a5-b064-acc1edd371f3 req-80d41bc0-40cf-494f-b6be-d7506a4be689 service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Received event network-changed-0c381671-6073-4a8e-98df-9574aff888d0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:01:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-7e87011b-85d9-47a5-b064-acc1edd371f3 req-80d41bc0-40cf-494f-b6be-d7506a4be689 service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Refreshing instance network info cache due to event network-changed-0c381671-6073-4a8e-98df-9574aff888d0. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:01:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7e87011b-85d9-47a5-b064-acc1edd371f3 req-80d41bc0-40cf-494f-b6be-d7506a4be689 service nova] Acquiring lock "refresh_cache-4ea416d1-fe78-41cd-9e03-e77d898151d0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:01:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7e87011b-85d9-47a5-b064-acc1edd371f3 req-80d41bc0-40cf-494f-b6be-d7506a4be689 service nova] Acquired lock "refresh_cache-4ea416d1-fe78-41cd-9e03-e77d898151d0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:01:22 user nova-compute[70243]: DEBUG nova.network.neutron [req-7e87011b-85d9-47a5-b064-acc1edd371f3 req-80d41bc0-40cf-494f-b6be-d7506a4be689 service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Refreshing network info cache for port 0c381671-6073-4a8e-98df-9574aff888d0 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:01:22 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:01:22 user nova-compute[70243]: DEBUG nova.network.neutron [req-7e87011b-85d9-47a5-b064-acc1edd371f3 req-80d41bc0-40cf-494f-b6be-d7506a4be689 service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Updated VIF entry in instance network info cache for port 0c381671-6073-4a8e-98df-9574aff888d0. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:01:22 user nova-compute[70243]: DEBUG nova.network.neutron [req-7e87011b-85d9-47a5-b064-acc1edd371f3 req-80d41bc0-40cf-494f-b6be-d7506a4be689 service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Updating instance_info_cache with network_info: [{"id": "0c381671-6073-4a8e-98df-9574aff888d0", "address": "fa:16:3e:1d:ef:a5", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c381671-60", "ovs_interfaceid": "0c381671-6073-4a8e-98df-9574aff888d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:01:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-7e87011b-85d9-47a5-b064-acc1edd371f3 req-80d41bc0-40cf-494f-b6be-d7506a4be689 service nova] Releasing lock "refresh_cache-4ea416d1-fe78-41cd-9e03-e77d898151d0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:01:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:25 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:01:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:26 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:01:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:01:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:01:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:01:26 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:01:26 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:01:26 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:01:26 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:01:26 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8720MB free_disk=24.130809783935547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:01:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:01:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:01:26 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 4ea416d1-fe78-41cd-9e03-e77d898151d0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:01:26 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:01:26 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:01:26 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:01:26 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:01:26 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:01:26 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:01:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "8f1a6bfb-341b-4fe2-b371-63820bc7fb1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:01:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "8f1a6bfb-341b-4fe2-b371-63820bc7fb1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:01:30 user nova-compute[70243]: DEBUG nova.compute.manager [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:01:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:01:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:01:30 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:01:30 user nova-compute[70243]: INFO nova.compute.claims [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Claim successful on node user
Jul 24 17:01:30 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:01:30 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:01:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:01:30 user nova-compute[70243]: DEBUG nova.compute.manager [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:01:30 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:01:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:30 user nova-compute[70243]: DEBUG nova.compute.manager [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:01:30 user nova-compute[70243]: DEBUG nova.network.neutron [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:01:30 user nova-compute[70243]: DEBUG nova.compute.manager [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:01:30 user nova-compute[70243]: INFO nova.virt.block_device [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Booting with volume snapshot 03658558-2ace-4302-8c7a-281b62cd6148 at /dev/vda
Jul 24 17:01:30 user nova-compute[70243]: DEBUG nova.policy [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f46574c91b549dda125d3d6874e26cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b57210106d441e96e821af15cb9469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:01:31 user nova-compute[70243]: DEBUG nova.network.neutron [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Successfully created port: 589c515f-9916-4979-8968-9937e6aea85e {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:01:32 user nova-compute[70243]: DEBUG nova.network.neutron [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Successfully updated port: 589c515f-9916-4979-8968-9937e6aea85e {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:01:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "refresh_cache-8f1a6bfb-341b-4fe2-b371-63820bc7fb1e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:01:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquired lock "refresh_cache-8f1a6bfb-341b-4fe2-b371-63820bc7fb1e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:01:32 user nova-compute[70243]: DEBUG nova.network.neutron [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:01:32 user nova-compute[70243]: DEBUG nova.compute.manager [req-6dbb0e08-c48f-4ccf-a446-ac28ca6051b9 req-9f5d555a-68cb-42d9-8d7c-2bda10b25b5e service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Received event network-changed-589c515f-9916-4979-8968-9937e6aea85e {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:01:32 user nova-compute[70243]: DEBUG nova.compute.manager [req-6dbb0e08-c48f-4ccf-a446-ac28ca6051b9 req-9f5d555a-68cb-42d9-8d7c-2bda10b25b5e service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Refreshing instance network info cache due to event network-changed-589c515f-9916-4979-8968-9937e6aea85e. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:01:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6dbb0e08-c48f-4ccf-a446-ac28ca6051b9 req-9f5d555a-68cb-42d9-8d7c-2bda10b25b5e service nova] Acquiring lock "refresh_cache-8f1a6bfb-341b-4fe2-b371-63820bc7fb1e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:01:32 user nova-compute[70243]: DEBUG nova.network.neutron [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:01:32 user nova-compute[70243]: DEBUG nova.network.neutron [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Updating instance_info_cache with network_info: [{"id": "589c515f-9916-4979-8968-9937e6aea85e", "address": "fa:16:3e:58:63:41", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589c515f-99", "ovs_interfaceid": "589c515f-9916-4979-8968-9937e6aea85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:01:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Releasing lock "refresh_cache-8f1a6bfb-341b-4fe2-b371-63820bc7fb1e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:01:32 user nova-compute[70243]: DEBUG nova.compute.manager [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Instance network_info: |[{"id": "589c515f-9916-4979-8968-9937e6aea85e", "address": "fa:16:3e:58:63:41", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589c515f-99", "ovs_interfaceid": "589c515f-9916-4979-8968-9937e6aea85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:01:32 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6dbb0e08-c48f-4ccf-a446-ac28ca6051b9 req-9f5d555a-68cb-42d9-8d7c-2bda10b25b5e service nova] Acquired lock "refresh_cache-8f1a6bfb-341b-4fe2-b371-63820bc7fb1e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:01:32 user nova-compute[70243]: DEBUG nova.network.neutron [req-6dbb0e08-c48f-4ccf-a446-ac28ca6051b9 req-9f5d555a-68cb-42d9-8d7c-2bda10b25b5e service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Refreshing network info cache for port 589c515f-9916-4979-8968-9937e6aea85e {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:01:33 user nova-compute[70243]: DEBUG nova.network.neutron [req-6dbb0e08-c48f-4ccf-a446-ac28ca6051b9 req-9f5d555a-68cb-42d9-8d7c-2bda10b25b5e service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Updated VIF entry in instance network info cache for port 589c515f-9916-4979-8968-9937e6aea85e. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:01:33 user nova-compute[70243]: DEBUG nova.network.neutron [req-6dbb0e08-c48f-4ccf-a446-ac28ca6051b9 req-9f5d555a-68cb-42d9-8d7c-2bda10b25b5e service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Updating instance_info_cache with network_info: [{"id": "589c515f-9916-4979-8968-9937e6aea85e", "address": "fa:16:3e:58:63:41", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589c515f-99", "ovs_interfaceid": "589c515f-9916-4979-8968-9937e6aea85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:01:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6dbb0e08-c48f-4ccf-a446-ac28ca6051b9 req-9f5d555a-68cb-42d9-8d7c-2bda10b25b5e service nova] Releasing lock "refresh_cache-8f1a6bfb-341b-4fe2-b371-63820bc7fb1e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:01:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:36 user nova-compute[70243]: DEBUG os_brick.utils [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:01:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:01:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:01:36 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b5d9a6-8e18-459a-a085-7f887b2e69f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:01:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:01:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:01:36 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c03e76-a3fc-44c4-a7bb-f10d01346087]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:01:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:01:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:01:36 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[234b289e-646a-48e1-ba27-4f354ae17ea4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:01:36 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62ba6cb-f60b-4706-ac2a-934fe294ddb3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:01:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:01:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:01:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:01:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:01:36 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:01:36 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:01:36 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a67a96-d650-4dd0-bc9c-9afa989791fc]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:01:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:01:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:01:36 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:01:36 user nova-compute[70243]: DEBUG os_brick.utils [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:01:36 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Updating existing volume attachment record: 52a53018-5f0c-488b-9d0e-243160dc75fe {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:01:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:42 user nova-compute[70243]: DEBUG nova.compute.manager [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:01:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:01:42 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Creating image(s)
Jul 24 17:01:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Did not create local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 17:01:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Ensure instance console log exists: /opt/stack/data/nova/instances/8f1a6bfb-341b-4fe2-b371-63820bc7fb1e/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:01:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:01:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:01:42 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:01:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Start _get_guest_xml network_info=[{"id": "589c515f-9916-4979-8968-9937e6aea85e", "address": "fa:16:3e:58:63:41", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589c515f-99", "ovs_interfaceid": "589c515f-9916-4979-8968-9937e6aea85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-24T17:01:24Z,direct_url=<?>,disk_format='qcow2',id=81abaa25-9497-45b9-8476-7f1a8adfd560,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-977655267',owner='a0b57210106d441e96e821af15cb9469',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-24T17:01:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iOkBYThy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8f1a6bfb-341b-4fe2-b371-63820bc7fb1e', 'attached_at': '', 'detached_at': '', 'volume_id': '8d0e31a5-d45b-427e-b688-84d32833109a', 'serial': '8d0e31a5-d45b-427e-b688-84d32833109a'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '52a53018-5f0c-488b-9d0e-243160dc75fe', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:01:42 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:01:42 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:01:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:01:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:01:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:01:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:01:42 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:01:42 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-24T17:01:24Z,direct_url=<?>,disk_format='qcow2',id=81abaa25-9497-45b9-8476-7f1a8adfd560,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-977655267',owner='a0b57210106d441e96e821af15cb9469',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-24T17:01:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:01:42 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:01:42 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:01:42 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:01:42 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:01:42 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:01:42 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:01:42 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:01:42 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:01:42 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:01:42 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iOkBYThy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:01:43 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:01:43 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:01:43 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1505a558-1775-43fe-ae26-5578c95979bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:01:43 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea7a642-296d-40da-bda3-f1b2617dddc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a] added
Jul 24 17:01:43 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[74353f91-84b8-41e6-aa7b-2e350c8b4892]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9cccb2-2ef3-4796-abe4-2964200711ae]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iOkBYThy {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iOkBYThy" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[629e0d31-dfed-4625-b1cb-f54937466ec3]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iOkBYThy'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c419b0-dcb9-4b5a-8c2f-2c772ebf93d7]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[558b51d0-aab8-4f7a-90c5-afbe2a24bc20]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 (non-flash)
Jul 24 17:01:43 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 (non-flash)
Jul 24 17:01:43 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ecce4f-34c8-40ed-b2c8-ccd7d4641e42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a, portal: 172.16.0.220,3260]
Jul 24 17:01:43 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a, portal: 172.16.0.220,3260] successful.
Jul 24 17:01:43 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e162ee32-65a7-4035-805d-d9a352c8fdfd]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d921e672-9b29-405e-953b-1ba2bf6b1799]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 (non-flash)
Jul 24 17:01:43 user nova-compute[70243]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a (non-flash)
Jul 24 17:01:43 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 (non-flash)
Jul 24 17:01:43 user nova-compute[70243]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a (non-flash)
Jul 24 17:01:43 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb523cd-14e3-4f4c-a2a6-19b531faff03]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iOkBYThy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:01:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:01:44 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23132383633396339', 'path': '/dev/sdc'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:01:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132383633396339', 'path': '/dev/sdc'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:01:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1710832629',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1710832629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1710832629',id=48,image_ref='81abaa25-9497-45b9-8476-7f1a8adfd560',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgDIbpPi5QspmlH9Rl10t2mCmu4+aYjHdQUluq/Nl5S5h/UHe0odHo+Az+nC7q6jtBR9nU76HadNtxYG6IefBEOMA4d3EoVN+YS+3Sb0StWAqYbzUlor6c+jK41sdHhLg==',key_name='tempest-keypair-1912019542',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0b57210106d441e96e821af15cb9469',ramdisk_id='',reservation_id='r-lspecf2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-994857419',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-994857419-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-994857419',owner_user_name='tempest-TestVolumeBootPattern-994857419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f46574c91b549dda125d3d6874e26cc',uuid=8f1a6bfb-341b-4fe2-b371-63820bc7fb1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "589c515f-9916-4979-8968-9937e6aea85e", "address": "fa:16:3e:58:63:41", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589c515f-99", "ovs_interfaceid": "589c515f-9916-4979-8968-9937e6aea85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:01:44 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converting VIF {"id": "589c515f-9916-4979-8968-9937e6aea85e", "address": "fa:16:3e:58:63:41", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589c515f-99", "ovs_interfaceid": "589c515f-9916-4979-8968-9937e6aea85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:01:44 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:63:41,bridge_name='br-int',has_traffic_filtering=True,id=589c515f-9916-4979-8968-9937e6aea85e,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589c515f-99') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:01:44 user nova-compute[70243]: DEBUG nova.objects.instance [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:01:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:01:44 user nova-compute[70243]:   <uuid>8f1a6bfb-341b-4fe2-b371-63820bc7fb1e</uuid>
Jul 24 17:01:44 user nova-compute[70243]:   <name>instance-00000030</name>
Jul 24 17:01:44 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 17:01:44 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 17:01:44 user nova-compute[70243]:   <metadata>
Jul 24 17:01:44 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:01:44 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 17:01:44 user nova-compute[70243]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1710832629</nova:name>
Jul 24 17:01:44 user nova-compute[70243]:       <nova:creationTime>2023-07-24 17:01:42</nova:creationTime>
Jul 24 17:01:44 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 17:01:44 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 17:01:44 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 17:01:44 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 17:01:44 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:01:44 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:01:44 user nova-compute[70243]:       </nova:flavor>
Jul 24 17:01:44 user nova-compute[70243]:       <nova:owner>
Jul 24 17:01:44 user nova-compute[70243]:         <nova:user uuid="9f46574c91b549dda125d3d6874e26cc">tempest-TestVolumeBootPattern-994857419-project-member</nova:user>
Jul 24 17:01:44 user nova-compute[70243]:         <nova:project uuid="a0b57210106d441e96e821af15cb9469">tempest-TestVolumeBootPattern-994857419</nova:project>
Jul 24 17:01:44 user nova-compute[70243]:       </nova:owner>
Jul 24 17:01:44 user nova-compute[70243]:       <nova:root type="image" uuid="81abaa25-9497-45b9-8476-7f1a8adfd560"/>
Jul 24 17:01:44 user nova-compute[70243]:       <nova:ports>
Jul 24 17:01:44 user nova-compute[70243]:         <nova:port uuid="589c515f-9916-4979-8968-9937e6aea85e">
Jul 24 17:01:44 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 24 17:01:44 user nova-compute[70243]:         </nova:port>
Jul 24 17:01:44 user nova-compute[70243]:       </nova:ports>
Jul 24 17:01:44 user nova-compute[70243]:     </nova:instance>
Jul 24 17:01:44 user nova-compute[70243]:   </metadata>
Jul 24 17:01:44 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 17:01:44 user nova-compute[70243]:     <system>
Jul 24 17:01:44 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:01:44 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:01:44 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 17:01:44 user nova-compute[70243]:       <entry name="serial">8f1a6bfb-341b-4fe2-b371-63820bc7fb1e</entry>
Jul 24 17:01:44 user nova-compute[70243]:       <entry name="uuid">8f1a6bfb-341b-4fe2-b371-63820bc7fb1e</entry>
Jul 24 17:01:44 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:01:44 user nova-compute[70243]:     </system>
Jul 24 17:01:44 user nova-compute[70243]:   </sysinfo>
Jul 24 17:01:44 user nova-compute[70243]:   <os>
Jul 24 17:01:44 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:01:44 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 17:01:44 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 17:01:44 user nova-compute[70243]:   </os>
Jul 24 17:01:44 user nova-compute[70243]:   <features>
Jul 24 17:01:44 user nova-compute[70243]:     <acpi/>
Jul 24 17:01:44 user nova-compute[70243]:     <apic/>
Jul 24 17:01:44 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 17:01:44 user nova-compute[70243]:   </features>
Jul 24 17:01:44 user nova-compute[70243]:   <clock offset="utc">
Jul 24 17:01:44 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:01:44 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:01:44 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 17:01:44 user nova-compute[70243]:   </clock>
Jul 24 17:01:44 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 17:01:44 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 17:01:44 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:01:44 user nova-compute[70243]:   </cpu>
Jul 24 17:01:44 user nova-compute[70243]:   <devices>
Jul 24 17:01:44 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 17:01:44 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:01:44 user nova-compute[70243]:       <source dev="/dev/sdc"/>
Jul 24 17:01:44 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 17:01:44 user nova-compute[70243]:       <serial>8d0e31a5-d45b-427e-b688-84d32833109a</serial>
Jul 24 17:01:44 user nova-compute[70243]:     </disk>
Jul 24 17:01:44 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 17:01:44 user nova-compute[70243]:       <mac address="fa:16:3e:58:63:41"/>
Jul 24 17:01:44 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 17:01:44 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 17:01:44 user nova-compute[70243]:       <target dev="tap589c515f-99"/>
Jul 24 17:01:44 user nova-compute[70243]:     </interface>
Jul 24 17:01:44 user nova-compute[70243]:     <serial type="pty">
Jul 24 17:01:44 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/8f1a6bfb-341b-4fe2-b371-63820bc7fb1e/console.log" append="off"/>
Jul 24 17:01:44 user nova-compute[70243]:     </serial>
Jul 24 17:01:44 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:01:44 user nova-compute[70243]:     <video>
Jul 24 17:01:44 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 17:01:44 user nova-compute[70243]:     </video>
Jul 24 17:01:44 user nova-compute[70243]:     <rng model="virtio">
Jul 24 17:01:44 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:01:44 user nova-compute[70243]:     </rng>
Jul 24 17:01:44 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:01:44 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 17:01:44 user nova-compute[70243]:       <stats period="10"/>
Jul 24 17:01:44 user nova-compute[70243]:     </memballoon>
Jul 24 17:01:44 user nova-compute[70243]:   </devices>
Jul 24 17:01:44 user nova-compute[70243]: </domain>
Jul 24 17:01:44 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:01:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1710832629',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1710832629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1710832629',id=48,image_ref='81abaa25-9497-45b9-8476-7f1a8adfd560',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgDIbpPi5QspmlH9Rl10t2mCmu4+aYjHdQUluq/Nl5S5h/UHe0odHo+Az+nC7q6jtBR9nU76HadNtxYG6IefBEOMA4d3EoVN+YS+3Sb0StWAqYbzUlor6c+jK41sdHhLg==',key_name='tempest-keypair-1912019542',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0b57210106d441e96e821af15cb9469',ramdisk_id='',reservation_id='r-lspecf2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-994857419',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-994857419-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-994857419',owner_user_name='tempest-TestVolumeBootPattern-994857419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f46574c91b549dda125d3d6874e26cc',uuid=8f1a6bfb-341b-4fe2-b371-63820bc7fb1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "589c515f-9916-4979-8968-9937e6aea85e", "address": "fa:16:3e:58:63:41", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589c515f-99", "ovs_interfaceid": "589c515f-9916-4979-8968-9937e6aea85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:01:44 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converting VIF {"id": "589c515f-9916-4979-8968-9937e6aea85e", "address": "fa:16:3e:58:63:41", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589c515f-99", "ovs_interfaceid": "589c515f-9916-4979-8968-9937e6aea85e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:01:44 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:63:41,bridge_name='br-int',has_traffic_filtering=True,id=589c515f-9916-4979-8968-9937e6aea85e,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589c515f-99') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:01:44 user nova-compute[70243]: DEBUG os_vif [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:63:41,bridge_name='br-int',has_traffic_filtering=True,id=589c515f-9916-4979-8968-9937e6aea85e,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589c515f-99') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:01:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:01:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:01:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap589c515f-99, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:01:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap589c515f-99, col_values=(('external_ids', {'iface-id': '589c515f-9916-4979-8968-9937e6aea85e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:63:41', 'vm-uuid': '8f1a6bfb-341b-4fe2-b371-63820bc7fb1e'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:01:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:01:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:44 user nova-compute[70243]: INFO os_vif [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:63:41,bridge_name='br-int',has_traffic_filtering=True,id=589c515f-9916-4979-8968-9937e6aea85e,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589c515f-99')
Jul 24 17:01:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:01:44 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] No VIF found with MAC fa:16:3e:58:63:41, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:01:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:45 user nova-compute[70243]: DEBUG nova.compute.manager [req-bee71748-4bf6-405a-8f84-513aa7432f1b req-d870bd3d-274f-42ae-9434-d53d03df634c service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Received event network-vif-plugged-589c515f-9916-4979-8968-9937e6aea85e {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:01:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-bee71748-4bf6-405a-8f84-513aa7432f1b req-d870bd3d-274f-42ae-9434-d53d03df634c service nova] Acquiring lock "8f1a6bfb-341b-4fe2-b371-63820bc7fb1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:01:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-bee71748-4bf6-405a-8f84-513aa7432f1b req-d870bd3d-274f-42ae-9434-d53d03df634c service nova] Lock "8f1a6bfb-341b-4fe2-b371-63820bc7fb1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:01:45 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-bee71748-4bf6-405a-8f84-513aa7432f1b req-d870bd3d-274f-42ae-9434-d53d03df634c service nova] Lock "8f1a6bfb-341b-4fe2-b371-63820bc7fb1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:01:45 user nova-compute[70243]: DEBUG nova.compute.manager [req-bee71748-4bf6-405a-8f84-513aa7432f1b req-d870bd3d-274f-42ae-9434-d53d03df634c service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] No waiting events found dispatching network-vif-plugged-589c515f-9916-4979-8968-9937e6aea85e {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:01:45 user nova-compute[70243]: WARNING nova.compute.manager [req-bee71748-4bf6-405a-8f84-513aa7432f1b req-d870bd3d-274f-42ae-9434-d53d03df634c service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Received unexpected event network-vif-plugged-589c515f-9916-4979-8968-9937e6aea85e for instance with vm_state building and task_state spawning.
Jul 24 17:01:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:47 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690218107.7245023, 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:01:47 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] VM Resumed (Lifecycle Event)
Jul 24 17:01:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:01:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:01:47 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Instance spawned successfully.
Jul 24 17:01:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:01:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:01:47 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:01:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:01:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:01:47 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:01:47 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690218107.7270133, 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:01:47 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] VM Started (Lifecycle Event)
Jul 24 17:01:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:01:47 user nova-compute[70243]: INFO nova.compute.manager [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Took 4.85 seconds to spawn the instance on the hypervisor.
Jul 24 17:01:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:01:47 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:01:47 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:01:47 user nova-compute[70243]: DEBUG nova.compute.manager [req-32af6756-ca8b-48d0-b833-6d4d6da6f229 req-6f169fc2-c116-47d2-863c-ae512b08d444 service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Received event network-vif-plugged-589c515f-9916-4979-8968-9937e6aea85e {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:01:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-32af6756-ca8b-48d0-b833-6d4d6da6f229 req-6f169fc2-c116-47d2-863c-ae512b08d444 service nova] Acquiring lock "8f1a6bfb-341b-4fe2-b371-63820bc7fb1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:01:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-32af6756-ca8b-48d0-b833-6d4d6da6f229 req-6f169fc2-c116-47d2-863c-ae512b08d444 service nova] Lock "8f1a6bfb-341b-4fe2-b371-63820bc7fb1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:01:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-32af6756-ca8b-48d0-b833-6d4d6da6f229 req-6f169fc2-c116-47d2-863c-ae512b08d444 service nova] Lock "8f1a6bfb-341b-4fe2-b371-63820bc7fb1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:01:47 user nova-compute[70243]: DEBUG nova.compute.manager [req-32af6756-ca8b-48d0-b833-6d4d6da6f229 req-6f169fc2-c116-47d2-863c-ae512b08d444 service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] No waiting events found dispatching network-vif-plugged-589c515f-9916-4979-8968-9937e6aea85e {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:01:47 user nova-compute[70243]: WARNING nova.compute.manager [req-32af6756-ca8b-48d0-b833-6d4d6da6f229 req-6f169fc2-c116-47d2-863c-ae512b08d444 service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Received unexpected event network-vif-plugged-589c515f-9916-4979-8968-9937e6aea85e for instance with vm_state building and task_state spawning.
Jul 24 17:01:47 user nova-compute[70243]: INFO nova.compute.manager [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Took 17.62 seconds to build instance.
Jul 24 17:01:47 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-3696d356-ecf3-4bbf-b988-4d60157a72a0 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "8f1a6bfb-341b-4fe2-b371-63820bc7fb1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.715s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:01:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:01:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:02:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:02:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:02:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:02:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:02:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:02:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:02:10 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:02:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:02:15 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:02:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:02:17 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:02:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:02:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:02:21 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:02:21 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:02:21 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 17:02:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-4ea416d1-fe78-41cd-9e03-e77d898151d0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:02:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-4ea416d1-fe78-41cd-9e03-e77d898151d0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:02:21 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 17:02:21 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lazy-loading 'info_cache' on Instance uuid 4ea416d1-fe78-41cd-9e03-e77d898151d0 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:02:21 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Updating instance_info_cache with network_info: [{"id": "0c381671-6073-4a8e-98df-9574aff888d0", "address": "fa:16:3e:1d:ef:a5", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c381671-60", "ovs_interfaceid": "0c381671-6073-4a8e-98df-9574aff888d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:02:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-4ea416d1-fe78-41cd-9e03-e77d898151d0" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:02:21 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 17:02:21 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:02:21 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:02:21 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:02:22 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:02:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:02:26 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:02:27 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:02:28 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:02:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:02:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:02:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:02:28 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:02:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:02:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:02:28 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:02:28 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:02:28 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8664MB free_disk=24.128219604492188GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:02:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:02:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:02:28 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 4ea416d1-fe78-41cd-9e03-e77d898151d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:02:28 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:02:28 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:02:28 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:02:28 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:02:28 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:02:29 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:02:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:02:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:02:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:02:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:02:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:02:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:02:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:02:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:02:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:02:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:02:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:02:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:02:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:02:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:02:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:02:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:02:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:02:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:03:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:03:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:03:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:03:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:03:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:03:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:03:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:03:13 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:03:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:03:15 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:03:19 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:03:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:03:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:03:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:03:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:03:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:03:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:03:21 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:03:21 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:03:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-8f1a6bfb-341b-4fe2-b371-63820bc7fb1e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:03:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-8f1a6bfb-341b-4fe2-b371-63820bc7fb1e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:03:21 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 17:03:21 user nova-compute[70243]: DEBUG nova.compute.manager [req-8f721978-ef4b-4b8f-8e62-1f3396c41af0 req-6d64db67-128a-41d9-b150-37b00fd45d4e service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Received event network-changed-589c515f-9916-4979-8968-9937e6aea85e {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:03:21 user nova-compute[70243]: DEBUG nova.compute.manager [req-8f721978-ef4b-4b8f-8e62-1f3396c41af0 req-6d64db67-128a-41d9-b150-37b00fd45d4e service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Refreshing instance network info cache due to event network-changed-589c515f-9916-4979-8968-9937e6aea85e. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:03:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8f721978-ef4b-4b8f-8e62-1f3396c41af0 req-6d64db67-128a-41d9-b150-37b00fd45d4e service nova] Acquiring lock "refresh_cache-8f1a6bfb-341b-4fe2-b371-63820bc7fb1e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:03:21 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Updating instance_info_cache with network_info: [{"id": "589c515f-9916-4979-8968-9937e6aea85e", "address": "fa:16:3e:58:63:41", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589c515f-99", "ovs_interfaceid": "589c515f-9916-4979-8968-9937e6aea85e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:03:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-8f1a6bfb-341b-4fe2-b371-63820bc7fb1e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:03:21 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 17:03:21 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8f721978-ef4b-4b8f-8e62-1f3396c41af0 req-6d64db67-128a-41d9-b150-37b00fd45d4e service nova] Acquired lock "refresh_cache-8f1a6bfb-341b-4fe2-b371-63820bc7fb1e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:03:21 user nova-compute[70243]: DEBUG nova.network.neutron [req-8f721978-ef4b-4b8f-8e62-1f3396c41af0 req-6d64db67-128a-41d9-b150-37b00fd45d4e service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Refreshing network info cache for port 589c515f-9916-4979-8968-9937e6aea85e {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:03:21 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "8f1a6bfb-341b-4fe2-b371-63820bc7fb1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "8f1a6bfb-341b-4fe2-b371-63820bc7fb1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "8f1a6bfb-341b-4fe2-b371-63820bc7fb1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "8f1a6bfb-341b-4fe2-b371-63820bc7fb1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "8f1a6bfb-341b-4fe2-b371-63820bc7fb1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:03:22 user nova-compute[70243]: INFO nova.compute.manager [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Terminating instance
Jul 24 17:03:22 user nova-compute[70243]: DEBUG nova.compute.manager [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-5fdef7b4-0870-40df-a2c9-77b0edde1768 req-3acd7c60-2e54-43cb-a351-663fbc881d46 service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Received event network-vif-unplugged-589c515f-9916-4979-8968-9937e6aea85e {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5fdef7b4-0870-40df-a2c9-77b0edde1768 req-3acd7c60-2e54-43cb-a351-663fbc881d46 service nova] Acquiring lock "8f1a6bfb-341b-4fe2-b371-63820bc7fb1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5fdef7b4-0870-40df-a2c9-77b0edde1768 req-3acd7c60-2e54-43cb-a351-663fbc881d46 service nova] Lock "8f1a6bfb-341b-4fe2-b371-63820bc7fb1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5fdef7b4-0870-40df-a2c9-77b0edde1768 req-3acd7c60-2e54-43cb-a351-663fbc881d46 service nova] Lock "8f1a6bfb-341b-4fe2-b371-63820bc7fb1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-5fdef7b4-0870-40df-a2c9-77b0edde1768 req-3acd7c60-2e54-43cb-a351-663fbc881d46 service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] No waiting events found dispatching network-vif-unplugged-589c515f-9916-4979-8968-9937e6aea85e {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG nova.compute.manager [req-5fdef7b4-0870-40df-a2c9-77b0edde1768 req-3acd7c60-2e54-43cb-a351-663fbc881d46 service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Received event network-vif-unplugged-589c515f-9916-4979-8968-9937e6aea85e for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG nova.network.neutron [req-8f721978-ef4b-4b8f-8e62-1f3396c41af0 req-6d64db67-128a-41d9-b150-37b00fd45d4e service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Updated VIF entry in instance network info cache for port 589c515f-9916-4979-8968-9937e6aea85e. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG nova.network.neutron [req-8f721978-ef4b-4b8f-8e62-1f3396c41af0 req-6d64db67-128a-41d9-b150-37b00fd45d4e service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Updating instance_info_cache with network_info: [{"id": "589c515f-9916-4979-8968-9937e6aea85e", "address": "fa:16:3e:58:63:41", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589c515f-99", "ovs_interfaceid": "589c515f-9916-4979-8968-9937e6aea85e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-8f721978-ef4b-4b8f-8e62-1f3396c41af0 req-6d64db67-128a-41d9-b150-37b00fd45d4e service nova] Releasing lock "refresh_cache-8f1a6bfb-341b-4fe2-b371-63820bc7fb1e" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:03:22 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Instance destroyed successfully.
Jul 24 17:03:22 user nova-compute[70243]: DEBUG nova.objects.instance [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lazy-loading 'resources' on Instance uuid 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1710832629',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1710832629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1710832629',id=48,image_ref='81abaa25-9497-45b9-8476-7f1a8adfd560',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgDIbpPi5QspmlH9Rl10t2mCmu4+aYjHdQUluq/Nl5S5h/UHe0odHo+Az+nC7q6jtBR9nU76HadNtxYG6IefBEOMA4d3EoVN+YS+3Sb0StWAqYbzUlor6c+jK41sdHhLg==',key_name='tempest-keypair-1912019542',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:01:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0b57210106d441e96e821af15cb9469',ramdisk_id='',reservation_id='r-lspecf2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-994857419',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-994857419-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-994857419',owner_user_name='tempest-TestVolumeBootPattern-994857419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f46574c91b549dda125d3d6874e26cc',uuid=8f1a6bfb-341b-4fe2-b371-63820bc7fb1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "589c515f-9916-4979-8968-9937e6aea85e", "address": "fa:16:3e:58:63:41", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589c515f-99", "ovs_interfaceid": "589c515f-9916-4979-8968-9937e6aea85e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converting VIF {"id": "589c515f-9916-4979-8968-9937e6aea85e", "address": "fa:16:3e:58:63:41", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589c515f-99", "ovs_interfaceid": "589c515f-9916-4979-8968-9937e6aea85e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:63:41,bridge_name='br-int',has_traffic_filtering=True,id=589c515f-9916-4979-8968-9937e6aea85e,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589c515f-99') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG os_vif [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:63:41,bridge_name='br-int',has_traffic_filtering=True,id=589c515f-9916-4979-8968-9937e6aea85e,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589c515f-99') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap589c515f-99, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:03:22 user nova-compute[70243]: INFO os_vif [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:63:41,bridge_name='br-int',has_traffic_filtering=True,id=589c515f-9916-4979-8968-9937e6aea85e,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589c515f-99')
Jul 24 17:03:22 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iOkBYThy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:03:22 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:03:22 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b665b1a1-ce95-4d63-9a0b-d7039cf3a43a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:03:22 user nova-compute[70243]: No targets found.
Jul 24 17:03:22 user nova-compute[70243]: iSNS:
Jul 24 17:03:22 user nova-compute[70243]: No targets found.
Jul 24 17:03:22 user nova-compute[70243]: STATIC:
Jul 24 17:03:22 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9
Jul 24 17:03:22 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:03:22 user nova-compute[70243]:                 Iface Name: default
Jul 24 17:03:22 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a
Jul 24 17:03:22 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:03:22 user nova-compute[70243]:                 Iface Name: default
Jul 24 17:03:22 user nova-compute[70243]: FIRMWARE:
Jul 24 17:03:22 user nova-compute[70243]: No targets found.
Jul 24 17:03:22 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:03:22 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:03:22 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d386e71-fcf6-4ee0-bd59-2b81277966c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b75c305-addc-4c58-a045-f3f529e4bda6]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 (non-flash)
Jul 24 17:03:22 user nova-compute[70243]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a (non-flash)
Jul 24 17:03:22 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 (non-flash)
Jul 24 17:03:22 user nova-compute[70243]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a (non-flash)
Jul 24 17:03:22 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91ac5aa8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a'): ({'sdc'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Removing single pathed devices sdc {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:03:22 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[861bdcb1-5f0a-4211-851b-f7e0130c6914]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1af9df-e17d-40a8-ac01-b47b38e4d0d6]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Flushing IO for device /dev/sdc {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29f7a3f-8324-45c3-82bd-193b32599b49]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[099aedc8-4880-4d1d-83f5-41176d7f76e8]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] SCSI volumes sdc have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_61c949f9', '/dev/disk/by-id/scsi-1SCST_BIO61c949f9-128639c941e86237', '/dev/disk/by-id/scsi-23132383633396339') {{(pid=81266) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9e0710-ef0e-4482-bfaa-1acff4f07f72]: (4, None) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5452e442-af9e-4962-b1ef-74ee287db6bf]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dceff75c-b87c-4d7a-bca8-a3f951ee14c6]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a, portal: 172.16.0.220,3260]
Jul 24 17:03:23 user nova-compute[70243]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a, portal: 172.16.0.220,3260] successful.
Jul 24 17:03:23 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d0e31a5-d45b-427e-b688-84d32833109a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02d6fd8-1387-4cc2-a6a4-6381a9b794e5]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] <== disconnect_volume: return (366ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:03:23 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Deleting instance files /opt/stack/data/nova/instances/8f1a6bfb-341b-4fe2-b371-63820bc7fb1e_del
Jul 24 17:03:23 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Deletion of /opt/stack/data/nova/instances/8f1a6bfb-341b-4fe2-b371-63820bc7fb1e_del complete
Jul 24 17:03:23 user nova-compute[70243]: INFO nova.compute.manager [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Took 1.24 seconds to destroy the instance on the hypervisor.
Jul 24 17:03:23 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 17:03:23 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 17:03:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-fbab30c9-56b2-46e5-a9a8-3606d0966abc req-a6fdedb5-4bff-44a3-a298-498cecf798a1 service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Received event network-vif-plugged-589c515f-9916-4979-8968-9937e6aea85e {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:03:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fbab30c9-56b2-46e5-a9a8-3606d0966abc req-a6fdedb5-4bff-44a3-a298-498cecf798a1 service nova] Acquiring lock "8f1a6bfb-341b-4fe2-b371-63820bc7fb1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:03:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fbab30c9-56b2-46e5-a9a8-3606d0966abc req-a6fdedb5-4bff-44a3-a298-498cecf798a1 service nova] Lock "8f1a6bfb-341b-4fe2-b371-63820bc7fb1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:03:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-fbab30c9-56b2-46e5-a9a8-3606d0966abc req-a6fdedb5-4bff-44a3-a298-498cecf798a1 service nova] Lock "8f1a6bfb-341b-4fe2-b371-63820bc7fb1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:03:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-fbab30c9-56b2-46e5-a9a8-3606d0966abc req-a6fdedb5-4bff-44a3-a298-498cecf798a1 service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] No waiting events found dispatching network-vif-plugged-589c515f-9916-4979-8968-9937e6aea85e {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:03:24 user nova-compute[70243]: WARNING nova.compute.manager [req-fbab30c9-56b2-46e5-a9a8-3606d0966abc req-a6fdedb5-4bff-44a3-a298-498cecf798a1 service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Received unexpected event network-vif-plugged-589c515f-9916-4979-8968-9937e6aea85e for instance with vm_state active and task_state deleting.
Jul 24 17:03:24 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:03:24 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Took 1.09 seconds to deallocate network for instance.
Jul 24 17:03:24 user nova-compute[70243]: DEBUG nova.compute.manager [req-f53b9420-8190-4ac2-8005-fdbe8b2b38b0 req-fc515dec-2fa1-45ae-854f-09ab0cdb76e6 service nova] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Received event network-vif-deleted-589c515f-9916-4979-8968-9937e6aea85e {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:03:25 user nova-compute[70243]: INFO nova.compute.manager [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Took 0.82 seconds to detach 1 volumes for instance.
Jul 24 17:03:25 user nova-compute[70243]: DEBUG nova.compute.manager [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Deleting volume: 8d0e31a5-d45b-427e-b688-84d32833109a {{(pid=70243) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 24 17:03:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:03:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:03:25 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:03:25 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:03:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:03:25 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Deleted allocations for instance 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e
Jul 24 17:03:25 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-486cc618-dfd7-4a15-a371-924b4a753645 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "8f1a6bfb-341b-4fe2-b371-63820bc7fb1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.555s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:03:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:03:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:03:28 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:03:28 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:03:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:03:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:03:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:03:28 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:03:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:03:28 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:03:28 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:03:28 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8766MB free_disk=24.12734603881836GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:03:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:03:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:03:28 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 4ea416d1-fe78-41cd-9e03-e77d898151d0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:03:28 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:03:28 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:03:28 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:03:28 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:03:28 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:03:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:03:32 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:03:37 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690218202.8076358, 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:03:37 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] VM Stopped (Lifecycle Event)
Jul 24 17:03:37 user nova-compute[70243]: DEBUG nova.compute.manager [None req-a2b4254a-5892-4d26-84be-a2e759ee9fbf None None] [instance: 8f1a6bfb-341b-4fe2-b371-63820bc7fb1e] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:03:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:03:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:03:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:03:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:03:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:04:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:04:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:04:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:04:12 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:04:16 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:04:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "4ea416d1-fe78-41cd-9e03-e77d898151d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:04:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "4ea416d1-fe78-41cd-9e03-e77d898151d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:04:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "4ea416d1-fe78-41cd-9e03-e77d898151d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:04:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "4ea416d1-fe78-41cd-9e03-e77d898151d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:04:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "4ea416d1-fe78-41cd-9e03-e77d898151d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:04:16 user nova-compute[70243]: INFO nova.compute.manager [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Terminating instance
Jul 24 17:04:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 17:04:16 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:04:16 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:04:16 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:04:16 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:04:16 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG nova.compute.manager [req-67c6b3b2-9864-47b0-b86a-625af6522a37 req-1243335c-f96c-4a3a-bf61-d932f03392fb service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Received event network-vif-unplugged-0c381671-6073-4a8e-98df-9574aff888d0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-67c6b3b2-9864-47b0-b86a-625af6522a37 req-1243335c-f96c-4a3a-bf61-d932f03392fb service nova] Acquiring lock "4ea416d1-fe78-41cd-9e03-e77d898151d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-67c6b3b2-9864-47b0-b86a-625af6522a37 req-1243335c-f96c-4a3a-bf61-d932f03392fb service nova] Lock "4ea416d1-fe78-41cd-9e03-e77d898151d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-67c6b3b2-9864-47b0-b86a-625af6522a37 req-1243335c-f96c-4a3a-bf61-d932f03392fb service nova] Lock "4ea416d1-fe78-41cd-9e03-e77d898151d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG nova.compute.manager [req-67c6b3b2-9864-47b0-b86a-625af6522a37 req-1243335c-f96c-4a3a-bf61-d932f03392fb service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] No waiting events found dispatching network-vif-unplugged-0c381671-6073-4a8e-98df-9574aff888d0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG nova.compute.manager [req-67c6b3b2-9864-47b0-b86a-625af6522a37 req-1243335c-f96c-4a3a-bf61-d932f03392fb service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Received event network-vif-unplugged-0c381671-6073-4a8e-98df-9574aff888d0 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:04:17 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Instance destroyed successfully.
Jul 24 17:04:17 user nova-compute[70243]: DEBUG nova.objects.instance [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lazy-loading 'resources' on Instance uuid 4ea416d1-fe78-41cd-9e03-e77d898151d0 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T16:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-530480187',display_name='tempest-TestVolumeBootPattern-volume-backed-server-530480187',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-530480187',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImCFTJvpYzDQS8Q/mv5t99CZwW3g6Bvtx0j/A+ne4ni2EacAjmSl83e87FwOv426F0pBCGV6NmS5WMpT+zzR5aFfQdQRnHlulY49f9frnxTgiJVMMial83BWPEmKb1QEQ==',key_name='tempest-keypair-856796068',keypairs=<?>,launch_index=0,launched_at=2023-07-24T16:59:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0b57210106d441e96e821af15cb9469',ramdisk_id='',reservation_id='r-4gdlictl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-994857419',owner_user_name='tempest-TestVolumeBootPattern-994857419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T16:59:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f46574c91b549dda125d3d6874e26cc',uuid=4ea416d1-fe78-41cd-9e03-e77d898151d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c381671-6073-4a8e-98df-9574aff888d0", "address": "fa:16:3e:1d:ef:a5", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c381671-60", "ovs_interfaceid": "0c381671-6073-4a8e-98df-9574aff888d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converting VIF {"id": "0c381671-6073-4a8e-98df-9574aff888d0", "address": "fa:16:3e:1d:ef:a5", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c381671-60", "ovs_interfaceid": "0c381671-6073-4a8e-98df-9574aff888d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:ef:a5,bridge_name='br-int',has_traffic_filtering=True,id=0c381671-6073-4a8e-98df-9574aff888d0,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c381671-60') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG os_vif [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:ef:a5,bridge_name='br-int',has_traffic_filtering=True,id=0c381671-6073-4a8e-98df-9574aff888d0,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c381671-60') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c381671-60, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:04:17 user nova-compute[70243]: INFO os_vif [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:ef:a5,bridge_name='br-int',has_traffic_filtering=True,id=0c381671-6073-4a8e-98df-9574aff888d0,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c381671-60')
Jul 24 17:04:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'culLOvkW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:04:17 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:04:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3896bc-aab0-495c-b97e-46c92a3303db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:04:17 user nova-compute[70243]: No targets found.
Jul 24 17:04:17 user nova-compute[70243]: iSNS:
Jul 24 17:04:17 user nova-compute[70243]: No targets found.
Jul 24 17:04:17 user nova-compute[70243]: STATIC:
Jul 24 17:04:17 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9
Jul 24 17:04:17 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:04:17 user nova-compute[70243]:                 Iface Name: default
Jul 24 17:04:17 user nova-compute[70243]: FIRMWARE:
Jul 24 17:04:17 user nova-compute[70243]: No targets found.
Jul 24 17:04:17 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:04:17 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:04:17 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79ceef4-4b5e-43f7-9aa8-1419f391ee12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a8798c-465a-4e47-babd-509a8c81be32]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 (non-flash)
Jul 24 17:04:17 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 (non-flash)
Jul 24 17:04:17 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91ac5aa0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9'): ({'sdb'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Removing single pathed devices sdb {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de7d907-9907-4d8f-85ed-1fc0e3894294]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf920e7-a03e-4dc6-ad07-abeebefc10c9]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Flushing IO for device /dev/sdb {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c82cce2-cd89-49a1-9750-82c72ea7efc0]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a543f2-a5d2-4900-b1a0-74755ea9a5ec]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe4b64e12-e4f1ab6c97a36d9f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e4b64e12', '/dev/disk/by-id/scsi-26534663161623663') {{(pid=81266) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3d0c69-a0ef-4786-873b-5c6dc39b08c4]: (4, None) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8e25f1-92cb-470f-958f-866af2d34851]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7820c7c1-a025-4e0e-a8ac-6d9d8867e4be]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9, portal: 172.16.0.220,3260]
Jul 24 17:04:17 user nova-compute[70243]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9, portal: 172.16.0.220,3260] successful.
Jul 24 17:04:17 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:113e5e69-7001-42c5-b86a-fcee55a4a0a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9df4284-9295-4241-b000-d0552bd2df3c]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] <== disconnect_volume: return (291ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:04:17 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Deleting instance files /opt/stack/data/nova/instances/4ea416d1-fe78-41cd-9e03-e77d898151d0_del
Jul 24 17:04:17 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Deletion of /opt/stack/data/nova/instances/4ea416d1-fe78-41cd-9e03-e77d898151d0_del complete
Jul 24 17:04:17 user nova-compute[70243]: INFO nova.compute.manager [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Took 1.13 seconds to destroy the instance on the hypervisor.
Jul 24 17:04:17 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 17:04:17 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 17:04:18 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:04:18 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Took 0.87 seconds to deallocate network for instance.
Jul 24 17:04:18 user nova-compute[70243]: DEBUG nova.compute.manager [req-35d6e46b-38ff-4c70-a1f1-189a303702d7 req-59a40b39-da67-48d7-a1cb-f4da1e08f090 service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Received event network-vif-deleted-0c381671-6073-4a8e-98df-9574aff888d0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:04:18 user nova-compute[70243]: INFO nova.compute.manager [req-35d6e46b-38ff-4c70-a1f1-189a303702d7 req-59a40b39-da67-48d7-a1cb-f4da1e08f090 service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Neutron deleted interface 0c381671-6073-4a8e-98df-9574aff888d0; detaching it from the instance and deleting it from the info cache
Jul 24 17:04:18 user nova-compute[70243]: DEBUG nova.network.neutron [req-35d6e46b-38ff-4c70-a1f1-189a303702d7 req-59a40b39-da67-48d7-a1cb-f4da1e08f090 service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:04:18 user nova-compute[70243]: DEBUG nova.compute.manager [req-35d6e46b-38ff-4c70-a1f1-189a303702d7 req-59a40b39-da67-48d7-a1cb-f4da1e08f090 service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Detach interface failed, port_id=0c381671-6073-4a8e-98df-9574aff888d0, reason: Instance 4ea416d1-fe78-41cd-9e03-e77d898151d0 could not be found. {{(pid=70243) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10846}}
Jul 24 17:04:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-9bd9345d-c82b-45fa-ab9a-a629815756c8 req-0122ff20-cae7-4928-a4d1-7fd17d2607d3 service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Received event network-vif-plugged-0c381671-6073-4a8e-98df-9574aff888d0 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:04:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9bd9345d-c82b-45fa-ab9a-a629815756c8 req-0122ff20-cae7-4928-a4d1-7fd17d2607d3 service nova] Acquiring lock "4ea416d1-fe78-41cd-9e03-e77d898151d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:04:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9bd9345d-c82b-45fa-ab9a-a629815756c8 req-0122ff20-cae7-4928-a4d1-7fd17d2607d3 service nova] Lock "4ea416d1-fe78-41cd-9e03-e77d898151d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:04:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9bd9345d-c82b-45fa-ab9a-a629815756c8 req-0122ff20-cae7-4928-a4d1-7fd17d2607d3 service nova] Lock "4ea416d1-fe78-41cd-9e03-e77d898151d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:04:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-9bd9345d-c82b-45fa-ab9a-a629815756c8 req-0122ff20-cae7-4928-a4d1-7fd17d2607d3 service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] No waiting events found dispatching network-vif-plugged-0c381671-6073-4a8e-98df-9574aff888d0 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:04:19 user nova-compute[70243]: WARNING nova.compute.manager [req-9bd9345d-c82b-45fa-ab9a-a629815756c8 req-0122ff20-cae7-4928-a4d1-7fd17d2607d3 service nova] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Received unexpected event network-vif-plugged-0c381671-6073-4a8e-98df-9574aff888d0 for instance with vm_state active and task_state deleting.
Jul 24 17:04:19 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:04:19 user nova-compute[70243]: INFO nova.compute.manager [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Took 0.70 seconds to detach 1 volumes for instance.
Jul 24 17:04:19 user nova-compute[70243]: DEBUG nova.compute.manager [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Deleting volume: 113e5e69-7001-42c5-b86a-fcee55a4a0a9 {{(pid=70243) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3220}}
Jul 24 17:04:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:04:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:04:19 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:04:19 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:04:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:04:19 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Deleted allocations for instance 4ea416d1-fe78-41cd-9e03-e77d898151d0
Jul 24 17:04:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-2ee9dfdc-171d-4e8f-8cda-d24489160794 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "4ea416d1-fe78-41cd-9e03-e77d898151d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.058s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:04:21 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:04:22 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:04:22 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:04:22 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 17:04:22 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Didn't find any instances for network info cache update. {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 17:04:22 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:04:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:04:23 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:04:23 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:04:23 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:04:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:04:30 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:04:30 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:04:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:04:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:04:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:04:30 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:04:30 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:04:30 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:04:30 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8929MB free_disk=24.12643051147461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:04:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:04:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:04:30 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:04:30 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:04:30 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:04:30 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:04:30 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:04:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:04:31 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:04:32 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690218257.4877024, 4ea416d1-fe78-41cd-9e03-e77d898151d0 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:04:32 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] VM Stopped (Lifecycle Event)
Jul 24 17:04:32 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:04:32 user nova-compute[70243]: DEBUG nova.compute.manager [None req-fb79106c-6df4-428f-9733-40d032ccfa3c None None] [instance: 4ea416d1-fe78-41cd-9e03-e77d898151d0] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:04:33 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:04:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70243) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 17:04:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:04:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:04:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:04:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:04:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:04:37 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:04:42 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:04:47 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:04:50 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:04:50 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Cleaning up deleted instances {{(pid=70243) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 17:04:50 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] There are 0 instances to clean {{(pid=70243) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 17:04:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:04:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:04:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:04:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:04:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:04:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:04:57 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:05:02 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:05:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:05:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:05:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:05:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:05:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:05:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:05:07 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:05:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:05:13 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:05:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "e2e3042d-ba33-460a-8a39-d3a8376450d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:05:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "e2e3042d-ba33-460a-8a39-d3a8376450d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:05:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:05:17 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:05:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:05:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:05:17 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:05:17 user nova-compute[70243]: INFO nova.compute.claims [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Claim successful on node user
Jul 24 17:05:17 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:05:17 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:05:17 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:05:17 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:05:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:05:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:05:17 user nova-compute[70243]: DEBUG nova.network.neutron [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:05:17 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:05:17 user nova-compute[70243]: DEBUG nova.compute.manager [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:05:18 user nova-compute[70243]: INFO nova.virt.block_device [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Booting with volume 18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb at /dev/vda
Jul 24 17:05:18 user nova-compute[70243]: DEBUG nova.policy [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f46574c91b549dda125d3d6874e26cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b57210106d441e96e821af15cb9469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:05:18 user nova-compute[70243]: DEBUG os_brick.utils [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:05:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:05:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:05:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e62adc-bcb6-414e-99e6-c97a76ed8f06]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:05:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:05:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:05:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adcda8c-2c97-45e2-84a5-357aa77d31a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:05:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:05:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:05:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a81a0de-ada8-4326-b93b-53a6611e15d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:05:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4601ef41-646f-413a-89bf-45453735bd0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:05:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:05:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:05:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:05:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:05:18 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:05:18 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:05:18 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b7b416-b6ce-46cd-941a-9a23517eaf29]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:05:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:05:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:05:18 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:05:18 user nova-compute[70243]: DEBUG os_brick.utils [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:05:18 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Updating existing volume attachment record: 122bedc1-323d-48ad-94bb-b75f1de97a48 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:05:18 user nova-compute[70243]: DEBUG nova.network.neutron [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Successfully created port: 37a01c90-ad06-4911-92d4-92d627844f4a {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:05:19 user nova-compute[70243]: DEBUG nova.network.neutron [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Successfully updated port: 37a01c90-ad06-4911-92d4-92d627844f4a {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:05:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "refresh_cache-e2e3042d-ba33-460a-8a39-d3a8376450d5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:05:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquired lock "refresh_cache-e2e3042d-ba33-460a-8a39-d3a8376450d5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:05:19 user nova-compute[70243]: DEBUG nova.network.neutron [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:05:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-cb032ae0-63fb-4ea8-8abe-95800652df8c req-1739cd47-fb62-42cd-88fe-c6058b8e4ef5 service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Received event network-changed-37a01c90-ad06-4911-92d4-92d627844f4a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:05:19 user nova-compute[70243]: DEBUG nova.compute.manager [req-cb032ae0-63fb-4ea8-8abe-95800652df8c req-1739cd47-fb62-42cd-88fe-c6058b8e4ef5 service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Refreshing instance network info cache due to event network-changed-37a01c90-ad06-4911-92d4-92d627844f4a. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:05:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cb032ae0-63fb-4ea8-8abe-95800652df8c req-1739cd47-fb62-42cd-88fe-c6058b8e4ef5 service nova] Acquiring lock "refresh_cache-e2e3042d-ba33-460a-8a39-d3a8376450d5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:05:19 user nova-compute[70243]: DEBUG nova.network.neutron [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:05:19 user nova-compute[70243]: DEBUG nova.network.neutron [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Updating instance_info_cache with network_info: [{"id": "37a01c90-ad06-4911-92d4-92d627844f4a", "address": "fa:16:3e:af:6a:37", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37a01c90-ad", "ovs_interfaceid": "37a01c90-ad06-4911-92d4-92d627844f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:05:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Releasing lock "refresh_cache-e2e3042d-ba33-460a-8a39-d3a8376450d5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:05:19 user nova-compute[70243]: DEBUG nova.compute.manager [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Instance network_info: |[{"id": "37a01c90-ad06-4911-92d4-92d627844f4a", "address": "fa:16:3e:af:6a:37", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37a01c90-ad", "ovs_interfaceid": "37a01c90-ad06-4911-92d4-92d627844f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:05:19 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cb032ae0-63fb-4ea8-8abe-95800652df8c req-1739cd47-fb62-42cd-88fe-c6058b8e4ef5 service nova] Acquired lock "refresh_cache-e2e3042d-ba33-460a-8a39-d3a8376450d5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:05:19 user nova-compute[70243]: DEBUG nova.network.neutron [req-cb032ae0-63fb-4ea8-8abe-95800652df8c req-1739cd47-fb62-42cd-88fe-c6058b8e4ef5 service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Refreshing network info cache for port 37a01c90-ad06-4911-92d4-92d627844f4a {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:05:20 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:05:20 user nova-compute[70243]: DEBUG nova.network.neutron [req-cb032ae0-63fb-4ea8-8abe-95800652df8c req-1739cd47-fb62-42cd-88fe-c6058b8e4ef5 service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Updated VIF entry in instance network info cache for port 37a01c90-ad06-4911-92d4-92d627844f4a. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:05:20 user nova-compute[70243]: DEBUG nova.network.neutron [req-cb032ae0-63fb-4ea8-8abe-95800652df8c req-1739cd47-fb62-42cd-88fe-c6058b8e4ef5 service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Updating instance_info_cache with network_info: [{"id": "37a01c90-ad06-4911-92d4-92d627844f4a", "address": "fa:16:3e:af:6a:37", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37a01c90-ad", "ovs_interfaceid": "37a01c90-ad06-4911-92d4-92d627844f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:05:20 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-cb032ae0-63fb-4ea8-8abe-95800652df8c req-1739cd47-fb62-42cd-88fe-c6058b8e4ef5 service nova] Releasing lock "refresh_cache-e2e3042d-ba33-460a-8a39-d3a8376450d5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:05:22 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:05:22 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:05:22 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 17:05:22 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Skipping network cache update for instance because it is Building. {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9835}}
Jul 24 17:05:22 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Didn't find any instances for network info cache update. {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 17:05:22 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:05:23 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:05:24 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:05:24 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:05:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:05:27 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:05:27 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_power_states {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:05:27 user nova-compute[70243]: WARNING nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] While synchronizing instance power states, found 1 instances in the database and 0 instances on the hypervisor.
Jul 24 17:05:27 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Triggering sync for uuid e2e3042d-ba33-460a-8a39-d3a8376450d5 {{(pid=70243) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10232}}
Jul 24 17:05:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "e2e3042d-ba33-460a-8a39-d3a8376450d5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG nova.compute.manager [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:05:28 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Creating image(s)
Jul 24 17:05:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Did not create local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Ensure instance console log exists: /opt/stack/data/nova/instances/e2e3042d-ba33-460a-8a39-d3a8376450d5/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Start _get_guest_xml network_info=[{"id": "37a01c90-ad06-4911-92d4-92d627844f4a", "address": "fa:16:3e:af:6a:37", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37a01c90-ad", "ovs_interfaceid": "37a01c90-ad06-4911-92d4-92d627844f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iZRgAkJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e2e3042d-ba33-460a-8a39-d3a8376450d5', 'attached_at': '', 'detached_at': '', 'volume_id': '18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb', 'serial': '18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '122bedc1-323d-48ad-94bb-b75f1de97a48', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:05:28 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:05:28 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:05:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iZRgAkJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:05:28 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:05:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:05:28 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:05:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:05:28 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[61739431-f140-41bb-b0f3-fa5e2ced577c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:05:28 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ddec17-c3ad-4144-8c5b-1d95c6cb5fc1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb] added
Jul 24 17:05:28 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b470b1b-e613-4ff2-958d-fd618df9c404]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd59f3a7-dd74-4c6c-9ff5-cad185edd285]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iZRgAkJQ {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iZRgAkJQ" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ccd5e8-a25e-453b-94de-38cc3f71581d]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iZRgAkJQ'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72c05b0-971a-4874-9ef4-be823154132c]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[da401d2b-9991-4d74-9d59-a59af6bfdb90]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 17:05:28 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 17:05:28 user nova-compute[70243]:  {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:05:28 user nova-compute[70243]: WARNING os_brick.initiator.connectors.iscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 17:05:28 user nova-compute[70243]: 
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[82efae75-4654-4db8-8122-29fc363a7d36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb, portal: 172.16.0.220,3260]
Jul 24 17:05:28 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb, portal: 172.16.0.220,3260] successful.
Jul 24 17:05:28 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4229a3-ebda-4324-b7ec-d66965f8336e]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[85167c96-9914-4a86-b4c1-0913d965dda2]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb (non-flash)
Jul 24 17:05:28 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb (non-flash)
Jul 24 17:05:28 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d950155d-c261-4aa3-9517-02b4faa2fc4b]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:05:28 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iZRgAkJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23135343162366261', 'path': '/dev/sdb'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135343162366261', 'path': '/dev/sdb'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-67740414',display_name='tempest-TestVolumeBootPattern-server-67740414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-67740414',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMa+Vfiu/hyBL6BjsKJMeUEZCpZEnJguBpbnuOLc84nZ65lifnwNPBAJSJztB2ZLidwnYoqrUnP9nJwiTuHlVXDJeVaK2xFSB8j3KUXPjcp7h8GbVzopH4gkVftS/l/s7w==',key_name='tempest-TestVolumeBootPattern-1868423947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0b57210106d441e96e821af15cb9469',ramdisk_id='',reservation_id='r-ecorh092',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-994857419',owner_user_name='tempest-TestVolumeBootPattern-994857419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:05:18Z,user_data=None,user_id='9f46574c91b549dda125d3d6874e26cc',uuid=e2e3042d-ba33-460a-8a39-d3a8376450d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37a01c90-ad06-4911-92d4-92d627844f4a", "address": "fa:16:3e:af:6a:37", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37a01c90-ad", "ovs_interfaceid": "37a01c90-ad06-4911-92d4-92d627844f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converting VIF {"id": "37a01c90-ad06-4911-92d4-92d627844f4a", "address": "fa:16:3e:af:6a:37", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37a01c90-ad", "ovs_interfaceid": "37a01c90-ad06-4911-92d4-92d627844f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:6a:37,bridge_name='br-int',has_traffic_filtering=True,id=37a01c90-ad06-4911-92d4-92d627844f4a,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37a01c90-ad') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG nova.objects.instance [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lazy-loading 'pci_devices' on Instance uuid e2e3042d-ba33-460a-8a39-d3a8376450d5 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:05:29 user nova-compute[70243]:   <uuid>e2e3042d-ba33-460a-8a39-d3a8376450d5</uuid>
Jul 24 17:05:29 user nova-compute[70243]:   <name>instance-00000031</name>
Jul 24 17:05:29 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 17:05:29 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 17:05:29 user nova-compute[70243]:   <metadata>
Jul 24 17:05:29 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:05:29 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 17:05:29 user nova-compute[70243]:       <nova:name>tempest-TestVolumeBootPattern-server-67740414</nova:name>
Jul 24 17:05:29 user nova-compute[70243]:       <nova:creationTime>2023-07-24 17:05:28</nova:creationTime>
Jul 24 17:05:29 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 17:05:29 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 17:05:29 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 17:05:29 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 17:05:29 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:05:29 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:05:29 user nova-compute[70243]:       </nova:flavor>
Jul 24 17:05:29 user nova-compute[70243]:       <nova:owner>
Jul 24 17:05:29 user nova-compute[70243]:         <nova:user uuid="9f46574c91b549dda125d3d6874e26cc">tempest-TestVolumeBootPattern-994857419-project-member</nova:user>
Jul 24 17:05:29 user nova-compute[70243]:         <nova:project uuid="a0b57210106d441e96e821af15cb9469">tempest-TestVolumeBootPattern-994857419</nova:project>
Jul 24 17:05:29 user nova-compute[70243]:       </nova:owner>
Jul 24 17:05:29 user nova-compute[70243]:       <nova:ports>
Jul 24 17:05:29 user nova-compute[70243]:         <nova:port uuid="37a01c90-ad06-4911-92d4-92d627844f4a">
Jul 24 17:05:29 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 24 17:05:29 user nova-compute[70243]:         </nova:port>
Jul 24 17:05:29 user nova-compute[70243]:       </nova:ports>
Jul 24 17:05:29 user nova-compute[70243]:     </nova:instance>
Jul 24 17:05:29 user nova-compute[70243]:   </metadata>
Jul 24 17:05:29 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 17:05:29 user nova-compute[70243]:     <system>
Jul 24 17:05:29 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:05:29 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:05:29 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 17:05:29 user nova-compute[70243]:       <entry name="serial">e2e3042d-ba33-460a-8a39-d3a8376450d5</entry>
Jul 24 17:05:29 user nova-compute[70243]:       <entry name="uuid">e2e3042d-ba33-460a-8a39-d3a8376450d5</entry>
Jul 24 17:05:29 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:05:29 user nova-compute[70243]:     </system>
Jul 24 17:05:29 user nova-compute[70243]:   </sysinfo>
Jul 24 17:05:29 user nova-compute[70243]:   <os>
Jul 24 17:05:29 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:05:29 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 17:05:29 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 17:05:29 user nova-compute[70243]:   </os>
Jul 24 17:05:29 user nova-compute[70243]:   <features>
Jul 24 17:05:29 user nova-compute[70243]:     <acpi/>
Jul 24 17:05:29 user nova-compute[70243]:     <apic/>
Jul 24 17:05:29 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 17:05:29 user nova-compute[70243]:   </features>
Jul 24 17:05:29 user nova-compute[70243]:   <clock offset="utc">
Jul 24 17:05:29 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:05:29 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:05:29 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 17:05:29 user nova-compute[70243]:   </clock>
Jul 24 17:05:29 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 17:05:29 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 17:05:29 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:05:29 user nova-compute[70243]:   </cpu>
Jul 24 17:05:29 user nova-compute[70243]:   <devices>
Jul 24 17:05:29 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 17:05:29 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:05:29 user nova-compute[70243]:       <source dev="/dev/sdb"/>
Jul 24 17:05:29 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 17:05:29 user nova-compute[70243]:       <serial>18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb</serial>
Jul 24 17:05:29 user nova-compute[70243]:     </disk>
Jul 24 17:05:29 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 17:05:29 user nova-compute[70243]:       <mac address="fa:16:3e:af:6a:37"/>
Jul 24 17:05:29 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 17:05:29 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 17:05:29 user nova-compute[70243]:       <target dev="tap37a01c90-ad"/>
Jul 24 17:05:29 user nova-compute[70243]:     </interface>
Jul 24 17:05:29 user nova-compute[70243]:     <serial type="pty">
Jul 24 17:05:29 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/e2e3042d-ba33-460a-8a39-d3a8376450d5/console.log" append="off"/>
Jul 24 17:05:29 user nova-compute[70243]:     </serial>
Jul 24 17:05:29 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:05:29 user nova-compute[70243]:     <video>
Jul 24 17:05:29 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 17:05:29 user nova-compute[70243]:     </video>
Jul 24 17:05:29 user nova-compute[70243]:     <rng model="virtio">
Jul 24 17:05:29 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:05:29 user nova-compute[70243]:     </rng>
Jul 24 17:05:29 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:05:29 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 17:05:29 user nova-compute[70243]:       <stats period="10"/>
Jul 24 17:05:29 user nova-compute[70243]:     </memballoon>
Jul 24 17:05:29 user nova-compute[70243]:   </devices>
Jul 24 17:05:29 user nova-compute[70243]: </domain>
Jul 24 17:05:29 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-67740414',display_name='tempest-TestVolumeBootPattern-server-67740414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-67740414',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMa+Vfiu/hyBL6BjsKJMeUEZCpZEnJguBpbnuOLc84nZ65lifnwNPBAJSJztB2ZLidwnYoqrUnP9nJwiTuHlVXDJeVaK2xFSB8j3KUXPjcp7h8GbVzopH4gkVftS/l/s7w==',key_name='tempest-TestVolumeBootPattern-1868423947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0b57210106d441e96e821af15cb9469',ramdisk_id='',reservation_id='r-ecorh092',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-994857419',owner_user_name='tempest-TestVolumeBootPattern-994857419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:05:18Z,user_data=None,user_id='9f46574c91b549dda125d3d6874e26cc',uuid=e2e3042d-ba33-460a-8a39-d3a8376450d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37a01c90-ad06-4911-92d4-92d627844f4a", "address": "fa:16:3e:af:6a:37", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37a01c90-ad", "ovs_interfaceid": "37a01c90-ad06-4911-92d4-92d627844f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converting VIF {"id": "37a01c90-ad06-4911-92d4-92d627844f4a", "address": "fa:16:3e:af:6a:37", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37a01c90-ad", "ovs_interfaceid": "37a01c90-ad06-4911-92d4-92d627844f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:6a:37,bridge_name='br-int',has_traffic_filtering=True,id=37a01c90-ad06-4911-92d4-92d627844f4a,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37a01c90-ad') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG os_vif [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:6a:37,bridge_name='br-int',has_traffic_filtering=True,id=37a01c90-ad06-4911-92d4-92d627844f4a,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37a01c90-ad') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37a01c90-ad, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37a01c90-ad, col_values=(('external_ids', {'iface-id': '37a01c90-ad06-4911-92d4-92d627844f4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:6a:37', 'vm-uuid': 'e2e3042d-ba33-460a-8a39-d3a8376450d5'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:05:29 user nova-compute[70243]: INFO os_vif [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:6a:37,bridge_name='br-int',has_traffic_filtering=True,id=37a01c90-ad06-4911-92d4-92d627844f4a,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37a01c90-ad')
Jul 24 17:05:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:05:29 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] No VIF found with MAC fa:16:3e:af:6a:37, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:05:30 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:05:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:05:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:05:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:05:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:05:31 user nova-compute[70243]: DEBUG nova.compute.manager [req-1fa7b665-84a2-4dc1-a53e-21fe54137846 req-a73fc48d-ff8e-4797-955c-a58f3a4ba8f1 service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Received event network-vif-plugged-37a01c90-ad06-4911-92d4-92d627844f4a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:05:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1fa7b665-84a2-4dc1-a53e-21fe54137846 req-a73fc48d-ff8e-4797-955c-a58f3a4ba8f1 service nova] Acquiring lock "e2e3042d-ba33-460a-8a39-d3a8376450d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:05:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1fa7b665-84a2-4dc1-a53e-21fe54137846 req-a73fc48d-ff8e-4797-955c-a58f3a4ba8f1 service nova] Lock "e2e3042d-ba33-460a-8a39-d3a8376450d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:05:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-1fa7b665-84a2-4dc1-a53e-21fe54137846 req-a73fc48d-ff8e-4797-955c-a58f3a4ba8f1 service nova] Lock "e2e3042d-ba33-460a-8a39-d3a8376450d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:05:31 user nova-compute[70243]: DEBUG nova.compute.manager [req-1fa7b665-84a2-4dc1-a53e-21fe54137846 req-a73fc48d-ff8e-4797-955c-a58f3a4ba8f1 service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] No waiting events found dispatching network-vif-plugged-37a01c90-ad06-4911-92d4-92d627844f4a {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:05:31 user nova-compute[70243]: WARNING nova.compute.manager [req-1fa7b665-84a2-4dc1-a53e-21fe54137846 req-a73fc48d-ff8e-4797-955c-a58f3a4ba8f1 service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Received unexpected event network-vif-plugged-37a01c90-ad06-4911-92d4-92d627844f4a for instance with vm_state building and task_state spawning.
Jul 24 17:05:31 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:05:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:05:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:05:31 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:05:31 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:05:31 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690218332.9259973, e2e3042d-ba33-460a-8a39-d3a8376450d5 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:05:33 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] VM Resumed (Lifecycle Event)
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.compute.manager [req-0dd58444-9c85-4ddd-a3ae-17dcabe6cd18 req-1b7e5157-9dad-41cf-abb5-f129eebf6b3f service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Received event network-vif-plugged-37a01c90-ad06-4911-92d4-92d627844f4a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0dd58444-9c85-4ddd-a3ae-17dcabe6cd18 req-1b7e5157-9dad-41cf-abb5-f129eebf6b3f service nova] Acquiring lock "e2e3042d-ba33-460a-8a39-d3a8376450d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0dd58444-9c85-4ddd-a3ae-17dcabe6cd18 req-1b7e5157-9dad-41cf-abb5-f129eebf6b3f service nova] Lock "e2e3042d-ba33-460a-8a39-d3a8376450d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-0dd58444-9c85-4ddd-a3ae-17dcabe6cd18 req-1b7e5157-9dad-41cf-abb5-f129eebf6b3f service nova] Lock "e2e3042d-ba33-460a-8a39-d3a8376450d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.compute.manager [req-0dd58444-9c85-4ddd-a3ae-17dcabe6cd18 req-1b7e5157-9dad-41cf-abb5-f129eebf6b3f service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] No waiting events found dispatching network-vif-plugged-37a01c90-ad06-4911-92d4-92d627844f4a {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:05:33 user nova-compute[70243]: WARNING nova.compute.manager [req-0dd58444-9c85-4ddd-a3ae-17dcabe6cd18 req-1b7e5157-9dad-41cf-abb5-f129eebf6b3f service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Received unexpected event network-vif-plugged-37a01c90-ad06-4911-92d4-92d627844f4a for instance with vm_state building and task_state spawning.
Jul 24 17:05:33 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Instance spawned successfully.
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:05:33 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:05:33 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8868MB free_disk=24.11690902709961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:05:33 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690218332.926756, e2e3042d-ba33-460a-8a39-d3a8376450d5 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:05:33 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] VM Started (Lifecycle Event)
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:05:33 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:05:33 user nova-compute[70243]: INFO nova.compute.manager [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Took 5.20 seconds to spawn the instance on the hypervisor.
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.compute.manager [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance e2e3042d-ba33-460a-8a39-d3a8376450d5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:05:33 user nova-compute[70243]: INFO nova.compute.manager [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Took 16.18 seconds to build instance.
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing inventories for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-fa9d256d-892f-4a01-bd56-af2636a3ce9d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "e2e3042d-ba33-460a-8a39-d3a8376450d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.290s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "e2e3042d-ba33-460a-8a39-d3a8376450d5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.713s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:05:33 user nova-compute[70243]: INFO nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Jul 24 17:05:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "e2e3042d-ba33-460a-8a39-d3a8376450d5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Updating ProviderTree inventory for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Updating inventory in ProviderTree for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing aggregate associations for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0, aggregates: None {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing trait associations for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0, traits: HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:05:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:05:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:05:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:05:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:05:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:05:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:05:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:05:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:05:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:05:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:06:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:06:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:06:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:06:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:06:15 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:06:18 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:06:19 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:06:21 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:06:24 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:06:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:06:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 17:06:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-e2e3042d-ba33-460a-8a39-d3a8376450d5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:06:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-e2e3042d-ba33-460a-8a39-d3a8376450d5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:06:24 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 17:06:24 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lazy-loading 'info_cache' on Instance uuid e2e3042d-ba33-460a-8a39-d3a8376450d5 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:06:24 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:06:24 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Updating instance_info_cache with network_info: [{"id": "37a01c90-ad06-4911-92d4-92d627844f4a", "address": "fa:16:3e:af:6a:37", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37a01c90-ad", "ovs_interfaceid": "37a01c90-ad06-4911-92d4-92d627844f4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:06:24 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-e2e3042d-ba33-460a-8a39-d3a8376450d5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:06:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 17:06:24 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:06:24 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:06:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:06:26 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:06:29 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:06:31 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:06:33 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:06:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:06:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:06:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:06:33 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:06:33 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:06:33 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:06:33 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:06:33 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8787MB free_disk=24.11577606201172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:06:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:06:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:06:33 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance e2e3042d-ba33-460a-8a39-d3a8376450d5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:06:33 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:06:33 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:06:33 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:06:33 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:06:33 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:06:33 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:06:34 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:06:36 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:06:39 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:06:44 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:06:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:06:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:06:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:06:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:06:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:06:49 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:06:54 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:06:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:06:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:06:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:06:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:06:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:06:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:07:04 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:07:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:07:09 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:07:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-c12b5315-6c4b-4ce8-925b-4f2cbcf7bb42 req-daf995bb-b82e-4ddb-a215-600aac29bd1c service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Received event network-changed-37a01c90-ad06-4911-92d4-92d627844f4a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:07:09 user nova-compute[70243]: DEBUG nova.compute.manager [req-c12b5315-6c4b-4ce8-925b-4f2cbcf7bb42 req-daf995bb-b82e-4ddb-a215-600aac29bd1c service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Refreshing instance network info cache due to event network-changed-37a01c90-ad06-4911-92d4-92d627844f4a. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:07:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c12b5315-6c4b-4ce8-925b-4f2cbcf7bb42 req-daf995bb-b82e-4ddb-a215-600aac29bd1c service nova] Acquiring lock "refresh_cache-e2e3042d-ba33-460a-8a39-d3a8376450d5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:07:09 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c12b5315-6c4b-4ce8-925b-4f2cbcf7bb42 req-daf995bb-b82e-4ddb-a215-600aac29bd1c service nova] Acquired lock "refresh_cache-e2e3042d-ba33-460a-8a39-d3a8376450d5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:07:09 user nova-compute[70243]: DEBUG nova.network.neutron [req-c12b5315-6c4b-4ce8-925b-4f2cbcf7bb42 req-daf995bb-b82e-4ddb-a215-600aac29bd1c service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Refreshing network info cache for port 37a01c90-ad06-4911-92d4-92d627844f4a {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "e2e3042d-ba33-460a-8a39-d3a8376450d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "e2e3042d-ba33-460a-8a39-d3a8376450d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "e2e3042d-ba33-460a-8a39-d3a8376450d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "e2e3042d-ba33-460a-8a39-d3a8376450d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "e2e3042d-ba33-460a-8a39-d3a8376450d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:07:10 user nova-compute[70243]: INFO nova.compute.manager [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Terminating instance
Jul 24 17:07:10 user nova-compute[70243]: DEBUG nova.compute.manager [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG nova.network.neutron [req-c12b5315-6c4b-4ce8-925b-4f2cbcf7bb42 req-daf995bb-b82e-4ddb-a215-600aac29bd1c service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Updated VIF entry in instance network info cache for port 37a01c90-ad06-4911-92d4-92d627844f4a. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG nova.network.neutron [req-c12b5315-6c4b-4ce8-925b-4f2cbcf7bb42 req-daf995bb-b82e-4ddb-a215-600aac29bd1c service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Updating instance_info_cache with network_info: [{"id": "37a01c90-ad06-4911-92d4-92d627844f4a", "address": "fa:16:3e:af:6a:37", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37a01c90-ad", "ovs_interfaceid": "37a01c90-ad06-4911-92d4-92d627844f4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c12b5315-6c4b-4ce8-925b-4f2cbcf7bb42 req-daf995bb-b82e-4ddb-a215-600aac29bd1c service nova] Releasing lock "refresh_cache-e2e3042d-ba33-460a-8a39-d3a8376450d5" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG nova.compute.manager [req-94a53182-f4af-41d3-b9ad-b64eb6c04ab3 req-9a569197-b34d-41c9-9a7a-088edf8f5ee4 service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Received event network-vif-unplugged-37a01c90-ad06-4911-92d4-92d627844f4a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-94a53182-f4af-41d3-b9ad-b64eb6c04ab3 req-9a569197-b34d-41c9-9a7a-088edf8f5ee4 service nova] Acquiring lock "e2e3042d-ba33-460a-8a39-d3a8376450d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-94a53182-f4af-41d3-b9ad-b64eb6c04ab3 req-9a569197-b34d-41c9-9a7a-088edf8f5ee4 service nova] Lock "e2e3042d-ba33-460a-8a39-d3a8376450d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-94a53182-f4af-41d3-b9ad-b64eb6c04ab3 req-9a569197-b34d-41c9-9a7a-088edf8f5ee4 service nova] Lock "e2e3042d-ba33-460a-8a39-d3a8376450d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG nova.compute.manager [req-94a53182-f4af-41d3-b9ad-b64eb6c04ab3 req-9a569197-b34d-41c9-9a7a-088edf8f5ee4 service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] No waiting events found dispatching network-vif-unplugged-37a01c90-ad06-4911-92d4-92d627844f4a {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG nova.compute.manager [req-94a53182-f4af-41d3-b9ad-b64eb6c04ab3 req-9a569197-b34d-41c9-9a7a-088edf8f5ee4 service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Received event network-vif-unplugged-37a01c90-ad06-4911-92d4-92d627844f4a for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:07:10 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Instance destroyed successfully.
Jul 24 17:07:10 user nova-compute[70243]: DEBUG nova.objects.instance [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lazy-loading 'resources' on Instance uuid e2e3042d-ba33-460a-8a39-d3a8376450d5 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-67740414',display_name='tempest-TestVolumeBootPattern-server-67740414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-67740414',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMa+Vfiu/hyBL6BjsKJMeUEZCpZEnJguBpbnuOLc84nZ65lifnwNPBAJSJztB2ZLidwnYoqrUnP9nJwiTuHlVXDJeVaK2xFSB8j3KUXPjcp7h8GbVzopH4gkVftS/l/s7w==',key_name='tempest-TestVolumeBootPattern-1868423947',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:05:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0b57210106d441e96e821af15cb9469',ramdisk_id='',reservation_id='r-ecorh092',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-994857419',owner_user_name='tempest-TestVolumeBootPattern-994857419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:05:33Z,user_data=None,user_id='9f46574c91b549dda125d3d6874e26cc',uuid=e2e3042d-ba33-460a-8a39-d3a8376450d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37a01c90-ad06-4911-92d4-92d627844f4a", "address": "fa:16:3e:af:6a:37", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37a01c90-ad", "ovs_interfaceid": "37a01c90-ad06-4911-92d4-92d627844f4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converting VIF {"id": "37a01c90-ad06-4911-92d4-92d627844f4a", "address": "fa:16:3e:af:6a:37", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37a01c90-ad", "ovs_interfaceid": "37a01c90-ad06-4911-92d4-92d627844f4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:6a:37,bridge_name='br-int',has_traffic_filtering=True,id=37a01c90-ad06-4911-92d4-92d627844f4a,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37a01c90-ad') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG os_vif [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:6a:37,bridge_name='br-int',has_traffic_filtering=True,id=37a01c90-ad06-4911-92d4-92d627844f4a,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37a01c90-ad') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37a01c90-ad, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:07:10 user nova-compute[70243]: INFO os_vif [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:6a:37,bridge_name='br-int',has_traffic_filtering=True,id=37a01c90-ad06-4911-92d4-92d627844f4a,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37a01c90-ad')
Jul 24 17:07:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iZRgAkJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:07:10 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:07:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c980bd9-bc72-436f-91d7-04ecc124248e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:07:10 user nova-compute[70243]: No targets found.
Jul 24 17:07:10 user nova-compute[70243]: iSNS:
Jul 24 17:07:10 user nova-compute[70243]: No targets found.
Jul 24 17:07:10 user nova-compute[70243]: STATIC:
Jul 24 17:07:10 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb
Jul 24 17:07:10 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:07:10 user nova-compute[70243]:                 Iface Name: default
Jul 24 17:07:10 user nova-compute[70243]: FIRMWARE:
Jul 24 17:07:10 user nova-compute[70243]: No targets found.
Jul 24 17:07:10 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:07:10 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:07:10 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:07:10 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bdc659-43ae-4d73-a77d-b74d4490df6c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e126b0-89f8-4f3b-b011-194b377ba1a3]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb (non-flash)
Jul 24 17:07:11 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb (non-flash)
Jul 24 17:07:11 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91ac7711b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb'): ({'sdb'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Removing single pathed devices sdb {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66b3f61-87f2-4b8c-ac40-3cddd6aefec0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9818d7de-9c71-4a9b-bea6-78d8bb44dbc6]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Flushing IO for device /dev/sdb {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e080162e-344e-4953-8c91-35f2a975cd61]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f882737-0d6e-4c58-9c1c-62ef7c0c2715]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOecd56350-1541b6ba216a8786', '/dev/disk/by-id/scsi-23135343162366261', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ecd56350') {{(pid=81266) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32dc231-833b-4925-a480-646c8bf377f0]: (4, None) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c297a0-d77e-4268-910f-7f398437cfc5]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb6f653-0db5-447b-995d-cb1a2ccf03be]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb, portal: 172.16.0.220,3260]
Jul 24 17:07:11 user nova-compute[70243]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb, portal: 172.16.0.220,3260] successful.
Jul 24 17:07:11 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e566e372-53fb-4e59-a2d7-a87768d08d83]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] <== disconnect_volume: return (290ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:07:11 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Deleting instance files /opt/stack/data/nova/instances/e2e3042d-ba33-460a-8a39-d3a8376450d5_del
Jul 24 17:07:11 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Deletion of /opt/stack/data/nova/instances/e2e3042d-ba33-460a-8a39-d3a8376450d5_del complete
Jul 24 17:07:11 user nova-compute[70243]: INFO nova.compute.manager [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Took 1.16 seconds to destroy the instance on the hypervisor.
Jul 24 17:07:11 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 17:07:11 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 17:07:12 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:07:12 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Took 0.98 seconds to deallocate network for instance.
Jul 24 17:07:12 user nova-compute[70243]: DEBUG nova.compute.manager [req-f05b84a0-6ae4-4cd2-b8c5-02cd71b3b309 req-2725fb69-1b17-44d3-a194-8086d4f50a27 service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Received event network-vif-plugged-37a01c90-ad06-4911-92d4-92d627844f4a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:07:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f05b84a0-6ae4-4cd2-b8c5-02cd71b3b309 req-2725fb69-1b17-44d3-a194-8086d4f50a27 service nova] Acquiring lock "e2e3042d-ba33-460a-8a39-d3a8376450d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:07:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f05b84a0-6ae4-4cd2-b8c5-02cd71b3b309 req-2725fb69-1b17-44d3-a194-8086d4f50a27 service nova] Lock "e2e3042d-ba33-460a-8a39-d3a8376450d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:07:12 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-f05b84a0-6ae4-4cd2-b8c5-02cd71b3b309 req-2725fb69-1b17-44d3-a194-8086d4f50a27 service nova] Lock "e2e3042d-ba33-460a-8a39-d3a8376450d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:07:12 user nova-compute[70243]: DEBUG nova.compute.manager [req-f05b84a0-6ae4-4cd2-b8c5-02cd71b3b309 req-2725fb69-1b17-44d3-a194-8086d4f50a27 service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] No waiting events found dispatching network-vif-plugged-37a01c90-ad06-4911-92d4-92d627844f4a {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:07:12 user nova-compute[70243]: WARNING nova.compute.manager [req-f05b84a0-6ae4-4cd2-b8c5-02cd71b3b309 req-2725fb69-1b17-44d3-a194-8086d4f50a27 service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Received unexpected event network-vif-plugged-37a01c90-ad06-4911-92d4-92d627844f4a for instance with vm_state active and task_state deleting.
Jul 24 17:07:12 user nova-compute[70243]: DEBUG nova.compute.manager [req-f05b84a0-6ae4-4cd2-b8c5-02cd71b3b309 req-2725fb69-1b17-44d3-a194-8086d4f50a27 service nova] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Received event network-vif-deleted-37a01c90-ad06-4911-92d4-92d627844f4a {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:07:13 user nova-compute[70243]: INFO nova.compute.manager [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Took 0.78 seconds to detach 1 volumes for instance.
Jul 24 17:07:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:07:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:07:13 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:07:13 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:07:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:07:13 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Deleted allocations for instance e2e3042d-ba33-460a-8a39-d3a8376450d5
Jul 24 17:07:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-7d7cd33d-982a-4b00-b4c7-e08c0891e953 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "e2e3042d-ba33-460a-8a39-d3a8376450d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.243s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:07:15 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:07:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:07:20 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:07:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:07:23 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:07:24 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:07:24 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:07:25 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690218430.902066, e2e3042d-ba33-460a-8a39-d3a8376450d5 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:07:25 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] VM Stopped (Lifecycle Event)
Jul 24 17:07:25 user nova-compute[70243]: DEBUG nova.compute.manager [None req-92f09b60-9fc7-4b36-ba3e-a24b83629916 None None] [instance: e2e3042d-ba33-460a-8a39-d3a8376450d5] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:07:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:07:26 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:07:26 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:07:26 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 17:07:26 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Didn't find any instances for network info cache update. {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 17:07:26 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:07:26 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:07:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:07:33 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:07:35 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:07:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:07:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:07:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:07:35 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:07:35 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:07:35 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:07:35 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8914MB free_disk=24.114906311035156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:07:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:07:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:07:35 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:07:35 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:07:35 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:07:35 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:07:35 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:07:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:07:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:07:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:07:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:07:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:07:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:07:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:07:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:07:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:07:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:07:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:08:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:08:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:08:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:08:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "0d11e4f4-8109-40e8-8628-4db6ead413aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "0d11e4f4-8109-40e8-8628-4db6ead413aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG nova.compute.manager [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:08:02 user nova-compute[70243]: INFO nova.compute.claims [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Claim successful on node user
Jul 24 17:08:02 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.186s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG nova.compute.manager [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG nova.compute.manager [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG nova.network.neutron [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:08:02 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:08:02 user nova-compute[70243]: DEBUG nova.compute.manager [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:08:02 user nova-compute[70243]: INFO nova.virt.block_device [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Booting with volume 18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb at /dev/vda
Jul 24 17:08:02 user nova-compute[70243]: DEBUG nova.policy [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f46574c91b549dda125d3d6874e26cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b57210106d441e96e821af15cb9469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG os_brick.utils [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e100f7c-2c19-4044-9fdd-7cef2ebef952]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e121c25e-dcf2-4e72-a5f0-98399776ab7a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8215bc6-41fc-4518-96a1-b7bfd7651dd1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[844f31df-d23c-4a63-899e-c29482f0526d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:08:02 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:08:02 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cee7daa-4723-4f53-9f8b-b0b47335e734]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG os_brick.utils [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:08:02 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Updating existing volume attachment record: bc139474-c42a-456b-bb11-93fda60a74d6 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:08:03 user nova-compute[70243]: DEBUG nova.network.neutron [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Successfully created port: f2445d51-83ba-4642-b53b-b50bd2371743 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:08:04 user nova-compute[70243]: DEBUG nova.network.neutron [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Successfully updated port: f2445d51-83ba-4642-b53b-b50bd2371743 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:08:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:08:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquired lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:08:04 user nova-compute[70243]: DEBUG nova.network.neutron [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:08:04 user nova-compute[70243]: DEBUG nova.compute.manager [req-ebc51597-57c3-40fd-ae36-89a7d369371e req-d386e135-bd5c-41e7-8a53-5c855dcdfd29 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Received event network-changed-f2445d51-83ba-4642-b53b-b50bd2371743 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:08:04 user nova-compute[70243]: DEBUG nova.compute.manager [req-ebc51597-57c3-40fd-ae36-89a7d369371e req-d386e135-bd5c-41e7-8a53-5c855dcdfd29 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Refreshing instance network info cache due to event network-changed-f2445d51-83ba-4642-b53b-b50bd2371743. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:08:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ebc51597-57c3-40fd-ae36-89a7d369371e req-d386e135-bd5c-41e7-8a53-5c855dcdfd29 service nova] Acquiring lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:08:04 user nova-compute[70243]: DEBUG nova.network.neutron [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:08:04 user nova-compute[70243]: DEBUG nova.network.neutron [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Updating instance_info_cache with network_info: [{"id": "f2445d51-83ba-4642-b53b-b50bd2371743", "address": "fa:16:3e:2b:70:4f", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2445d51-83", "ovs_interfaceid": "f2445d51-83ba-4642-b53b-b50bd2371743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:08:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Releasing lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:08:04 user nova-compute[70243]: DEBUG nova.compute.manager [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Instance network_info: |[{"id": "f2445d51-83ba-4642-b53b-b50bd2371743", "address": "fa:16:3e:2b:70:4f", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2445d51-83", "ovs_interfaceid": "f2445d51-83ba-4642-b53b-b50bd2371743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:08:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ebc51597-57c3-40fd-ae36-89a7d369371e req-d386e135-bd5c-41e7-8a53-5c855dcdfd29 service nova] Acquired lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:08:04 user nova-compute[70243]: DEBUG nova.network.neutron [req-ebc51597-57c3-40fd-ae36-89a7d369371e req-d386e135-bd5c-41e7-8a53-5c855dcdfd29 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Refreshing network info cache for port f2445d51-83ba-4642-b53b-b50bd2371743 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:08:05 user nova-compute[70243]: DEBUG nova.network.neutron [req-ebc51597-57c3-40fd-ae36-89a7d369371e req-d386e135-bd5c-41e7-8a53-5c855dcdfd29 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Updated VIF entry in instance network info cache for port f2445d51-83ba-4642-b53b-b50bd2371743. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:08:05 user nova-compute[70243]: DEBUG nova.network.neutron [req-ebc51597-57c3-40fd-ae36-89a7d369371e req-d386e135-bd5c-41e7-8a53-5c855dcdfd29 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Updating instance_info_cache with network_info: [{"id": "f2445d51-83ba-4642-b53b-b50bd2371743", "address": "fa:16:3e:2b:70:4f", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2445d51-83", "ovs_interfaceid": "f2445d51-83ba-4642-b53b-b50bd2371743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:08:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-ebc51597-57c3-40fd-ae36-89a7d369371e req-d386e135-bd5c-41e7-8a53-5c855dcdfd29 service nova] Releasing lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:08:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:08:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:08:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:08:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:08:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG nova.compute.manager [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:08:08 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Creating image(s)
Jul 24 17:08:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Did not create local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Ensure instance console log exists: /opt/stack/data/nova/instances/0d11e4f4-8109-40e8-8628-4db6ead413aa/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Start _get_guest_xml network_info=[{"id": "f2445d51-83ba-4642-b53b-b50bd2371743", "address": "fa:16:3e:2b:70:4f", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2445d51-83", "ovs_interfaceid": "f2445d51-83ba-4642-b53b-b50bd2371743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iZRgAkJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0d11e4f4-8109-40e8-8628-4db6ead413aa', 'attached_at': '', 'detached_at': '', 'volume_id': '18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb', 'serial': '18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'bc139474-c42a-456b-bb11-93fda60a74d6', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:08:08 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:08:08 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:08:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iZRgAkJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:08:08 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:08:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:08:08 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:08:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:08:08 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:08:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a24785-dc70-4db7-babe-9b29a53e7818]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:08:08 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8d336f-44d2-44de-b391-8c4fba0bbf1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb] added
Jul 24 17:08:08 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[595d244c-3686-4e9c-96d8-6ad9b520f6f1]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d4d49a-a541-4e60-85a3-9a45e723826d]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iZRgAkJQ {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iZRgAkJQ" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41ae80b-d32e-468f-9a5c-799001775bc9]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:08:08 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iZRgAkJQ'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b658aa61-2ab0-41f7-9c6b-3212debe3ad0]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c9d3c4-3dc2-4f47-a3ca-439ac3037dfc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 24 17:08:09 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 24 17:08:09 user nova-compute[70243]:  {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:08:09 user nova-compute[70243]: WARNING os_brick.initiator.connectors.iscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 24 17:08:09 user nova-compute[70243]: 
Jul 24 17:08:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58dcdb3-9875-4f4d-bb44-f7890ff613ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb, portal: 172.16.0.220,3260]
Jul 24 17:08:09 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb, portal: 172.16.0.220,3260] successful.
Jul 24 17:08:09 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[766150bf-beeb-4a87-8fbb-73f8af4fdf62]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[571813cd-4c11-46f7-9065-10ce4d3b8b80]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb (non-flash)
Jul 24 17:08:09 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb (non-flash)
Jul 24 17:08:09 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[755b472e-6f82-481e-8c09-7c06fd9361f4]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:08:09 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iZRgAkJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:08:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:08:10 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23135343162366261', 'path': '/dev/sdb'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:08:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135343162366261', 'path': '/dev/sdb'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:08:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1348270684',display_name='tempest-TestVolumeBootPattern-server-1348270684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1348270684',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMa+Vfiu/hyBL6BjsKJMeUEZCpZEnJguBpbnuOLc84nZ65lifnwNPBAJSJztB2ZLidwnYoqrUnP9nJwiTuHlVXDJeVaK2xFSB8j3KUXPjcp7h8GbVzopH4gkVftS/l/s7w==',key_name='tempest-TestVolumeBootPattern-1868423947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0b57210106d441e96e821af15cb9469',ramdisk_id='',reservation_id='r-7ctzmjta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-994857419',owner_user_name='tempest-TestVolumeBootPattern-994857419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:08:02Z,user_data=None,user_id='9f46574c91b549dda125d3d6874e26cc',uuid=0d11e4f4-8109-40e8-8628-4db6ead413aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2445d51-83ba-4642-b53b-b50bd2371743", "address": "fa:16:3e:2b:70:4f", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2445d51-83", "ovs_interfaceid": "f2445d51-83ba-4642-b53b-b50bd2371743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:08:10 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converting VIF {"id": "f2445d51-83ba-4642-b53b-b50bd2371743", "address": "fa:16:3e:2b:70:4f", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2445d51-83", "ovs_interfaceid": "f2445d51-83ba-4642-b53b-b50bd2371743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:08:10 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:70:4f,bridge_name='br-int',has_traffic_filtering=True,id=f2445d51-83ba-4642-b53b-b50bd2371743,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2445d51-83') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:08:10 user nova-compute[70243]: DEBUG nova.objects.instance [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d11e4f4-8109-40e8-8628-4db6ead413aa {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:08:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:08:10 user nova-compute[70243]:   <uuid>0d11e4f4-8109-40e8-8628-4db6ead413aa</uuid>
Jul 24 17:08:10 user nova-compute[70243]:   <name>instance-00000032</name>
Jul 24 17:08:10 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 17:08:10 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 17:08:10 user nova-compute[70243]:   <metadata>
Jul 24 17:08:10 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:08:10 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 17:08:10 user nova-compute[70243]:       <nova:name>tempest-TestVolumeBootPattern-server-1348270684</nova:name>
Jul 24 17:08:10 user nova-compute[70243]:       <nova:creationTime>2023-07-24 17:08:08</nova:creationTime>
Jul 24 17:08:10 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 17:08:10 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 17:08:10 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 17:08:10 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 17:08:10 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:08:10 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:08:10 user nova-compute[70243]:       </nova:flavor>
Jul 24 17:08:10 user nova-compute[70243]:       <nova:owner>
Jul 24 17:08:10 user nova-compute[70243]:         <nova:user uuid="9f46574c91b549dda125d3d6874e26cc">tempest-TestVolumeBootPattern-994857419-project-member</nova:user>
Jul 24 17:08:10 user nova-compute[70243]:         <nova:project uuid="a0b57210106d441e96e821af15cb9469">tempest-TestVolumeBootPattern-994857419</nova:project>
Jul 24 17:08:10 user nova-compute[70243]:       </nova:owner>
Jul 24 17:08:10 user nova-compute[70243]:       <nova:ports>
Jul 24 17:08:10 user nova-compute[70243]:         <nova:port uuid="f2445d51-83ba-4642-b53b-b50bd2371743">
Jul 24 17:08:10 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 24 17:08:10 user nova-compute[70243]:         </nova:port>
Jul 24 17:08:10 user nova-compute[70243]:       </nova:ports>
Jul 24 17:08:10 user nova-compute[70243]:     </nova:instance>
Jul 24 17:08:10 user nova-compute[70243]:   </metadata>
Jul 24 17:08:10 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 17:08:10 user nova-compute[70243]:     <system>
Jul 24 17:08:10 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:08:10 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:08:10 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 17:08:10 user nova-compute[70243]:       <entry name="serial">0d11e4f4-8109-40e8-8628-4db6ead413aa</entry>
Jul 24 17:08:10 user nova-compute[70243]:       <entry name="uuid">0d11e4f4-8109-40e8-8628-4db6ead413aa</entry>
Jul 24 17:08:10 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:08:10 user nova-compute[70243]:     </system>
Jul 24 17:08:10 user nova-compute[70243]:   </sysinfo>
Jul 24 17:08:10 user nova-compute[70243]:   <os>
Jul 24 17:08:10 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:08:10 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 17:08:10 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 17:08:10 user nova-compute[70243]:   </os>
Jul 24 17:08:10 user nova-compute[70243]:   <features>
Jul 24 17:08:10 user nova-compute[70243]:     <acpi/>
Jul 24 17:08:10 user nova-compute[70243]:     <apic/>
Jul 24 17:08:10 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 17:08:10 user nova-compute[70243]:   </features>
Jul 24 17:08:10 user nova-compute[70243]:   <clock offset="utc">
Jul 24 17:08:10 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:08:10 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:08:10 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 17:08:10 user nova-compute[70243]:   </clock>
Jul 24 17:08:10 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 17:08:10 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 17:08:10 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:08:10 user nova-compute[70243]:   </cpu>
Jul 24 17:08:10 user nova-compute[70243]:   <devices>
Jul 24 17:08:10 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 17:08:10 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:08:10 user nova-compute[70243]:       <source dev="/dev/sdb"/>
Jul 24 17:08:10 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 17:08:10 user nova-compute[70243]:       <serial>18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb</serial>
Jul 24 17:08:10 user nova-compute[70243]:     </disk>
Jul 24 17:08:10 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 17:08:10 user nova-compute[70243]:       <mac address="fa:16:3e:2b:70:4f"/>
Jul 24 17:08:10 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 17:08:10 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 17:08:10 user nova-compute[70243]:       <target dev="tapf2445d51-83"/>
Jul 24 17:08:10 user nova-compute[70243]:     </interface>
Jul 24 17:08:10 user nova-compute[70243]:     <serial type="pty">
Jul 24 17:08:10 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/0d11e4f4-8109-40e8-8628-4db6ead413aa/console.log" append="off"/>
Jul 24 17:08:10 user nova-compute[70243]:     </serial>
Jul 24 17:08:10 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:08:10 user nova-compute[70243]:     <video>
Jul 24 17:08:10 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 17:08:10 user nova-compute[70243]:     </video>
Jul 24 17:08:10 user nova-compute[70243]:     <rng model="virtio">
Jul 24 17:08:10 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:08:10 user nova-compute[70243]:     </rng>
Jul 24 17:08:10 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:08:10 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 17:08:10 user nova-compute[70243]:       <stats period="10"/>
Jul 24 17:08:10 user nova-compute[70243]:     </memballoon>
Jul 24 17:08:10 user nova-compute[70243]:   </devices>
Jul 24 17:08:10 user nova-compute[70243]: </domain>
Jul 24 17:08:10 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:08:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1348270684',display_name='tempest-TestVolumeBootPattern-server-1348270684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1348270684',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMa+Vfiu/hyBL6BjsKJMeUEZCpZEnJguBpbnuOLc84nZ65lifnwNPBAJSJztB2ZLidwnYoqrUnP9nJwiTuHlVXDJeVaK2xFSB8j3KUXPjcp7h8GbVzopH4gkVftS/l/s7w==',key_name='tempest-TestVolumeBootPattern-1868423947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0b57210106d441e96e821af15cb9469',ramdisk_id='',reservation_id='r-7ctzmjta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-994857419',owner_user_name='tempest-TestVolumeBootPattern-994857419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:08:02Z,user_data=None,user_id='9f46574c91b549dda125d3d6874e26cc',uuid=0d11e4f4-8109-40e8-8628-4db6ead413aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2445d51-83ba-4642-b53b-b50bd2371743", "address": "fa:16:3e:2b:70:4f", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2445d51-83", "ovs_interfaceid": "f2445d51-83ba-4642-b53b-b50bd2371743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:08:10 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converting VIF {"id": "f2445d51-83ba-4642-b53b-b50bd2371743", "address": "fa:16:3e:2b:70:4f", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2445d51-83", "ovs_interfaceid": "f2445d51-83ba-4642-b53b-b50bd2371743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:08:10 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:70:4f,bridge_name='br-int',has_traffic_filtering=True,id=f2445d51-83ba-4642-b53b-b50bd2371743,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2445d51-83') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:08:10 user nova-compute[70243]: DEBUG os_vif [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:70:4f,bridge_name='br-int',has_traffic_filtering=True,id=f2445d51-83ba-4642-b53b-b50bd2371743,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2445d51-83') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:08:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:08:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:08:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2445d51-83, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:08:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf2445d51-83, col_values=(('external_ids', {'iface-id': 'f2445d51-83ba-4642-b53b-b50bd2371743', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:70:4f', 'vm-uuid': '0d11e4f4-8109-40e8-8628-4db6ead413aa'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:08:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:08:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:10 user nova-compute[70243]: INFO os_vif [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:70:4f,bridge_name='br-int',has_traffic_filtering=True,id=f2445d51-83ba-4642-b53b-b50bd2371743,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2445d51-83')
Jul 24 17:08:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:08:10 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] No VIF found with MAC fa:16:3e:2b:70:4f, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:08:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:11 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:11 user nova-compute[70243]: DEBUG nova.compute.manager [req-9336f9ca-161b-4716-b6ea-6fe590599b35 req-483de2ef-4d16-408f-b29f-f8bbf014b8f5 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Received event network-vif-plugged-f2445d51-83ba-4642-b53b-b50bd2371743 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:08:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9336f9ca-161b-4716-b6ea-6fe590599b35 req-483de2ef-4d16-408f-b29f-f8bbf014b8f5 service nova] Acquiring lock "0d11e4f4-8109-40e8-8628-4db6ead413aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:08:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9336f9ca-161b-4716-b6ea-6fe590599b35 req-483de2ef-4d16-408f-b29f-f8bbf014b8f5 service nova] Lock "0d11e4f4-8109-40e8-8628-4db6ead413aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:08:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-9336f9ca-161b-4716-b6ea-6fe590599b35 req-483de2ef-4d16-408f-b29f-f8bbf014b8f5 service nova] Lock "0d11e4f4-8109-40e8-8628-4db6ead413aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:08:11 user nova-compute[70243]: DEBUG nova.compute.manager [req-9336f9ca-161b-4716-b6ea-6fe590599b35 req-483de2ef-4d16-408f-b29f-f8bbf014b8f5 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] No waiting events found dispatching network-vif-plugged-f2445d51-83ba-4642-b53b-b50bd2371743 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:08:11 user nova-compute[70243]: WARNING nova.compute.manager [req-9336f9ca-161b-4716-b6ea-6fe590599b35 req-483de2ef-4d16-408f-b29f-f8bbf014b8f5 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Received unexpected event network-vif-plugged-f2445d51-83ba-4642-b53b-b50bd2371743 for instance with vm_state building and task_state spawning.
Jul 24 17:08:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:12 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:13 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690218493.605942, 0d11e4f4-8109-40e8-8628-4db6ead413aa => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:08:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] VM Resumed (Lifecycle Event)
Jul 24 17:08:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:08:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:08:13 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Instance spawned successfully.
Jul 24 17:08:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:08:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:08:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:08:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:08:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:08:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:08:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:08:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:08:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:08:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:08:13 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690218493.6077225, 0d11e4f4-8109-40e8-8628-4db6ead413aa => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:08:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] VM Started (Lifecycle Event)
Jul 24 17:08:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:08:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:08:13 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:08:13 user nova-compute[70243]: INFO nova.compute.manager [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Took 4.93 seconds to spawn the instance on the hypervisor.
Jul 24 17:08:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:08:13 user nova-compute[70243]: INFO nova.compute.manager [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Took 11.68 seconds to build instance.
Jul 24 17:08:13 user nova-compute[70243]: DEBUG nova.compute.manager [req-e1d2e374-1c9d-490a-aea0-9917aadb9c9f req-dc60794d-d436-4442-8464-6b0672bb23b8 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Received event network-vif-plugged-f2445d51-83ba-4642-b53b-b50bd2371743 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:08:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e1d2e374-1c9d-490a-aea0-9917aadb9c9f req-dc60794d-d436-4442-8464-6b0672bb23b8 service nova] Acquiring lock "0d11e4f4-8109-40e8-8628-4db6ead413aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:08:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e1d2e374-1c9d-490a-aea0-9917aadb9c9f req-dc60794d-d436-4442-8464-6b0672bb23b8 service nova] Lock "0d11e4f4-8109-40e8-8628-4db6ead413aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:08:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-e1d2e374-1c9d-490a-aea0-9917aadb9c9f req-dc60794d-d436-4442-8464-6b0672bb23b8 service nova] Lock "0d11e4f4-8109-40e8-8628-4db6ead413aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:08:13 user nova-compute[70243]: DEBUG nova.compute.manager [req-e1d2e374-1c9d-490a-aea0-9917aadb9c9f req-dc60794d-d436-4442-8464-6b0672bb23b8 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] No waiting events found dispatching network-vif-plugged-f2445d51-83ba-4642-b53b-b50bd2371743 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:08:13 user nova-compute[70243]: WARNING nova.compute.manager [req-e1d2e374-1c9d-490a-aea0-9917aadb9c9f req-dc60794d-d436-4442-8464-6b0672bb23b8 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Received unexpected event network-vif-plugged-f2445d51-83ba-4642-b53b-b50bd2371743 for instance with vm_state active and task_state None.
Jul 24 17:08:13 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-72f6e957-c6ed-4c50-8231-7f3021964a88 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "0d11e4f4-8109-40e8-8628-4db6ead413aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.794s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:08:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:17 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:08:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:20 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:08:23 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:08:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:25 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:08:25 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:08:26 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:08:27 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:08:27 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:08:27 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 17:08:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:08:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:08:27 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 17:08:27 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lazy-loading 'info_cache' on Instance uuid 0d11e4f4-8109-40e8-8628-4db6ead413aa {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:08:27 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Updating instance_info_cache with network_info: [{"id": "f2445d51-83ba-4642-b53b-b50bd2371743", "address": "fa:16:3e:2b:70:4f", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2445d51-83", "ovs_interfaceid": "f2445d51-83ba-4642-b53b-b50bd2371743", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:08:27 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:08:27 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 17:08:28 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:08:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:33 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:08:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:35 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:08:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:08:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:08:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:08:35 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:08:35 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:08:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:35 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:08:35 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:08:35 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8728MB free_disk=24.11325454711914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:08:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:08:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:08:35 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 0d11e4f4-8109-40e8-8628-4db6ead413aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:08:35 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:08:35 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:08:35 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:08:35 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:08:35 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:08:35 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:08:39 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:08:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:08:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:08:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:08:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:08:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:08:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:08:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:09:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:09:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:09:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:09:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:09:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:09:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:09:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:09:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:09:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:09:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:09:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:09:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:09:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:09:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:09:18 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:09:20 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:09:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:09:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:09:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:09:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:09:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:09:20 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:09:23 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:09:25 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:09:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:09:26 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:09:26 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:09:26 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:09:28 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:09:28 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:09:28 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 17:09:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:09:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:09:28 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 17:09:28 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lazy-loading 'info_cache' on Instance uuid 0d11e4f4-8109-40e8-8628-4db6ead413aa {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:09:28 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Updating instance_info_cache with network_info: [{"id": "f2445d51-83ba-4642-b53b-b50bd2371743", "address": "fa:16:3e:2b:70:4f", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2445d51-83", "ovs_interfaceid": "f2445d51-83ba-4642-b53b-b50bd2371743", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:09:28 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:09:28 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 17:09:30 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:09:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:09:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:09:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:09:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:09:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:09:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:09:33 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:09:35 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:09:35 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Cleaning up deleted instances with incomplete migration  {{(pid=70243) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11147}}
Jul 24 17:09:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:09:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:09:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:09:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:09:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:09:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:09:37 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:09:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:09:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:09:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:09:37 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:09:37 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:09:37 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:09:37 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:09:37 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8779MB free_disk=24.11258316040039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:09:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:09:37 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:09:37 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 0d11e4f4-8109-40e8-8628-4db6ead413aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:09:37 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:09:37 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:09:37 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:09:37 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:09:38 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:09:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:09:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:09:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:09:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:09:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:09:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:09:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:09:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:09:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:09:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:09:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:09:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:09:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:09:50 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:09:52 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:09:53 user nova-compute[70243]: DEBUG nova.compute.manager [req-acb35e7a-d329-4122-83e8-9fa03ae67c31 req-337f9556-a8b8-4ac4-9cfc-405252f4f476 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Received event network-changed-f2445d51-83ba-4642-b53b-b50bd2371743 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:09:53 user nova-compute[70243]: DEBUG nova.compute.manager [req-acb35e7a-d329-4122-83e8-9fa03ae67c31 req-337f9556-a8b8-4ac4-9cfc-405252f4f476 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Refreshing instance network info cache due to event network-changed-f2445d51-83ba-4642-b53b-b50bd2371743. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:09:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-acb35e7a-d329-4122-83e8-9fa03ae67c31 req-337f9556-a8b8-4ac4-9cfc-405252f4f476 service nova] Acquiring lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:09:53 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-acb35e7a-d329-4122-83e8-9fa03ae67c31 req-337f9556-a8b8-4ac4-9cfc-405252f4f476 service nova] Acquired lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:09:53 user nova-compute[70243]: DEBUG nova.network.neutron [req-acb35e7a-d329-4122-83e8-9fa03ae67c31 req-337f9556-a8b8-4ac4-9cfc-405252f4f476 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Refreshing network info cache for port f2445d51-83ba-4642-b53b-b50bd2371743 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:09:54 user nova-compute[70243]: DEBUG nova.network.neutron [req-acb35e7a-d329-4122-83e8-9fa03ae67c31 req-337f9556-a8b8-4ac4-9cfc-405252f4f476 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Updated VIF entry in instance network info cache for port f2445d51-83ba-4642-b53b-b50bd2371743. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:09:54 user nova-compute[70243]: DEBUG nova.network.neutron [req-acb35e7a-d329-4122-83e8-9fa03ae67c31 req-337f9556-a8b8-4ac4-9cfc-405252f4f476 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Updating instance_info_cache with network_info: [{"id": "f2445d51-83ba-4642-b53b-b50bd2371743", "address": "fa:16:3e:2b:70:4f", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2445d51-83", "ovs_interfaceid": "f2445d51-83ba-4642-b53b-b50bd2371743", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:09:54 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-acb35e7a-d329-4122-83e8-9fa03ae67c31 req-337f9556-a8b8-4ac4-9cfc-405252f4f476 service nova] Releasing lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:09:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:09:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:04 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:10:04 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Cleaning up deleted instances {{(pid=70243) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11109}}
Jul 24 17:10:04 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] There are 0 instances to clean {{(pid=70243) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11118}}
Jul 24 17:10:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "0b703da3-3974-4067-8332-2e43ed1a7622" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:10:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "0b703da3-3974-4067-8332-2e43ed1a7622" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:10:04 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Starting instance... {{(pid=70243) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2405}}
Jul 24 17:10:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:10:04 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:10:04 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=70243) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 24 17:10:04 user nova-compute[70243]: INFO nova.compute.claims [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Claim successful on node user
Jul 24 17:10:04 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:10:04 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Start building networks asynchronously for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2802}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Allocating IP information in the background. {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1955}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] allocate_for_instance() {{(pid=70243) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 24 17:10:05 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 24 17:10:05 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Start building block device mappings for instance. {{(pid=70243) _build_resources /opt/stack/nova/nova/compute/manager.py:2837}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:05 user nova-compute[70243]: INFO nova.virt.block_device [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Booting with volume a7010d2f-e370-4079-ac71-56b76acbf555 at /dev/vda
Jul 24 17:10:05 user nova-compute[70243]: DEBUG nova.policy [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f46574c91b549dda125d3d6874e26cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b57210106d441e96e821af15cb9469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=70243) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG os_brick.utils [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ede8063-76ae-47dc-9706-ebfda5bf1bba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a52165ee7c2a\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be2ba27-ad80-4dc9-96ab-9f352112fa75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0de14f-cefd-4906-9415-a05bc04101f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7461cc1-fa84-4170-98b5-74cf88c5985b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Running cmd (subprocess): nvme version {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] 'nvme version' failed. Not Retrying. {{(pid=70243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] nvme not present on system {{(pid=70243) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 24 17:10:05 user nova-compute[70243]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 24 17:10:05 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd292db-284b-4c40-a295-34a8f6f90613]: (4, '') {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=70243) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.lightos [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] LIGHTOS: no hostnqn found. {{(pid=70243) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG os_brick.utils [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a52165ee7c2a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:10:05 user nova-compute[70243]: DEBUG nova.virt.block_device [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Updating existing volume attachment record: 6eab57fe-7b44-4c56-b693-3e21f5c64407 {{(pid=70243) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 24 17:10:06 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Successfully created port: b2301d06-4328-4ac4-a94a-54652369cc09 {{(pid=70243) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 24 17:10:07 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Successfully updated port: b2301d06-4328-4ac4-a94a-54652369cc09 {{(pid=70243) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 24 17:10:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "refresh_cache-0b703da3-3974-4067-8332-2e43ed1a7622" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:10:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquired lock "refresh_cache-0b703da3-3974-4067-8332-2e43ed1a7622" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:10:07 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Building network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 24 17:10:07 user nova-compute[70243]: DEBUG nova.compute.manager [req-11badb0b-3c97-40ab-9326-c70fecd7e701 req-d729f1c1-2fbb-4e32-92e8-719a3ae32a66 service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Received event network-changed-b2301d06-4328-4ac4-a94a-54652369cc09 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:10:07 user nova-compute[70243]: DEBUG nova.compute.manager [req-11badb0b-3c97-40ab-9326-c70fecd7e701 req-d729f1c1-2fbb-4e32-92e8-719a3ae32a66 service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Refreshing instance network info cache due to event network-changed-b2301d06-4328-4ac4-a94a-54652369cc09. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:10:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-11badb0b-3c97-40ab-9326-c70fecd7e701 req-d729f1c1-2fbb-4e32-92e8-719a3ae32a66 service nova] Acquiring lock "refresh_cache-0b703da3-3974-4067-8332-2e43ed1a7622" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:10:07 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Instance cache missing network info. {{(pid=70243) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 24 17:10:07 user nova-compute[70243]: DEBUG nova.network.neutron [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Updating instance_info_cache with network_info: [{"id": "b2301d06-4328-4ac4-a94a-54652369cc09", "address": "fa:16:3e:14:1c:f8", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2301d06-43", "ovs_interfaceid": "b2301d06-4328-4ac4-a94a-54652369cc09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:10:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Releasing lock "refresh_cache-0b703da3-3974-4067-8332-2e43ed1a7622" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:10:07 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Instance network_info: |[{"id": "b2301d06-4328-4ac4-a94a-54652369cc09", "address": "fa:16:3e:14:1c:f8", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2301d06-43", "ovs_interfaceid": "b2301d06-4328-4ac4-a94a-54652369cc09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=70243) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1970}}
Jul 24 17:10:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-11badb0b-3c97-40ab-9326-c70fecd7e701 req-d729f1c1-2fbb-4e32-92e8-719a3ae32a66 service nova] Acquired lock "refresh_cache-0b703da3-3974-4067-8332-2e43ed1a7622" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:10:07 user nova-compute[70243]: DEBUG nova.network.neutron [req-11badb0b-3c97-40ab-9326-c70fecd7e701 req-d729f1c1-2fbb-4e32-92e8-719a3ae32a66 service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Refreshing network info cache for port b2301d06-4328-4ac4-a94a-54652369cc09 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:10:07 user nova-compute[70243]: DEBUG nova.network.neutron [req-11badb0b-3c97-40ab-9326-c70fecd7e701 req-d729f1c1-2fbb-4e32-92e8-719a3ae32a66 service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Updated VIF entry in instance network info cache for port b2301d06-4328-4ac4-a94a-54652369cc09. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:10:07 user nova-compute[70243]: DEBUG nova.network.neutron [req-11badb0b-3c97-40ab-9326-c70fecd7e701 req-d729f1c1-2fbb-4e32-92e8-719a3ae32a66 service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Updating instance_info_cache with network_info: [{"id": "b2301d06-4328-4ac4-a94a-54652369cc09", "address": "fa:16:3e:14:1c:f8", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2301d06-43", "ovs_interfaceid": "b2301d06-4328-4ac4-a94a-54652369cc09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:10:07 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-11badb0b-3c97-40ab-9326-c70fecd7e701 req-d729f1c1-2fbb-4e32-92e8-719a3ae32a66 service nova] Releasing lock "refresh_cache-0b703da3-3974-4067-8332-2e43ed1a7622" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:10:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:10:10 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Start spawning the instance on the hypervisor. {{(pid=70243) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2611}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Creating instance directory {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 24 17:10:11 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Creating image(s)
Jul 24 17:10:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Did not create local disks {{(pid=70243) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Ensure instance console log exists: /opt/stack/data/nova/instances/0b703da3-3974-4067-8332-2e43ed1a7622/console.log {{(pid=70243) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Start _get_guest_xml network_info=[{"id": "b2301d06-4328-4ac4-a94a-54652369cc09", "address": "fa:16:3e:14:1c:f8", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2301d06-43", "ovs_interfaceid": "b2301d06-4328-4ac4-a94a-54652369cc09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YEexSfXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0b703da3-3974-4067-8332-2e43ed1a7622', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7010d2f-e370-4079-ac71-56b76acbf555', 'serial': 'a7010d2f-e370-4079-ac71-56b76acbf555'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '6eab57fe-7b44-4c56-b693-3e21f5c64407', 'volume_type': None} {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 24 17:10:11 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:10:11 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:10:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] CPU controller missing on host. {{(pid=70243) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.host [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] CPU controller found on host. {{(pid=70243) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=70243) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-24T16:13:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Flavor limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Image limits 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Flavor pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Image pref 0:0:0 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=70243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Got 1 possible topologies {{(pid=70243) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG nova.virt.hardware [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=70243) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Calling os-brick to attach iSCSI Volume {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YEexSfXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:10:11 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:10:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:10:11 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:10:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:10:11 user nova-compute[70243]: INFO os_brick.initiator.connectors.iscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 -p 172.16.0.220:3260 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[53382f2c-d2a9-4171-8d00-385add3edb09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 24 17:10:11 user nova-compute[70243]:  {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 -p 172.16.0.220:3260 --interface default --op new {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[960de8af-3ee1-4118-b502-7d9b44495ac0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555] added\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555] added
Jul 24 17:10:11 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[88186450-687c-48c1-8766-103ba78fcd5e]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[843fced7-a07e-4128-8a85-fd399a5f8bd8]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YEexSfXG {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YEexSfXG" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1d56bd-8d47-4821-bac3-00e8ee9c1571]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YEexSfXG'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[64628dfd-fbb1-4269-a832-83aa3c578685]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ae35c2-104a-4ccc-9190-9839f6c66c05]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb (non-flash)
Jul 24 17:10:11 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb (non-flash)
Jul 24 17:10:11 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:10:11 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 -p 172.16.0.220:3260 --login {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:10:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:10:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[630058ac-17ea-475f-a356-5b98dc364859]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:10:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555, portal: 172.16.0.220,3260]
Jul 24 17:10:12 user nova-compute[70243]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555, portal: 172.16.0.220,3260] successful.
Jul 24 17:10:12 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:10:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:10:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:10:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d29fa75-cc6f-44a4-a257-07e201eabbc1]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:10:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:10:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:10:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:10:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d4f220-9640-43a4-be62-72e57d37db85]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:10:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb (non-flash)
Jul 24 17:10:12 user nova-compute[70243]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 (non-flash)
Jul 24 17:10:12 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:10:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb (non-flash)
Jul 24 17:10:12 user nova-compute[70243]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 (non-flash)
Jul 24 17:10:12 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:10:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:10:12 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Connected to 172.16.0.220:3260 {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 24 17:10:12 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=70243) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 24 17:10:12 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=70243) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 24 17:10:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:10:12 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:10:12 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf22a84-5304-4556-892b-58961fc1f019]: (4, ('- - 0', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:10:12 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: None {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=70243) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YEexSfXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=70243) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26433353639346136', 'path': '/dev/sdc'} {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433353639346136', 'path': '/dev/sdc'} {{(pid=70243) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-786161492',display_name='tempest-TestVolumeBootPattern-server-786161492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-786161492',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMa+Vfiu/hyBL6BjsKJMeUEZCpZEnJguBpbnuOLc84nZ65lifnwNPBAJSJztB2ZLidwnYoqrUnP9nJwiTuHlVXDJeVaK2xFSB8j3KUXPjcp7h8GbVzopH4gkVftS/l/s7w==',key_name='tempest-TestVolumeBootPattern-1868423947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0b57210106d441e96e821af15cb9469',ramdisk_id='',reservation_id='r-om90tjvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-994857419',owner_user_name='tempest-TestVolumeBootPattern-994857419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:10:05Z,user_data=None,user_id='9f46574c91b549dda125d3d6874e26cc',uuid=0b703da3-3974-4067-8332-2e43ed1a7622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2301d06-4328-4ac4-a94a-54652369cc09", "address": "fa:16:3e:14:1c:f8", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2301d06-43", "ovs_interfaceid": "b2301d06-4328-4ac4-a94a-54652369cc09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=70243) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converting VIF {"id": "b2301d06-4328-4ac4-a94a-54652369cc09", "address": "fa:16:3e:14:1c:f8", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2301d06-43", "ovs_interfaceid": "b2301d06-4328-4ac4-a94a-54652369cc09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:1c:f8,bridge_name='br-int',has_traffic_filtering=True,id=b2301d06-4328-4ac4-a94a-54652369cc09,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2301d06-43') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG nova.objects.instance [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b703da3-3974-4067-8332-2e43ed1a7622 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] End _get_guest_xml xml=<domain type="kvm">
Jul 24 17:10:13 user nova-compute[70243]:   <uuid>0b703da3-3974-4067-8332-2e43ed1a7622</uuid>
Jul 24 17:10:13 user nova-compute[70243]:   <name>instance-00000033</name>
Jul 24 17:10:13 user nova-compute[70243]:   <memory>524288</memory>
Jul 24 17:10:13 user nova-compute[70243]:   <vcpu>1</vcpu>
Jul 24 17:10:13 user nova-compute[70243]:   <metadata>
Jul 24 17:10:13 user nova-compute[70243]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 24 17:10:13 user nova-compute[70243]:       <nova:package version="0.0.0"/>
Jul 24 17:10:13 user nova-compute[70243]:       <nova:name>tempest-TestVolumeBootPattern-server-786161492</nova:name>
Jul 24 17:10:13 user nova-compute[70243]:       <nova:creationTime>2023-07-24 17:10:11</nova:creationTime>
Jul 24 17:10:13 user nova-compute[70243]:       <nova:flavor name="m1.tiny">
Jul 24 17:10:13 user nova-compute[70243]:         <nova:memory>512</nova:memory>
Jul 24 17:10:13 user nova-compute[70243]:         <nova:disk>1</nova:disk>
Jul 24 17:10:13 user nova-compute[70243]:         <nova:swap>0</nova:swap>
Jul 24 17:10:13 user nova-compute[70243]:         <nova:ephemeral>0</nova:ephemeral>
Jul 24 17:10:13 user nova-compute[70243]:         <nova:vcpus>1</nova:vcpus>
Jul 24 17:10:13 user nova-compute[70243]:       </nova:flavor>
Jul 24 17:10:13 user nova-compute[70243]:       <nova:owner>
Jul 24 17:10:13 user nova-compute[70243]:         <nova:user uuid="9f46574c91b549dda125d3d6874e26cc">tempest-TestVolumeBootPattern-994857419-project-member</nova:user>
Jul 24 17:10:13 user nova-compute[70243]:         <nova:project uuid="a0b57210106d441e96e821af15cb9469">tempest-TestVolumeBootPattern-994857419</nova:project>
Jul 24 17:10:13 user nova-compute[70243]:       </nova:owner>
Jul 24 17:10:13 user nova-compute[70243]:       <nova:ports>
Jul 24 17:10:13 user nova-compute[70243]:         <nova:port uuid="b2301d06-4328-4ac4-a94a-54652369cc09">
Jul 24 17:10:13 user nova-compute[70243]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 24 17:10:13 user nova-compute[70243]:         </nova:port>
Jul 24 17:10:13 user nova-compute[70243]:       </nova:ports>
Jul 24 17:10:13 user nova-compute[70243]:     </nova:instance>
Jul 24 17:10:13 user nova-compute[70243]:   </metadata>
Jul 24 17:10:13 user nova-compute[70243]:   <sysinfo type="smbios">
Jul 24 17:10:13 user nova-compute[70243]:     <system>
Jul 24 17:10:13 user nova-compute[70243]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 24 17:10:13 user nova-compute[70243]:       <entry name="product">OpenStack Nova</entry>
Jul 24 17:10:13 user nova-compute[70243]:       <entry name="version">0.0.0</entry>
Jul 24 17:10:13 user nova-compute[70243]:       <entry name="serial">0b703da3-3974-4067-8332-2e43ed1a7622</entry>
Jul 24 17:10:13 user nova-compute[70243]:       <entry name="uuid">0b703da3-3974-4067-8332-2e43ed1a7622</entry>
Jul 24 17:10:13 user nova-compute[70243]:       <entry name="family">Virtual Machine</entry>
Jul 24 17:10:13 user nova-compute[70243]:     </system>
Jul 24 17:10:13 user nova-compute[70243]:   </sysinfo>
Jul 24 17:10:13 user nova-compute[70243]:   <os>
Jul 24 17:10:13 user nova-compute[70243]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 24 17:10:13 user nova-compute[70243]:     <boot dev="hd"/>
Jul 24 17:10:13 user nova-compute[70243]:     <smbios mode="sysinfo"/>
Jul 24 17:10:13 user nova-compute[70243]:   </os>
Jul 24 17:10:13 user nova-compute[70243]:   <features>
Jul 24 17:10:13 user nova-compute[70243]:     <acpi/>
Jul 24 17:10:13 user nova-compute[70243]:     <apic/>
Jul 24 17:10:13 user nova-compute[70243]:     <vmcoreinfo/>
Jul 24 17:10:13 user nova-compute[70243]:   </features>
Jul 24 17:10:13 user nova-compute[70243]:   <clock offset="utc">
Jul 24 17:10:13 user nova-compute[70243]:     <timer name="pit" tickpolicy="delay"/>
Jul 24 17:10:13 user nova-compute[70243]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 24 17:10:13 user nova-compute[70243]:     <timer name="hpet" present="no"/>
Jul 24 17:10:13 user nova-compute[70243]:   </clock>
Jul 24 17:10:13 user nova-compute[70243]:   <cpu mode="custom" match="exact">
Jul 24 17:10:13 user nova-compute[70243]:     <model>Nehalem</model>
Jul 24 17:10:13 user nova-compute[70243]:     <topology sockets="1" cores="1" threads="1"/>
Jul 24 17:10:13 user nova-compute[70243]:   </cpu>
Jul 24 17:10:13 user nova-compute[70243]:   <devices>
Jul 24 17:10:13 user nova-compute[70243]:     <disk type="block" device="disk">
Jul 24 17:10:13 user nova-compute[70243]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 24 17:10:13 user nova-compute[70243]:       <source dev="/dev/sdc"/>
Jul 24 17:10:13 user nova-compute[70243]:       <target dev="vda" bus="virtio"/>
Jul 24 17:10:13 user nova-compute[70243]:       <serial>a7010d2f-e370-4079-ac71-56b76acbf555</serial>
Jul 24 17:10:13 user nova-compute[70243]:     </disk>
Jul 24 17:10:13 user nova-compute[70243]:     <interface type="ethernet">
Jul 24 17:10:13 user nova-compute[70243]:       <mac address="fa:16:3e:14:1c:f8"/>
Jul 24 17:10:13 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 17:10:13 user nova-compute[70243]:       <mtu size="1442"/>
Jul 24 17:10:13 user nova-compute[70243]:       <target dev="tapb2301d06-43"/>
Jul 24 17:10:13 user nova-compute[70243]:     </interface>
Jul 24 17:10:13 user nova-compute[70243]:     <serial type="pty">
Jul 24 17:10:13 user nova-compute[70243]:       <log file="/opt/stack/data/nova/instances/0b703da3-3974-4067-8332-2e43ed1a7622/console.log" append="off"/>
Jul 24 17:10:13 user nova-compute[70243]:     </serial>
Jul 24 17:10:13 user nova-compute[70243]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 24 17:10:13 user nova-compute[70243]:     <video>
Jul 24 17:10:13 user nova-compute[70243]:       <model type="virtio"/>
Jul 24 17:10:13 user nova-compute[70243]:     </video>
Jul 24 17:10:13 user nova-compute[70243]:     <rng model="virtio">
Jul 24 17:10:13 user nova-compute[70243]:       <backend model="random">/dev/urandom</backend>
Jul 24 17:10:13 user nova-compute[70243]:     </rng>
Jul 24 17:10:13 user nova-compute[70243]:     <controller type="usb" index="0" model="none"/>
Jul 24 17:10:13 user nova-compute[70243]:     <memballoon model="virtio">
Jul 24 17:10:13 user nova-compute[70243]:       <stats period="10"/>
Jul 24 17:10:13 user nova-compute[70243]:     </memballoon>
Jul 24 17:10:13 user nova-compute[70243]:   </devices>
Jul 24 17:10:13 user nova-compute[70243]: </domain>
Jul 24 17:10:13 user nova-compute[70243]:  {{(pid=70243) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-786161492',display_name='tempest-TestVolumeBootPattern-server-786161492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-786161492',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMa+Vfiu/hyBL6BjsKJMeUEZCpZEnJguBpbnuOLc84nZ65lifnwNPBAJSJztB2ZLidwnYoqrUnP9nJwiTuHlVXDJeVaK2xFSB8j3KUXPjcp7h8GbVzopH4gkVftS/l/s7w==',key_name='tempest-TestVolumeBootPattern-1868423947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0b57210106d441e96e821af15cb9469',ramdisk_id='',reservation_id='r-om90tjvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-994857419',owner_user_name='tempest-TestVolumeBootPattern-994857419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-24T17:10:05Z,user_data=None,user_id='9f46574c91b549dda125d3d6874e26cc',uuid=0b703da3-3974-4067-8332-2e43ed1a7622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2301d06-4328-4ac4-a94a-54652369cc09", "address": "fa:16:3e:14:1c:f8", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2301d06-43", "ovs_interfaceid": "b2301d06-4328-4ac4-a94a-54652369cc09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converting VIF {"id": "b2301d06-4328-4ac4-a94a-54652369cc09", "address": "fa:16:3e:14:1c:f8", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2301d06-43", "ovs_interfaceid": "b2301d06-4328-4ac4-a94a-54652369cc09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:1c:f8,bridge_name='br-int',has_traffic_filtering=True,id=b2301d06-4328-4ac4-a94a-54652369cc09,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2301d06-43') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG os_vif [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:1c:f8,bridge_name='br-int',has_traffic_filtering=True,id=b2301d06-4328-4ac4-a94a-54652369cc09,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2301d06-43') {{(pid=70243) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2301d06-43, may_exist=True, interface_attrs={}) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb2301d06-43, col_values=(('external_ids', {'iface-id': 'b2301d06-4328-4ac4-a94a-54652369cc09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:1c:f8', 'vm-uuid': '0b703da3-3974-4067-8332-2e43ed1a7622'}),), if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:13 user nova-compute[70243]: INFO os_vif [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:1c:f8,bridge_name='br-int',has_traffic_filtering=True,id=b2301d06-4328-4ac4-a94a-54652369cc09,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2301d06-43')
Jul 24 17:10:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] No BDM found with device name vda, not building metadata. {{(pid=70243) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 24 17:10:13 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] No VIF found with MAC fa:16:3e:14:1c:f8, not building metadata {{(pid=70243) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 24 17:10:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:14 user nova-compute[70243]: DEBUG nova.compute.manager [req-6d211b32-3601-4117-b457-0474e67d3d15 req-4ed3ed82-31e7-4354-911e-f3996847dd80 service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Received event network-vif-plugged-b2301d06-4328-4ac4-a94a-54652369cc09 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:10:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6d211b32-3601-4117-b457-0474e67d3d15 req-4ed3ed82-31e7-4354-911e-f3996847dd80 service nova] Acquiring lock "0b703da3-3974-4067-8332-2e43ed1a7622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:10:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6d211b32-3601-4117-b457-0474e67d3d15 req-4ed3ed82-31e7-4354-911e-f3996847dd80 service nova] Lock "0b703da3-3974-4067-8332-2e43ed1a7622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:10:14 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-6d211b32-3601-4117-b457-0474e67d3d15 req-4ed3ed82-31e7-4354-911e-f3996847dd80 service nova] Lock "0b703da3-3974-4067-8332-2e43ed1a7622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:10:14 user nova-compute[70243]: DEBUG nova.compute.manager [req-6d211b32-3601-4117-b457-0474e67d3d15 req-4ed3ed82-31e7-4354-911e-f3996847dd80 service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] No waiting events found dispatching network-vif-plugged-b2301d06-4328-4ac4-a94a-54652369cc09 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:10:14 user nova-compute[70243]: WARNING nova.compute.manager [req-6d211b32-3601-4117-b457-0474e67d3d15 req-4ed3ed82-31e7-4354-911e-f3996847dd80 service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Received unexpected event network-vif-plugged-b2301d06-4328-4ac4-a94a-54652369cc09 for instance with vm_state building and task_state spawning.
Jul 24 17:10:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:14 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:15 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:16 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690218616.6358762, 0b703da3-3974-4067-8332-2e43ed1a7622 => Resumed> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:10:16 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] VM Resumed (Lifecycle Event)
Jul 24 17:10:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Instance event wait completed in 0 seconds for  {{(pid=70243) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 24 17:10:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Guest created on hypervisor {{(pid=70243) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 24 17:10:16 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Instance spawned successfully.
Jul 24 17:10:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 24 17:10:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:10:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:10:16 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:10:16 user nova-compute[70243]: DEBUG nova.virt.driver [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] Emitting event <LifecycleEvent: 1690218616.6406739, 0b703da3-3974-4067-8332-2e43ed1a7622 => Started> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:10:16 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] VM Started (Lifecycle Event)
Jul 24 17:10:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Found default for hw_cdrom_bus of ide {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:10:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Found default for hw_disk_bus of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:10:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Found default for hw_input_bus of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:10:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Found default for hw_pointer_model of None {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:10:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Found default for hw_video_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:10:16 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Found default for hw_vif_model of virtio {{(pid=70243) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 24 17:10:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:10:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=70243) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1397}}
Jul 24 17:10:16 user nova-compute[70243]: INFO nova.compute.manager [None req-b80c66f6-7340-415e-b1d4-ae1bbf2689a6 None None] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 24 17:10:16 user nova-compute[70243]: INFO nova.compute.manager [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Took 5.02 seconds to spawn the instance on the hypervisor.
Jul 24 17:10:16 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:10:16 user nova-compute[70243]: DEBUG nova.compute.manager [req-16424dcc-85f9-4a21-ae7f-956d386c8eef req-029f4d9a-d1cf-4a95-9a3c-47a1750b5466 service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Received event network-vif-plugged-b2301d06-4328-4ac4-a94a-54652369cc09 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:10:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-16424dcc-85f9-4a21-ae7f-956d386c8eef req-029f4d9a-d1cf-4a95-9a3c-47a1750b5466 service nova] Acquiring lock "0b703da3-3974-4067-8332-2e43ed1a7622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:10:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-16424dcc-85f9-4a21-ae7f-956d386c8eef req-029f4d9a-d1cf-4a95-9a3c-47a1750b5466 service nova] Lock "0b703da3-3974-4067-8332-2e43ed1a7622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:10:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-16424dcc-85f9-4a21-ae7f-956d386c8eef req-029f4d9a-d1cf-4a95-9a3c-47a1750b5466 service nova] Lock "0b703da3-3974-4067-8332-2e43ed1a7622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:10:16 user nova-compute[70243]: DEBUG nova.compute.manager [req-16424dcc-85f9-4a21-ae7f-956d386c8eef req-029f4d9a-d1cf-4a95-9a3c-47a1750b5466 service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] No waiting events found dispatching network-vif-plugged-b2301d06-4328-4ac4-a94a-54652369cc09 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:10:16 user nova-compute[70243]: WARNING nova.compute.manager [req-16424dcc-85f9-4a21-ae7f-956d386c8eef req-029f4d9a-d1cf-4a95-9a3c-47a1750b5466 service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Received unexpected event network-vif-plugged-b2301d06-4328-4ac4-a94a-54652369cc09 for instance with vm_state building and task_state spawning.
Jul 24 17:10:16 user nova-compute[70243]: INFO nova.compute.manager [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Took 12.13 seconds to build instance.
Jul 24 17:10:16 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e38a0a00-35bd-4a81-8dec-6fee517784d2 tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "0b703da3-3974-4067-8332-2e43ed1a7622" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.226s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:10:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:20 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:10:21 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:10:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:25 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:10:25 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:26 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:10:26 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:10:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:28 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:10:29 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:10:29 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:10:29 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 17:10:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:10:29 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:10:29 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 17:10:29 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lazy-loading 'info_cache' on Instance uuid 0d11e4f4-8109-40e8-8628-4db6ead413aa {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:10:29 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Updating instance_info_cache with network_info: [{"id": "f2445d51-83ba-4642-b53b-b50bd2371743", "address": "fa:16:3e:2b:70:4f", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2445d51-83", "ovs_interfaceid": "f2445d51-83ba-4642-b53b-b50bd2371743", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:10:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:10:30 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 17:10:30 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:31 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:10:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:33 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:10:35 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:38 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:10:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:10:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:10:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:10:38 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:10:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:10:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:10:38 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:10:38 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:10:38 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8672MB free_disk=24.110736846923828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:10:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:10:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:10:38 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 0d11e4f4-8109-40e8-8628-4db6ead413aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:10:38 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 0b703da3-3974-4067-8332-2e43ed1a7622 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:10:38 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:10:38 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:10:38 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing inventories for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 24 17:10:38 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Updating ProviderTree inventory for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 24 17:10:38 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Updating inventory in ProviderTree for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 24 17:10:38 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing aggregate associations for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0, aggregates: None {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 24 17:10:39 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Refreshing trait associations for resource provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0, traits: HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO {{(pid=70243) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 24 17:10:39 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:10:39 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:10:39 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:10:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.386s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:10:40 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:43 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:10:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:45 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:10:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:10:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:11:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:11:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:11:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:11:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:11:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:11:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:11:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:11:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:11:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:11:21 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:11:22 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:11:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:11:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:11:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:11:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:11:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:11:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:11:25 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:11:27 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:11:27 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:11:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:11:29 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:11:30 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:11:30 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:11:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-0b703da3-3974-4067-8332-2e43ed1a7622" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:11:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-0b703da3-3974-4067-8332-2e43ed1a7622" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:11:30 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 17:11:30 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Updating instance_info_cache with network_info: [{"id": "b2301d06-4328-4ac4-a94a-54652369cc09", "address": "fa:16:3e:14:1c:f8", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2301d06-43", "ovs_interfaceid": "b2301d06-4328-4ac4-a94a-54652369cc09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:11:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-0b703da3-3974-4067-8332-2e43ed1a7622" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:11:30 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 17:11:32 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:11:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:11:35 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:11:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:11:38 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:11:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:11:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:11:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:11:38 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:11:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:11:38 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:11:38 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:11:38 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:11:38 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8732MB free_disk=24.110076904296875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:11:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:11:38 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:11:39 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 0d11e4f4-8109-40e8-8628-4db6ead413aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:11:39 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 0b703da3-3974-4067-8332-2e43ed1a7622 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:11:39 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:11:39 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:11:39 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:11:39 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:11:39 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:11:39 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:11:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:11:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:11:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:11:55 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:11:56 user nova-compute[70243]: DEBUG nova.compute.manager [req-5de302c0-5098-413c-bbf8-a64bc9cf4e23 req-262e2bf6-f472-42e2-a7a7-b6e76dc0a095 service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Received event network-changed-b2301d06-4328-4ac4-a94a-54652369cc09 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:11:56 user nova-compute[70243]: DEBUG nova.compute.manager [req-5de302c0-5098-413c-bbf8-a64bc9cf4e23 req-262e2bf6-f472-42e2-a7a7-b6e76dc0a095 service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Refreshing instance network info cache due to event network-changed-b2301d06-4328-4ac4-a94a-54652369cc09. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:11:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5de302c0-5098-413c-bbf8-a64bc9cf4e23 req-262e2bf6-f472-42e2-a7a7-b6e76dc0a095 service nova] Acquiring lock "refresh_cache-0b703da3-3974-4067-8332-2e43ed1a7622" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:11:56 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5de302c0-5098-413c-bbf8-a64bc9cf4e23 req-262e2bf6-f472-42e2-a7a7-b6e76dc0a095 service nova] Acquired lock "refresh_cache-0b703da3-3974-4067-8332-2e43ed1a7622" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:11:56 user nova-compute[70243]: DEBUG nova.network.neutron [req-5de302c0-5098-413c-bbf8-a64bc9cf4e23 req-262e2bf6-f472-42e2-a7a7-b6e76dc0a095 service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Refreshing network info cache for port b2301d06-4328-4ac4-a94a-54652369cc09 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:11:57 user nova-compute[70243]: DEBUG nova.network.neutron [req-5de302c0-5098-413c-bbf8-a64bc9cf4e23 req-262e2bf6-f472-42e2-a7a7-b6e76dc0a095 service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Updated VIF entry in instance network info cache for port b2301d06-4328-4ac4-a94a-54652369cc09. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:11:57 user nova-compute[70243]: DEBUG nova.network.neutron [req-5de302c0-5098-413c-bbf8-a64bc9cf4e23 req-262e2bf6-f472-42e2-a7a7-b6e76dc0a095 service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Updating instance_info_cache with network_info: [{"id": "b2301d06-4328-4ac4-a94a-54652369cc09", "address": "fa:16:3e:14:1c:f8", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2301d06-43", "ovs_interfaceid": "b2301d06-4328-4ac4-a94a-54652369cc09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:11:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-5de302c0-5098-413c-bbf8-a64bc9cf4e23 req-262e2bf6-f472-42e2-a7a7-b6e76dc0a095 service nova] Releasing lock "refresh_cache-0b703da3-3974-4067-8332-2e43ed1a7622" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "0b703da3-3974-4067-8332-2e43ed1a7622" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "0b703da3-3974-4067-8332-2e43ed1a7622" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "0b703da3-3974-4067-8332-2e43ed1a7622-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "0b703da3-3974-4067-8332-2e43ed1a7622-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "0b703da3-3974-4067-8332-2e43ed1a7622-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:11:58 user nova-compute[70243]: INFO nova.compute.manager [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Terminating instance
Jul 24 17:11:58 user nova-compute[70243]: DEBUG nova.compute.manager [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-c6ed87ae-ca88-4c5e-ad58-28a13f8e5474 req-9f64959a-a4c5-4a8c-8979-2f34d8e1d5da service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Received event network-vif-unplugged-b2301d06-4328-4ac4-a94a-54652369cc09 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c6ed87ae-ca88-4c5e-ad58-28a13f8e5474 req-9f64959a-a4c5-4a8c-8979-2f34d8e1d5da service nova] Acquiring lock "0b703da3-3974-4067-8332-2e43ed1a7622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c6ed87ae-ca88-4c5e-ad58-28a13f8e5474 req-9f64959a-a4c5-4a8c-8979-2f34d8e1d5da service nova] Lock "0b703da3-3974-4067-8332-2e43ed1a7622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c6ed87ae-ca88-4c5e-ad58-28a13f8e5474 req-9f64959a-a4c5-4a8c-8979-2f34d8e1d5da service nova] Lock "0b703da3-3974-4067-8332-2e43ed1a7622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-c6ed87ae-ca88-4c5e-ad58-28a13f8e5474 req-9f64959a-a4c5-4a8c-8979-2f34d8e1d5da service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] No waiting events found dispatching network-vif-unplugged-b2301d06-4328-4ac4-a94a-54652369cc09 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG nova.compute.manager [req-c6ed87ae-ca88-4c5e-ad58-28a13f8e5474 req-9f64959a-a4c5-4a8c-8979-2f34d8e1d5da service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Received event network-vif-unplugged-b2301d06-4328-4ac4-a94a-54652369cc09 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:11:58 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Instance destroyed successfully.
Jul 24 17:11:58 user nova-compute[70243]: DEBUG nova.objects.instance [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lazy-loading 'resources' on Instance uuid 0b703da3-3974-4067-8332-2e43ed1a7622 {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-786161492',display_name='tempest-TestVolumeBootPattern-server-786161492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-786161492',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMa+Vfiu/hyBL6BjsKJMeUEZCpZEnJguBpbnuOLc84nZ65lifnwNPBAJSJztB2ZLidwnYoqrUnP9nJwiTuHlVXDJeVaK2xFSB8j3KUXPjcp7h8GbVzopH4gkVftS/l/s7w==',key_name='tempest-TestVolumeBootPattern-1868423947',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:10:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0b57210106d441e96e821af15cb9469',ramdisk_id='',reservation_id='r-om90tjvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-994857419',owner_user_name='tempest-TestVolumeBootPattern-994857419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:10:17Z,user_data=None,user_id='9f46574c91b549dda125d3d6874e26cc',uuid=0b703da3-3974-4067-8332-2e43ed1a7622,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2301d06-4328-4ac4-a94a-54652369cc09", "address": "fa:16:3e:14:1c:f8", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2301d06-43", "ovs_interfaceid": "b2301d06-4328-4ac4-a94a-54652369cc09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converting VIF {"id": "b2301d06-4328-4ac4-a94a-54652369cc09", "address": "fa:16:3e:14:1c:f8", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2301d06-43", "ovs_interfaceid": "b2301d06-4328-4ac4-a94a-54652369cc09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:1c:f8,bridge_name='br-int',has_traffic_filtering=True,id=b2301d06-4328-4ac4-a94a-54652369cc09,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2301d06-43') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG os_vif [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:1c:f8,bridge_name='br-int',has_traffic_filtering=True,id=b2301d06-4328-4ac4-a94a-54652369cc09,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2301d06-43') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2301d06-43, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:11:58 user nova-compute[70243]: INFO os_vif [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:1c:f8,bridge_name='br-int',has_traffic_filtering=True,id=b2301d06-4328-4ac4-a94a-54652369cc09,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2301d06-43')
Jul 24 17:11:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YEexSfXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:11:58 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:11:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:11:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f2c4c4-7d31-4708-9292-5186707a610b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:11:59 user nova-compute[70243]: No targets found.
Jul 24 17:11:59 user nova-compute[70243]: iSNS:
Jul 24 17:11:59 user nova-compute[70243]: No targets found.
Jul 24 17:11:59 user nova-compute[70243]: STATIC:
Jul 24 17:11:59 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555
Jul 24 17:11:59 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:11:59 user nova-compute[70243]:                 Iface Name: default
Jul 24 17:11:59 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb
Jul 24 17:11:59 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:11:59 user nova-compute[70243]:                 Iface Name: default
Jul 24 17:11:59 user nova-compute[70243]: FIRMWARE:
Jul 24 17:11:59 user nova-compute[70243]: No targets found.
Jul 24 17:11:59 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:11:59 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:11:59 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG nova.compute.manager [req-2f593a6c-4133-4457-b8c7-ed6b3af579e8 req-ecad5fd3-3610-4a61-815b-e479a1355cf6 service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Received event network-changed-b2301d06-4328-4ac4-a94a-54652369cc09 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG nova.compute.manager [req-2f593a6c-4133-4457-b8c7-ed6b3af579e8 req-ecad5fd3-3610-4a61-815b-e479a1355cf6 service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Refreshing instance network info cache due to event network-changed-b2301d06-4328-4ac4-a94a-54652369cc09. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2f593a6c-4133-4457-b8c7-ed6b3af579e8 req-ecad5fd3-3610-4a61-815b-e479a1355cf6 service nova] Acquiring lock "refresh_cache-0b703da3-3974-4067-8332-2e43ed1a7622" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2f593a6c-4133-4457-b8c7-ed6b3af579e8 req-ecad5fd3-3610-4a61-815b-e479a1355cf6 service nova] Acquired lock "refresh_cache-0b703da3-3974-4067-8332-2e43ed1a7622" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG nova.network.neutron [req-2f593a6c-4133-4457-b8c7-ed6b3af579e8 req-ecad5fd3-3610-4a61-815b-e479a1355cf6 service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Refreshing network info cache for port b2301d06-4328-4ac4-a94a-54652369cc09 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea9b736-1ec7-492e-b832-1f99ff807c02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e582e62d-ed79-428b-aa09-b598d08fd237]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb (non-flash)
Jul 24 17:11:59 user nova-compute[70243]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 (non-flash)
Jul 24 17:11:59 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb (non-flash)
Jul 24 17:11:59 user nova-compute[70243]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 (non-flash)
Jul 24 17:11:59 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91cc1356c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555'): ({'sdc'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Removing single pathed devices sdc {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf47400e-3edb-4cf4-9400-e6173f34cf00]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c972fef2-c65e-4057-945d-37ce421e8a98]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Flushing IO for device /dev/sdc {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c269cdd-fb75-4348-91ac-bba4227c112d]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[da54ddb0-00c2-4bed-a651-51e9ddfaa1ec]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] SCSI volumes sdc have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[726ed4c7-694b-4d26-b645-3be1bd277556]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfc9c30-4c73-44db-98c9-15da96905dc1]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555, portal: 172.16.0.220,3260]
Jul 24 17:11:59 user nova-compute[70243]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555, portal: 172.16.0.220,3260] successful.
Jul 24 17:11:59 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7010d2f-e370-4079-ac71-56b76acbf555 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb23ea1-a6d4-42b4-a1f8-acfb78561446]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] <== disconnect_volume: return (299ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:11:59 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Deleting instance files /opt/stack/data/nova/instances/0b703da3-3974-4067-8332-2e43ed1a7622_del
Jul 24 17:11:59 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Deletion of /opt/stack/data/nova/instances/0b703da3-3974-4067-8332-2e43ed1a7622_del complete
Jul 24 17:11:59 user nova-compute[70243]: INFO nova.compute.manager [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Took 1.15 seconds to destroy the instance on the hypervisor.
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG nova.network.neutron [req-2f593a6c-4133-4457-b8c7-ed6b3af579e8 req-ecad5fd3-3610-4a61-815b-e479a1355cf6 service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Updated VIF entry in instance network info cache for port b2301d06-4328-4ac4-a94a-54652369cc09. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG nova.network.neutron [req-2f593a6c-4133-4457-b8c7-ed6b3af579e8 req-ecad5fd3-3610-4a61-815b-e479a1355cf6 service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Updating instance_info_cache with network_info: [{"id": "b2301d06-4328-4ac4-a94a-54652369cc09", "address": "fa:16:3e:14:1c:f8", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2301d06-43", "ovs_interfaceid": "b2301d06-4328-4ac4-a94a-54652369cc09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-2f593a6c-4133-4457-b8c7-ed6b3af579e8 req-ecad5fd3-3610-4a61-815b-e479a1355cf6 service nova] Releasing lock "refresh_cache-0b703da3-3974-4067-8332-2e43ed1a7622" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:11:59 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:11:59 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Took 0.49 seconds to deallocate network for instance.
Jul 24 17:11:59 user nova-compute[70243]: DEBUG nova.compute.manager [req-8dbf4682-8f0b-4605-bd9b-03d77d7ec447 req-4cde9262-f11c-4296-bd3b-a47af76924aa service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Received event network-vif-deleted-b2301d06-4328-4ac4-a94a-54652369cc09 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:12:00 user nova-compute[70243]: DEBUG nova.compute.manager [req-b0fb6493-1fa9-4d12-b715-f12044ee86b2 req-d87f0580-7f2f-4a36-a833-73f289cedf3c service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Received event network-vif-plugged-b2301d06-4328-4ac4-a94a-54652369cc09 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:12:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b0fb6493-1fa9-4d12-b715-f12044ee86b2 req-d87f0580-7f2f-4a36-a833-73f289cedf3c service nova] Acquiring lock "0b703da3-3974-4067-8332-2e43ed1a7622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:12:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b0fb6493-1fa9-4d12-b715-f12044ee86b2 req-d87f0580-7f2f-4a36-a833-73f289cedf3c service nova] Lock "0b703da3-3974-4067-8332-2e43ed1a7622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:12:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-b0fb6493-1fa9-4d12-b715-f12044ee86b2 req-d87f0580-7f2f-4a36-a833-73f289cedf3c service nova] Lock "0b703da3-3974-4067-8332-2e43ed1a7622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:12:00 user nova-compute[70243]: DEBUG nova.compute.manager [req-b0fb6493-1fa9-4d12-b715-f12044ee86b2 req-d87f0580-7f2f-4a36-a833-73f289cedf3c service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] No waiting events found dispatching network-vif-plugged-b2301d06-4328-4ac4-a94a-54652369cc09 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:12:00 user nova-compute[70243]: WARNING nova.compute.manager [req-b0fb6493-1fa9-4d12-b715-f12044ee86b2 req-d87f0580-7f2f-4a36-a833-73f289cedf3c service nova] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Received unexpected event network-vif-plugged-b2301d06-4328-4ac4-a94a-54652369cc09 for instance with vm_state active and task_state deleting.
Jul 24 17:12:00 user nova-compute[70243]: INFO nova.compute.manager [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Took 0.76 seconds to detach 1 volumes for instance.
Jul 24 17:12:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:12:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:12:00 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:12:00 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:12:00 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:12:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:12:00 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Deleted allocations for instance 0b703da3-3974-4067-8332-2e43ed1a7622
Jul 24 17:12:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-26a33659-7858-4ed9-bb11-0dadd2dd37ee tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "0b703da3-3974-4067-8332-2e43ed1a7622" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.790s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:12:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:12:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:12:13 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690218718.9424837, 0b703da3-3974-4067-8332-2e43ed1a7622 => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:12:13 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] VM Stopped (Lifecycle Event)
Jul 24 17:12:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-f1df197e-842c-486c-95a9-8fabcaa77ee3 None None] [instance: 0b703da3-3974-4067-8332-2e43ed1a7622] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:12:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:12:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:12:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:12:24 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:12:24 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:12:27 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:12:27 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:12:27 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:12:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:12:30 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:12:30 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:12:30 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 17:12:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:12:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquired lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:12:30 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Forcefully refreshing network info cache for instance {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 24 17:12:30 user nova-compute[70243]: DEBUG nova.objects.instance [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lazy-loading 'info_cache' on Instance uuid 0d11e4f4-8109-40e8-8628-4db6ead413aa {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:12:30 user nova-compute[70243]: DEBUG nova.network.neutron [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Updating instance_info_cache with network_info: [{"id": "f2445d51-83ba-4642-b53b-b50bd2371743", "address": "fa:16:3e:2b:70:4f", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2445d51-83", "ovs_interfaceid": "f2445d51-83ba-4642-b53b-b50bd2371743", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:12:30 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Releasing lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:12:30 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Updated the network info_cache for instance {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9893}}
Jul 24 17:12:30 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:12:32 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:12:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:12:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:12:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:12:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:12:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:12:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:12:36 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:12:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:12:40 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:12:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:12:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:12:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:12:40 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:12:40 user nova-compute[70243]: DEBUG nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=70243) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 24 17:12:40 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:12:40 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:12:40 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8806MB free_disk=24.109149932861328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:12:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:12:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:12:40 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Instance 0d11e4f4-8109-40e8-8628-4db6ead413aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=70243) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1667}}
Jul 24 17:12:40 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:12:40 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:12:40 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:12:40 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:12:40 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:12:40 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:12:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:12:47 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:12:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:12:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:12:57 user nova-compute[70243]: DEBUG nova.compute.manager [req-57b42329-c149-4c9b-b7c6-9b62ecf36ad8 req-47594c1f-fcfe-435c-aba8-2f4c98e9625e service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Received event network-changed-f2445d51-83ba-4642-b53b-b50bd2371743 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:12:57 user nova-compute[70243]: DEBUG nova.compute.manager [req-57b42329-c149-4c9b-b7c6-9b62ecf36ad8 req-47594c1f-fcfe-435c-aba8-2f4c98e9625e service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Refreshing instance network info cache due to event network-changed-f2445d51-83ba-4642-b53b-b50bd2371743. {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11017}}
Jul 24 17:12:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-57b42329-c149-4c9b-b7c6-9b62ecf36ad8 req-47594c1f-fcfe-435c-aba8-2f4c98e9625e service nova] Acquiring lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 24 17:12:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-57b42329-c149-4c9b-b7c6-9b62ecf36ad8 req-47594c1f-fcfe-435c-aba8-2f4c98e9625e service nova] Acquired lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 24 17:12:57 user nova-compute[70243]: DEBUG nova.network.neutron [req-57b42329-c149-4c9b-b7c6-9b62ecf36ad8 req-47594c1f-fcfe-435c-aba8-2f4c98e9625e service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Refreshing network info cache for port f2445d51-83ba-4642-b53b-b50bd2371743 {{(pid=70243) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 24 17:12:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "0d11e4f4-8109-40e8-8628-4db6ead413aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:12:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "0d11e4f4-8109-40e8-8628-4db6ead413aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:12:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "0d11e4f4-8109-40e8-8628-4db6ead413aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:12:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "0d11e4f4-8109-40e8-8628-4db6ead413aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:12:57 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "0d11e4f4-8109-40e8-8628-4db6ead413aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:12:57 user nova-compute[70243]: INFO nova.compute.manager [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Terminating instance
Jul 24 17:12:57 user nova-compute[70243]: DEBUG nova.compute.manager [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Start destroying the instance on the hypervisor. {{(pid=70243) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3123}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:12:58 user nova-compute[70243]: INFO nova.virt.libvirt.driver [-] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Instance destroyed successfully.
Jul 24 17:12:58 user nova-compute[70243]: DEBUG nova.objects.instance [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lazy-loading 'resources' on Instance uuid 0d11e4f4-8109-40e8-8628-4db6ead413aa {{(pid=70243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1105}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.vif [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-07-24T17:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1348270684',display_name='tempest-TestVolumeBootPattern-server-1348270684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1348270684',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMa+Vfiu/hyBL6BjsKJMeUEZCpZEnJguBpbnuOLc84nZ65lifnwNPBAJSJztB2ZLidwnYoqrUnP9nJwiTuHlVXDJeVaK2xFSB8j3KUXPjcp7h8GbVzopH4gkVftS/l/s7w==',key_name='tempest-TestVolumeBootPattern-1868423947',keypairs=<?>,launch_index=0,launched_at=2023-07-24T17:08:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0b57210106d441e96e821af15cb9469',ramdisk_id='',reservation_id='r-7ctzmjta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-994857419',owner_user_name='tempest-TestVolumeBootPattern-994857419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-24T17:08:14Z,user_data=None,user_id='9f46574c91b549dda125d3d6874e26cc',uuid=0d11e4f4-8109-40e8-8628-4db6ead413aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2445d51-83ba-4642-b53b-b50bd2371743", "address": "fa:16:3e:2b:70:4f", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2445d51-83", "ovs_interfaceid": "f2445d51-83ba-4642-b53b-b50bd2371743", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converting VIF {"id": "f2445d51-83ba-4642-b53b-b50bd2371743", "address": "fa:16:3e:2b:70:4f", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2445d51-83", "ovs_interfaceid": "f2445d51-83ba-4642-b53b-b50bd2371743", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG nova.network.os_vif_util [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:70:4f,bridge_name='br-int',has_traffic_filtering=True,id=f2445d51-83ba-4642-b53b-b50bd2371743,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2445d51-83') {{(pid=70243) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG os_vif [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:70:4f,bridge_name='br-int',has_traffic_filtering=True,id=f2445d51-83ba-4642-b53b-b50bd2371743,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2445d51-83') {{(pid=70243) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2445d51-83, bridge=br-int, if_exists=True) {{(pid=70243) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:12:58 user nova-compute[70243]: INFO os_vif [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:70:4f,bridge_name='br-int',has_traffic_filtering=True,id=f2445d51-83ba-4642-b53b-b50bd2371743,network=Network(0c3bb14f-ca3b-4f0d-8159-e1959df1ba99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2445d51-83')
Jul 24 17:12:58 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] calling os-brick to detach iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f91cc555db0>, {'target_iqn': 'iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iZRgAkJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 24 17:12:58 user nova-compute[70243]: WARNING os_brick.initiator.connectors.base [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 24 17:12:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4ec455-a9da-4110-8ea5-ff6e814f6217]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 24 17:12:58 user nova-compute[70243]: No targets found.
Jul 24 17:12:58 user nova-compute[70243]: iSNS:
Jul 24 17:12:58 user nova-compute[70243]: No targets found.
Jul 24 17:12:58 user nova-compute[70243]: STATIC:
Jul 24 17:12:58 user nova-compute[70243]: Target: iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb
Jul 24 17:12:58 user nova-compute[70243]:         Portal: 172.16.0.220:3260,-1
Jul 24 17:12:58 user nova-compute[70243]:                 Iface Name: default
Jul 24 17:12:58 user nova-compute[70243]: FIRMWARE:
Jul 24 17:12:58 user nova-compute[70243]: No targets found.
Jul 24 17:12:58 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 24 17:12:58 user nova-compute[70243]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 24 17:12:58 user nova-compute[70243]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=70243) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb', 0)] {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8cb4bf-978d-4dad-80f1-c26cca654ac1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4416f5df-6aea-44a2-ac84-bb1dfff6cd34]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb (non-flash)\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb (non-flash)
Jul 24 17:12:58 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb (non-flash)
Jul 24 17:12:58 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91ac7451b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb'): ({'sdb'}, set())}) {{(pid=70243) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Removing single pathed devices sdb {{(pid=70243) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[284fe21e-0c38-46bb-806e-39ca32a3d023]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f86c2a-8269-4696-b2e6-54eef9d1ae33]: (4, ('ok\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Flushing IO for device /dev/sdb {{(pid=70243) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[452b7541-ac0b-478c-b72a-6ac3af22fbea]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=70243) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5721517-6b28-4624-b54a-a85aef17e7db]: (4, ('1', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG os_brick.initiator.linuxscsi [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] SCSI volumes sdb have been removed. {{(pid=70243) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23135343162366261', '/dev/disk/by-id/scsi-1SCST_BIOecd56350-1541b6ba216a8786', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ecd56350') {{(pid=81266) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe0ac44-b7ed-4e81-8dd7-d89eeafad039]: (4, None) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb')] {{(pid=70243) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dd0019-5dec-44c0-a2cb-2daaedfc2a0c]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --logout {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e44bf3-050b-4018-85f0-2a6fd0f8eaf8]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb, portal: 172.16.0.220,3260]
Jul 24 17:12:58 user nova-compute[70243]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb, portal: 172.16.0.220,3260] successful.
Jul 24 17:12:58 user nova-compute[70243]:  stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:12:58 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op delete {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 24 17:12:59 user nova-compute[70243]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18fd55fa-954a-4039-ab8b-6ebb8fdcc1fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81266) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 24 17:12:59 user nova-compute[70243]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a0a86c-2e5e-4546-9684-f23a08f12b10]: (4, ('', '')) {{(pid=81266) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 24 17:12:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=70243) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 24 17:12:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.base [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 24 17:12:59 user nova-compute[70243]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] <== disconnect_volume: return (306ms) None {{(pid=70243) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 24 17:12:59 user nova-compute[70243]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Disconnected iSCSI Volume {{(pid=70243) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 24 17:12:59 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Deleting instance files /opt/stack/data/nova/instances/0d11e4f4-8109-40e8-8628-4db6ead413aa_del
Jul 24 17:12:59 user nova-compute[70243]: INFO nova.virt.libvirt.driver [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Deletion of /opt/stack/data/nova/instances/0d11e4f4-8109-40e8-8628-4db6ead413aa_del complete
Jul 24 17:12:59 user nova-compute[70243]: DEBUG nova.network.neutron [req-57b42329-c149-4c9b-b7c6-9b62ecf36ad8 req-47594c1f-fcfe-435c-aba8-2f4c98e9625e service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Updated VIF entry in instance network info cache for port f2445d51-83ba-4642-b53b-b50bd2371743. {{(pid=70243) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 24 17:12:59 user nova-compute[70243]: DEBUG nova.network.neutron [req-57b42329-c149-4c9b-b7c6-9b62ecf36ad8 req-47594c1f-fcfe-435c-aba8-2f4c98e9625e service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Updating instance_info_cache with network_info: [{"id": "f2445d51-83ba-4642-b53b-b50bd2371743", "address": "fa:16:3e:2b:70:4f", "network": {"id": "0c3bb14f-ca3b-4f0d-8159-e1959df1ba99", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1267204958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b57210106d441e96e821af15cb9469", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2445d51-83", "ovs_interfaceid": "f2445d51-83ba-4642-b53b-b50bd2371743", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:12:59 user nova-compute[70243]: INFO nova.compute.manager [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Took 1.15 seconds to destroy the instance on the hypervisor.
Jul 24 17:12:59 user nova-compute[70243]: DEBUG oslo.service.loopingcall [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=70243) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 24 17:12:59 user nova-compute[70243]: DEBUG nova.compute.manager [-] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Deallocating network for instance {{(pid=70243) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2262}}
Jul 24 17:12:59 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] deallocate_for_instance() {{(pid=70243) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 24 17:12:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-57b42329-c149-4c9b-b7c6-9b62ecf36ad8 req-47594c1f-fcfe-435c-aba8-2f4c98e9625e service nova] Releasing lock "refresh_cache-0d11e4f4-8109-40e8-8628-4db6ead413aa" {{(pid=70243) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 24 17:12:59 user nova-compute[70243]: DEBUG nova.network.neutron [-] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Updating instance_info_cache with network_info: [] {{(pid=70243) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 24 17:12:59 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Took 0.55 seconds to deallocate network for instance.
Jul 24 17:12:59 user nova-compute[70243]: DEBUG nova.compute.manager [req-c4b98573-76cf-47a7-8c4b-dffbfd17542b req-2939427e-33d7-4dde-a00b-e44b7934f114 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Received event network-vif-unplugged-f2445d51-83ba-4642-b53b-b50bd2371743 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:12:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c4b98573-76cf-47a7-8c4b-dffbfd17542b req-2939427e-33d7-4dde-a00b-e44b7934f114 service nova] Acquiring lock "0d11e4f4-8109-40e8-8628-4db6ead413aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:12:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c4b98573-76cf-47a7-8c4b-dffbfd17542b req-2939427e-33d7-4dde-a00b-e44b7934f114 service nova] Lock "0d11e4f4-8109-40e8-8628-4db6ead413aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:12:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c4b98573-76cf-47a7-8c4b-dffbfd17542b req-2939427e-33d7-4dde-a00b-e44b7934f114 service nova] Lock "0d11e4f4-8109-40e8-8628-4db6ead413aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:12:59 user nova-compute[70243]: DEBUG nova.compute.manager [req-c4b98573-76cf-47a7-8c4b-dffbfd17542b req-2939427e-33d7-4dde-a00b-e44b7934f114 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] No waiting events found dispatching network-vif-unplugged-f2445d51-83ba-4642-b53b-b50bd2371743 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:12:59 user nova-compute[70243]: DEBUG nova.compute.manager [req-c4b98573-76cf-47a7-8c4b-dffbfd17542b req-2939427e-33d7-4dde-a00b-e44b7934f114 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Received event network-vif-unplugged-f2445d51-83ba-4642-b53b-b50bd2371743 for instance with task_state deleting. {{(pid=70243) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10790}}
Jul 24 17:12:59 user nova-compute[70243]: DEBUG nova.compute.manager [req-c4b98573-76cf-47a7-8c4b-dffbfd17542b req-2939427e-33d7-4dde-a00b-e44b7934f114 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Received event network-vif-plugged-f2445d51-83ba-4642-b53b-b50bd2371743 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:12:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c4b98573-76cf-47a7-8c4b-dffbfd17542b req-2939427e-33d7-4dde-a00b-e44b7934f114 service nova] Acquiring lock "0d11e4f4-8109-40e8-8628-4db6ead413aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:12:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c4b98573-76cf-47a7-8c4b-dffbfd17542b req-2939427e-33d7-4dde-a00b-e44b7934f114 service nova] Lock "0d11e4f4-8109-40e8-8628-4db6ead413aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:12:59 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [req-c4b98573-76cf-47a7-8c4b-dffbfd17542b req-2939427e-33d7-4dde-a00b-e44b7934f114 service nova] Lock "0d11e4f4-8109-40e8-8628-4db6ead413aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:12:59 user nova-compute[70243]: DEBUG nova.compute.manager [req-c4b98573-76cf-47a7-8c4b-dffbfd17542b req-2939427e-33d7-4dde-a00b-e44b7934f114 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] No waiting events found dispatching network-vif-plugged-f2445d51-83ba-4642-b53b-b50bd2371743 {{(pid=70243) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 24 17:12:59 user nova-compute[70243]: WARNING nova.compute.manager [req-c4b98573-76cf-47a7-8c4b-dffbfd17542b req-2939427e-33d7-4dde-a00b-e44b7934f114 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Received unexpected event network-vif-plugged-f2445d51-83ba-4642-b53b-b50bd2371743 for instance with vm_state active and task_state deleting.
Jul 24 17:12:59 user nova-compute[70243]: DEBUG nova.compute.manager [req-c4b98573-76cf-47a7-8c4b-dffbfd17542b req-2939427e-33d7-4dde-a00b-e44b7934f114 service nova] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Received event network-vif-deleted-f2445d51-83ba-4642-b53b-b50bd2371743 {{(pid=70243) external_instance_event /opt/stack/nova/nova/compute/manager.py:11012}}
Jul 24 17:13:00 user nova-compute[70243]: INFO nova.compute.manager [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Took 0.71 seconds to detach 1 volumes for instance.
Jul 24 17:13:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:13:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:13:00 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:13:00 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:13:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:13:00 user nova-compute[70243]: INFO nova.scheduler.client.report [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Deleted allocations for instance 0d11e4f4-8109-40e8-8628-4db6ead413aa
Jul 24 17:13:00 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-e3040990-ac37-4390-bfad-ce3f830cb31d tempest-TestVolumeBootPattern-994857419 tempest-TestVolumeBootPattern-994857419-project-member] Lock "0d11e4f4-8109-40e8-8628-4db6ead413aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.705s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:13:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:13:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:13:13 user nova-compute[70243]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690218778.670045, 0d11e4f4-8109-40e8-8628-4db6ead413aa => Stopped> {{(pid=70243) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 24 17:13:13 user nova-compute[70243]: INFO nova.compute.manager [-] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] VM Stopped (Lifecycle Event)
Jul 24 17:13:13 user nova-compute[70243]: DEBUG nova.compute.manager [None req-60a3fb5f-cd87-48f6-b220-6a5a5f6c88dc None None] [instance: 0d11e4f4-8109-40e8-8628-4db6ead413aa] Checking state {{(pid=70243) _get_power_state /opt/stack/nova/nova/compute/manager.py:1765}}
Jul 24 17:13:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:13:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:13:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:13:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:13:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:13:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:13:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:13:23 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:13:24 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:13:26 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:13:27 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:13:27 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:13:27 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=70243) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10441}}
Jul 24 17:13:28 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:13:32 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:13:32 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Starting heal instance info cache {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9822}}
Jul 24 17:13:32 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Rebuilding the list of instances to heal {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9826}}
Jul 24 17:13:32 user nova-compute[70243]: DEBUG nova.compute.manager [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Didn't find any instances for network info cache update. {{(pid=70243) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9908}}
Jul 24 17:13:32 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:13:32 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:13:33 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:13:34 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:13:36 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:13:38 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:13:41 user nova-compute[70243]: DEBUG oslo_service.periodic_task [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=70243) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 24 17:13:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:13:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:13:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:13:41 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Auditing locally available compute resources for user (node: user) {{(pid=70243) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:896}}
Jul 24 17:13:41 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:13:41 user nova-compute[70243]: WARNING nova.virt.libvirt.driver [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 24 17:13:41 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Hypervisor/Node resource view: name=user free_ram=8920MB free_disk=24.10821533203125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=70243) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1069}}
Jul 24 17:13:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 24 17:13:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 24 17:13:41 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1092}}
Jul 24 17:13:41 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=70243) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1101}}
Jul 24 17:13:41 user nova-compute[70243]: DEBUG nova.compute.provider_tree [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed in ProviderTree for provider: 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 {{(pid=70243) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 24 17:13:41 user nova-compute[70243]: DEBUG nova.scheduler.client.report [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Inventory has not changed for provider 428d8cd7-181b-4d2d-ad06-02c79cc6b5e0 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=70243) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 24 17:13:41 user nova-compute[70243]: DEBUG nova.compute.resource_tracker [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Compute_service record updated for user:user {{(pid=70243) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1030}}
Jul 24 17:13:41 user nova-compute[70243]: DEBUG oslo_concurrency.lockutils [None req-c4005ba9-a0ae-4cdd-8283-240354415a56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=70243) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 24 17:13:43 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:13:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:13:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:13:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=70243) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 24 17:13:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:13:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=70243) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 24 17:13:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:13:48 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:13:53 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:13:56 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:13:58 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:13:59 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:14:03 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:14:08 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 24 17:14:13 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 24 17:14:18 user nova-compute[70243]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=70243) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}